-- Logs begin at Tue 2021-08-31 02:26:14 UTC, end at Tue 2021-08-31 03:21:55 UTC. -- Aug 31 02:51:19.635487 dv-cinder-806665-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 02:51:19.642852 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 02:51:19.644902 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 31 02:51:19 2021] *** Aug 31 02:51:19.644902 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 02:51:19.644902 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 02:51:19.644902 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: nodename: dv-cinder-806665-1-iscsi Aug 31 02:51:19.644902 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: machine: x86_64 Aug 31 02:51:19.644902 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: clock source: unix Aug 31 02:51:19.644902 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: pcre jit disabled Aug 31 02:51:19.644902 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: detected number of CPU cores: 4 Aug 31 02:51:19.645335 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: current working directory: / Aug 31 02:51:19.645335 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: detected binary path: /usr/bin/uwsgi-core Aug 31 02:51:19.645335 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: your processes number limit is 47680 Aug 31 02:51:19.645335 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: your memory page size is 4096 bytes Aug 31 02:51:19.645335 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: detected max file descriptor number: 2048 Aug 31 02:51:19.645335 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: lock engine: pthread robust mutexes Aug 31 02:51:19.645335 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: thunder lock: enabled Aug 31 02:51:19.645335 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 02:51:19.645335 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 31 02:51:19.704680 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: Python main interpreter initialized at 0x5615a6e6b9c0 Aug 31 02:51:19.704680 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: python threads support enabled Aug 31 02:51:19.704680 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: your server socket listen backlog is limited to 100 connections Aug 31 02:51:19.704680 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: your mercy for graceful operations on workers is 90 seconds Aug 31 02:51:19.705060 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 02:51:19.705127 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: *** Operational MODE: preforking *** Aug 31 02:51:19.705412 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: *** uWSGI is running in multiple interpreter mode *** Aug 31 02:51:19.705412 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: spawned uWSGI master process (pid: 73332) Aug 31 02:51:19.705622 dv-cinder-806665-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 31 02:51:19.706422 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: spawned uWSGI worker 1 (pid: 73350, cores: 1) Aug 31 02:51:19.706522 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: spawned uWSGI worker 2 (pid: 73351, cores: 1) Aug 31 02:51:19.707432 dv-cinder-806665-1-iscsi devstack@keystone.service[73332]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 02:51:24.733031 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 02:51:24.733031 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: from cryptography.utils import int_from_bytes Aug 31 02:51:24.733822 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 02:51:24.733822 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: from cryptography.utils import int_from_bytes Aug 31 02:51:24.734242 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 02:51:24.734242 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: from cryptography.utils import int_from_bytes Aug 31 02:51:24.734346 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 02:51:24.734346 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: from cryptography.utils import int_from_bytes Aug 31 02:51:24.783267 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 02:51:24.783622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 02:51:24.783721 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 02:51:24.783812 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 02:51:24.783893 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] command line args: [] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 02:51:24.783975 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] command line args: [] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 02:51:24.783975 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 02:51:24.784115 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 02:51:24.784191 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ================================================================================ {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 02:51:24.784273 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ================================================================================ {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 02:51:24.784350 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] admin_token = **** {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.784431 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] admin_token = **** {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.784554 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] config_dir = [] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.784641 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] config_dir = [] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.784745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.784829 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.784906 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] config_source = [] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.784987 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] config_source = [] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.785088 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] debug = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.785167 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] debug = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.785285 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.785552 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.785644 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.785711 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.785852 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.785960 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.786064 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.786172 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.786277 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.786390 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.786502 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] list_limit = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.786604 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] list_limit = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.786701 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] log_config_append = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.786814 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] log_config_append = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.786918 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.787020 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.787123 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] log_dir = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.787225 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] log_dir = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.787332 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] log_file = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.787475 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] log_file = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.787590 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.787721 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.787721 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.787912 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.787994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.788122 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.788199 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.788329 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.788407 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.788533 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.788622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.788696 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.788819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.788908 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.788987 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.789112 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.789196 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.789274 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.789391 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.789467 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.789588 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.789670 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.789797 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.789880 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.790004 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.790095 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.790246 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.790329 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.790518 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.790606 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.791006 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.791090 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.791190 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] publish_errors = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.791268 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] publish_errors = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.791446 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.791538 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.791682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.791760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.791858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.791935 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.792102 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.792232 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.792317 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.792394 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.792551 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] standard_threads = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.792628 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] standard_threads = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.792777 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.792860 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.793022 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.793150 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.793253 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.793329 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.793414 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] use_journal = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.793494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] use_journal = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.793571 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] use_json = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.793649 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] use_json = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.793721 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] use_stderr = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.793797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] use_stderr = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.793877 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] use_syslog = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.793955 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] use_syslog = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.794061 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.794158 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 02:51:24.794314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.794394 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.794551 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.794635 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.794808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.794895 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.795043 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.795125 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.795288 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.795380 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.795552 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.795631 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.795797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.795883 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.796031 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.796110 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.796263 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.796339 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.796506 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.796584 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.796752 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.796831 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.796983 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.797065 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.797225 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.797300 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.797996 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.798083 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.798247 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.798324 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.798495 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.798578 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.798734 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.798812 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.798989 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.799072 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.799230 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.799317 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.799489 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.799571 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.799740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.799818 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.799998 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.800086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.800246 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.800328 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.800493 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.800581 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.800724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.800807 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.800950 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.801027 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.801177 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.801253 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.801410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.801494 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.801657 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.801739 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.801901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.801977 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.802131 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.802282 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.802357 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.802426 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.802587 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.802671 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.802831 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.802919 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.803064 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.803141 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.803310 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.803414 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.803565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.803651 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.803798 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.803874 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.804026 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.804101 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.804258 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.804344 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.804486 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.804568 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.804712 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.804787 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.804940 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.805023 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.805172 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.805254 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.805416 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.805497 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.805643 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.805727 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.805876 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.805959 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.806102 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.806183 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.806332 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.806449 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.806550 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.806651 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.806798 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.806903 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.807029 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.807175 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.807286 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.807455 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.807535 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.807655 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.807738 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.807811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.807929 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.808015 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.808166 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.808303 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.808439 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.808567 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.808691 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.808811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.808948 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.809074 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.809212 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.809337 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.809473 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.809608 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.809738 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.809864 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.809996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.810122 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.810271 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.810395 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.810517 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.810643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.810765 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.810891 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.811021 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.811150 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.811289 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.811451 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.811585 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.811719 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.811849 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.811973 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.812096 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.812220 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.812347 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.812482 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.812612 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.812745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.812874 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.813023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.813165 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.813289 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.813429 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.813607 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.813740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.813869 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.814003 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.814003 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.814319 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.814448 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.814573 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.814695 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.814822 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.814949 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.815094 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.815223 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.815351 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.815523 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.815652 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.815779 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.815921 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.816050 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.816188 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.816315 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.816448 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.816580 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.816719 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.816858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.816994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.817130 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.817254 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.817386 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.817515 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.817649 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.817784 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.817912 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] auth.external = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.818040 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.818167 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.818299 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] auth.external = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.818434 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.818565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.818708 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.818832 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.818962 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] auth.password = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.819084 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.819219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] auth.token = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.819348 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] auth.password = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.819496 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.819618 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] auth.token = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.819745 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.819873 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.820013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.820141 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.820269 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.820405 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.820533 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.820661 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.820797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.820927 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.821059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.821187 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.821324 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] credential.caching = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.821457 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.821615 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.821755 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] credential.caching = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.821891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.822022 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.822150 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.822292 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.822430 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.822558 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.822697 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.822832 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.822960 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.823091 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.823218 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.823345 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.823490 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.823620 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.823748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.823882 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.824020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.824150 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.824286 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.824415 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.824543 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.824670 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.824798 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.824926 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.825061 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.825197 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.825331 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.825459 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.825588 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] federation.caching = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.825715 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.825860 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.825989 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] federation.caching = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.826117 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.826251 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.826381 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.826509 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.826645 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.826773 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.826901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.827030 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.827159 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.827264 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.827429 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.827566 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.827696 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.827819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.827947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.828085 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.828214 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.828214 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.828456 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.829101 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] identity.caching = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.829234 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.829418 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.829571 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.829701 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.829829 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] identity.caching = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.829969 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.830098 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.830304 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.830436 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.830566 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.830695 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.830831 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.830965 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.831102 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.831237 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.831379 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.831515 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.831640 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.831773 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.831910 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.832039 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.832174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.832303 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.832431 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.832560 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.832696 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.832825 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.832954 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.833081 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.833207 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.833330 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.833461 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.833595 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.833724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.833852 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.833935 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.834068 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.834206 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.834331 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.834455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.834580 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.834703 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.834825 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.834959 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.835084 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.835218 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.835343 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.835487 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.835615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.835756 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.835885 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.836013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.836141 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.836268 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.836415 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.836547 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.836678 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.836806 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.836933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.837076 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.837209 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.837345 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.837473 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.837473 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.837713 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.837840 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.837967 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.838103 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.838241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.838363 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.838491 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.838620 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.838755 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.838893 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.839020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.839147 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.839280 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.839432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.839565 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.839691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.839814 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.839937 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.840060 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.840182 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.840313 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.840437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.840560 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.840694 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.840818 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.840942 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.841073 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.841197 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.841321 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.841444 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.841567 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.841690 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.841821 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.841946 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.842069 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.842192 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.842325 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.842455 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.842587 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.842717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.842841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.842965 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.843088 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.843217 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.843348 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.843501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.843625 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.843748 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.843870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.844002 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.844148 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.844353 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.844984 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.844984 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.845219 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.845344 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.845485 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.845615 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.845739 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.845862 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.845985 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.846109 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.846241 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.846381 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.846506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.846506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.846746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.846746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.846987 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.847120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.847120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.847355 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.847499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.847627 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.847766 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.847896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.848024 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.848165 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.848295 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.848424 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.848559 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.848688 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.848816 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.848944 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.849072 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.849200 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.849336 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.849461 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.849585 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.849717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.849846 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.849991 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.850133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.850263 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.850397 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.850528 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.850655 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.850655 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.850909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.851038 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.851166 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.851295 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.851515 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.851599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.851786 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.851913 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.852037 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.852161 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.852290 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.852416 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] resource.caching = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.852547 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.852673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.852796 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.852920 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.853043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.853167 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.853298 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.853422 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.853556 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] resource.caching = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.853681 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.853805 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.853928 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.854059 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.854184 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.854308 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.854431 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.854555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.854679 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.854811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.854935 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] role.caching = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.855059 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.855183 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] role.driver = sql {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.855316 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.855524 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.855651 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.855781 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.855909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.856037 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.856165 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] role.caching = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.856301 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.856430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] role.driver = sql {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.856559 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.856687 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.856816 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.856944 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.857092 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.857222 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.857351 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.857480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.857609 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.857737 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.857878 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.858000 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.858129 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.858257 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.858385 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.858513 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.858650 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.858789 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.858919 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.859046 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.859046 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.859288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.859507 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.859632 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.859757 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.859898 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.860023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.860157 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.860157 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.860401 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.860531 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.860666 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.860791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.860916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.861049 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.861174 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.861298 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.861423 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.861546 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.861677 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.861803 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.861927 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.862052 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.862175 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.862313 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.862446 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.862572 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.862695 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.862826 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.862951 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.863077 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.863213 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.863339 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.863484 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.863562 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.863635 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.863707 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.863795 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.863878 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] token.caching = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.863952 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.864025 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.864096 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.864168 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.864247 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.864322 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.864393 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.864464 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.864536 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] token.caching = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.864607 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.864687 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.864761 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.864833 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.864905 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.864977 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.865048 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.865128 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.865202 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.865274 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.865346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.865417 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.865489 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.865489 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.865628 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.865700 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.865771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.865842 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.865913 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.865992 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.866072 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.866145 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.866223 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.866296 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.866367 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.866446 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.connection = **** {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.866520 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.866592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.866663 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.866734 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.866805 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.866885 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.866960 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.867031 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.867031 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.867154 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.867225 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.867304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.connection = **** {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.867418 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.867494 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.867566 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.867639 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.867710 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.867793 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.867867 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.867938 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.868009 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.868089 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.868170 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.868243 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.868322 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.868396 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.868468 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.868540 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.868611 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.868682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.868760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.868833 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.868904 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.868975 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.869054 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.869135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.869208 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 02:51:24.869281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.869281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.869281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.869281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.869281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.869281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 02:51:24.869281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 02:51:24.896215 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:24.896400 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:24.896487 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:24.896633 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:24.896716 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:24.896859 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:24.904983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:24.905274 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:24.934111 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:24.934232 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:24.934453 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:24.934538 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:24.987792 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:24.987926 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.039994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.040227 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.105534 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.105768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.110340 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.110581 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.110805 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.111026 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.111247 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.111487 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.149799 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.150153 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.150285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.150423 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.150634 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.150846 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.173972 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.174214 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.174415 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.174640 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.174862 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.175078 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.175294 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.188551 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.208989 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.209314 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.209639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.209959 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.210271 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.210584 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.210888 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.211316 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.211646 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.211872 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.212095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.212313 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.212529 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.212745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.220925 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.223941 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.224173 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.224397 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.224619 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.224835 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.225045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.225254 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 02:51:25.235338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.235564 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.235720 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 02:51:25.235859 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 02:51:25.236005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.236138 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.236270 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 02:51:25.236410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 02:51:25.236540 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.236666 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.236793 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.236921 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.237048 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.237186 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.237316 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.237455 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.248403 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.248640 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.248919 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.249200 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.252537 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.252930 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.253312 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.253708 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.258419 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.261693 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.261973 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.262263 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.262543 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.262837 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.263111 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.263397 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.263671 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.263951 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.264229 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.264494 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.265178 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.271183 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.271598 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.271981 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.272367 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.272673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.272929 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.273191 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.273455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.273717 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.273981 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.274241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.292312 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.293895 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.294186 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.300135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.300412 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.300547 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.300807 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.302129 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.302404 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.307619 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.308006 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.308139 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.308269 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.308415 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.312745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.313559 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.313852 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.314144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.314416 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.314686 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.314953 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.315226 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.315937 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.316218 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.320602 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.320885 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.321164 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.321442 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.321713 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.321984 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.322251 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.322512 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.334277 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.334554 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.339099 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.341498 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.341773 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.342724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.343020 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.346257 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.348244 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.349801 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.350200 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.351822 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.355083 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.355416 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.355717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.356001 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.356295 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.356582 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.356858 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.358644 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.362246 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.362540 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.362823 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.363100 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.363397 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.363682 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.376493 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.376773 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.377040 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.377302 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.383473 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.383763 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.384027 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.384286 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.385018 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.386683 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.386960 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.390124 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.390405 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.390694 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.390970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.391819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.392655 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.394321 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.394594 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.397725 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.398008 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.398287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.398561 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.398832 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.405260 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.405542 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.405821 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.406098 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.407869 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.408172 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.408475 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.411880 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.412156 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.412432 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.412715 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.413083 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.413355 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.413635 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.426328 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.429558 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.431164 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.432841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.434386 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.434553 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.436188 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.436467 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.436746 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.437633 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.441106 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.442702 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.442975 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.443261 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.444573 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.446149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.449344 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.449634 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.450027 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.450301 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.450464 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.451957 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.455748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.456032 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.456416 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.456691 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.460926 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.461213 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.461494 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.465947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.466232 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.466509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.469356 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.469642 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.469925 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.470198 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.470468 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.470841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.471141 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.471437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.471710 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.471979 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.472256 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.473246 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.473246 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.473246 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.475315 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 02:51:25.475613 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.475889 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.476161 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.476446 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.476815 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.477098 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.477366 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.477637 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.477906 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.478181 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.478448 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.478731 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.479007 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 02:51:25.511445 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5615a6e6b9c0 pid: 73351 (default app) Aug 31 02:51:25.514757 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa37e92-130f-4e92-b9be-30b639b17017 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:25.515049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa37e92-130f-4e92-b9be-30b639b17017 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:25.515324 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa37e92-130f-4e92-b9be-30b639b17017 None None] PATH_INFO: `/v3` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:25.517586 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5615a6e6b9c0 pid: 73350 (default app) Aug 31 02:51:25.520024 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 792 bytes} [Tue Aug 31 02:51:25 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:33.217639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf720784-865d-48e3-9a7d-236da2d8d7c1 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:33.218151 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf720784-865d-48e3-9a7d-236da2d8d7c1 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:33.218238 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf720784-865d-48e3-9a7d-236da2d8d7c1 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:33.223598 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:33 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:33.229347 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cf39a-fa5f-4ad1-9143-24e2a0d519ef None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:33.229709 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cf39a-fa5f-4ad1-9143-24e2a0d519ef None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:33.229900 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cf39a-fa5f-4ad1-9143-24e2a0d519ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:33.261563 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG oslo_db.sqlalchemy.engines [None req-3b5cf39a-fa5f-4ad1-9143-24e2a0d519ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 02:51:33.448517 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG passlib.handlers.bcrypt [None req-3b5cf39a-fa5f-4ad1-9143-24e2a0d519ef None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73351) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 02:51:33.448843 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG passlib.handlers.bcrypt [None req-3b5cf39a-fa5f-4ad1-9143-24e2a0d519ef None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73351) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 02:51:33.503806 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-3b5cf39a-fa5f-4ad1-9143-24e2a0d519ef None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:33.505396 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-3b5cf39a-fa5f-4ad1-9143-24e2a0d519ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:33.648100 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:51:33.774081 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf720784-865d-48e3-9a7d-236da2d8d7c1 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:33.808044 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG oslo_db.sqlalchemy.engines [None req-bf720784-865d-48e3-9a7d-236da2d8d7c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 02:51:33.937137 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf720784-865d-48e3-9a7d-236da2d8d7c1 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:33.941507 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2695c-70a5-49fc-9130-c91a4fc70448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:33.942165 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2695c-70a5-49fc-9130-c91a4fc70448 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:33.942451 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2695c-70a5-49fc-9130-c91a4fc70448 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:33.942735 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2695c-70a5-49fc-9130-c91a4fc70448 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:33.950626 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2695c-70a5-49fc-9130-c91a4fc70448 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:34.001429 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5cb2695c-70a5-49fc-9130-c91a4fc70448 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 02:51:34.001769 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2695c-70a5-49fc-9130-c91a4fc70448 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:34.010901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:51:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:51:34.018149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cf39a-fa5f-4ad1-9143-24e2a0d519ef None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:34.032870 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cf39a-fa5f-4ad1-9143-24e2a0d519ef None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:34.037304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69299df-5d5d-4cbc-8dc1-3fd6482297f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:34.038377 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69299df-5d5d-4cbc-8dc1-3fd6482297f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:34.038660 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69299df-5d5d-4cbc-8dc1-3fd6482297f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:34.038939 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69299df-5d5d-4cbc-8dc1-3fd6482297f5 admin admin] PATH_INFO: `/v3/projects/8eb33f1e09d7463d8975fc4c37c2e87b` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:34.040459 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69299df-5d5d-4cbc-8dc1-3fd6482297f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=8eb33f1e09d7463d8975fc4c37c2e87b)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:34.092406 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b69299df-5d5d-4cbc-8dc1-3fd6482297f5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 02:51:34.092749 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69299df-5d5d-4cbc-8dc1-3fd6482297f5 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:34.097358 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:51:34 2021] GET /identity/v3/projects/8eb33f1e09d7463d8975fc4c37c2e87b => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:36.221015 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d05692-134c-412e-914f-3a7e0f5a0719 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:36.221578 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d05692-134c-412e-914f-3a7e0f5a0719 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:36.221578 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d05692-134c-412e-914f-3a7e0f5a0719 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:36.226046 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:36 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:51:36.232090 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a95a32-3997-4e0d-bc8f-7dae679e9e6d None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:36.232518 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a95a32-3997-4e0d-bc8f-7dae679e9e6d None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:36.232648 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a95a32-3997-4e0d-bc8f-7dae679e9e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:36.252465 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-79a95a32-3997-4e0d-bc8f-7dae679e9e6d None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:36.253975 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-79a95a32-3997-4e0d-bc8f-7dae679e9e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:36.261787 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:51:36.284990 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d05692-134c-412e-914f-3a7e0f5a0719 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:36.297979 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d05692-134c-412e-914f-3a7e0f5a0719 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:36.302287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fff98-3ee5-4803-b874-67ca7d92422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:36.302929 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fff98-3ee5-4803-b874-67ca7d92422f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:36.303213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fff98-3ee5-4803-b874-67ca7d92422f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:36.303532 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fff98-3ee5-4803-b874-67ca7d92422f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:36.311303 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fff98-3ee5-4803-b874-67ca7d92422f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:36.313923 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fff98-3ee5-4803-b874-67ca7d92422f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:36.322398 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:51:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:51:36.328653 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a95a32-3997-4e0d-bc8f-7dae679e9e6d None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:36.337589 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a95a32-3997-4e0d-bc8f-7dae679e9e6d None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:36.342045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01693c-abe8-4673-837c-49a915c12b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:36.342897 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01693c-abe8-4673-837c-49a915c12b2b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:36.343183 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01693c-abe8-4673-837c-49a915c12b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:36.343497 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01693c-abe8-4673-837c-49a915c12b2b admin admin] PATH_INFO: `/v3/users/2a89afdaf4304b8588d33fcfb779c592` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:36.345015 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01693c-abe8-4673-837c-49a915c12b2b admin admin] RBAC: Authorizing `identity:get_user(user_id=2a89afdaf4304b8588d33fcfb779c592)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:36.346835 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01693c-abe8-4673-837c-49a915c12b2b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:36.348412 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:51:36 2021] GET /identity/v3/users/2a89afdaf4304b8588d33fcfb779c592 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:38.549089 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ab2ea-1e4f-4bed-935a-3ab1f6950f4e None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:38.549612 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ab2ea-1e4f-4bed-935a-3ab1f6950f4e None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:38.549695 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ab2ea-1e4f-4bed-935a-3ab1f6950f4e None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:38.551394 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:38.557424 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50246ec3-fb29-4ca0-baaf-bae9326f841d None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:38.557816 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50246ec3-fb29-4ca0-baaf-bae9326f841d None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:38.558088 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50246ec3-fb29-4ca0-baaf-bae9326f841d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:38.576295 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-50246ec3-fb29-4ca0-baaf-bae9326f841d None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:38.577460 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-50246ec3-fb29-4ca0-baaf-bae9326f841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:38.582147 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad2f55-da7a-491e-82f8-42a710a13a60 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:38.582440 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad2f55-da7a-491e-82f8-42a710a13a60 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:38.582720 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad2f55-da7a-491e-82f8-42a710a13a60 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:38.584479 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:51:38.586484 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:51:38.590177 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2413fe9-a45e-43bc-8353-b1fa8fcaabaa None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:38.590465 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2413fe9-a45e-43bc-8353-b1fa8fcaabaa None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:38.590741 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2413fe9-a45e-43bc-8353-b1fa8fcaabaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:38.611745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50246ec3-fb29-4ca0-baaf-bae9326f841d None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:38.620583 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50246ec3-fb29-4ca0-baaf-bae9326f841d None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:38.625811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc6f0e-91e9-4f7d-9896-e5be78786ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:38.626598 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc6f0e-91e9-4f7d-9896-e5be78786ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:38.626879 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc6f0e-91e9-4f7d-9896-e5be78786ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:38.627150 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc6f0e-91e9-4f7d-9896-e5be78786ae6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:38.633728 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG passlib.handlers.bcrypt [None req-c2413fe9-a45e-43bc-8353-b1fa8fcaabaa None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73350) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 02:51:38.634155 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG passlib.handlers.bcrypt [None req-c2413fe9-a45e-43bc-8353-b1fa8fcaabaa None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73350) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 02:51:38.639893 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc6f0e-91e9-4f7d-9896-e5be78786ae6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:51:38.646771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-84cc6f0e-91e9-4f7d-9896-e5be78786ae6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:51:38.647970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 7/13] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:51:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:51:38.654305 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc6f0e-91e9-4f7d-9896-e5be78786ae6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:38.663577 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc6f0e-91e9-4f7d-9896-e5be78786ae6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:38.667883 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4288fbb-dc00-4541-bb0e-f5df88d71057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:38.668471 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4288fbb-dc00-4541-bb0e-f5df88d71057 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:38.668749 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4288fbb-dc00-4541-bb0e-f5df88d71057 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:38.669019 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4288fbb-dc00-4541-bb0e-f5df88d71057 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:38.669727 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4288fbb-dc00-4541-bb0e-f5df88d71057 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:38.670025 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4288fbb-dc00-4541-bb0e-f5df88d71057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:38.671792 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-e4288fbb-dc00-4541-bb0e-f5df88d71057 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:51:38.671792 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 02:51:38.671792 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 02:51:38.673369 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4288fbb-dc00-4541-bb0e-f5df88d71057 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:38.680321 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-c2413fe9-a45e-43bc-8353-b1fa8fcaabaa None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:38.681901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c2413fe9-a45e-43bc-8353-b1fa8fcaabaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:38.685602 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 8/14] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:51:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:51:38.692113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4288fbb-dc00-4541-bb0e-f5df88d71057 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:38.701166 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4288fbb-dc00-4541-bb0e-f5df88d71057 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:38.705622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8097b3-022e-4fcc-90bd-af433cded952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:38.706426 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8097b3-022e-4fcc-90bd-af433cded952 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:38.706701 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8097b3-022e-4fcc-90bd-af433cded952 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:38.706967 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8097b3-022e-4fcc-90bd-af433cded952 admin admin] PATH_INFO: `/v3/users/2a89afdaf4304b8588d33fcfb779c592` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:38.708170 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8097b3-022e-4fcc-90bd-af433cded952 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a89afdaf4304b8588d33fcfb779c592)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:38.709933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8097b3-022e-4fcc-90bd-af433cded952 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:38.711444 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 9/15] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:51:38 2021] GET /identity/v3/users/2a89afdaf4304b8588d33fcfb779c592 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:51:38.716957 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8097b3-022e-4fcc-90bd-af433cded952 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:38.720174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 7/16] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:51:38.726819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8097b3-022e-4fcc-90bd-af433cded952 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:38.731073 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b09abf-824d-47ae-b7ab-04d3b5fc7d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:38.731827 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b09abf-824d-47ae-b7ab-04d3b5fc7d8a admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:38.732109 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b09abf-824d-47ae-b7ab-04d3b5fc7d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:38.732381 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b09abf-824d-47ae-b7ab-04d3b5fc7d8a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:38.733508 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b09abf-824d-47ae-b7ab-04d3b5fc7d8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:38.735850 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b09abf-824d-47ae-b7ab-04d3b5fc7d8a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:38.737355 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 10/17] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:51:38 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:51:38.743422 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2413fe9-a45e-43bc-8353-b1fa8fcaabaa None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:38.745262 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b09abf-824d-47ae-b7ab-04d3b5fc7d8a admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:38.753900 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2413fe9-a45e-43bc-8353-b1fa8fcaabaa None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:38.754842 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b09abf-824d-47ae-b7ab-04d3b5fc7d8a admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:38.758183 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6a956-174f-4ffb-8ffb-a0f10082c624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:38.759132 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6a956-174f-4ffb-8ffb-a0f10082c624 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:38.759228 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d85d4-3be9-4957-9090-876212a5ccef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:38.759438 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6a956-174f-4ffb-8ffb-a0f10082c624 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:38.759715 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6a956-174f-4ffb-8ffb-a0f10082c624 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:38.759871 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d85d4-3be9-4957-9090-876212a5ccef admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:38.760157 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d85d4-3be9-4957-9090-876212a5ccef admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:38.760436 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d85d4-3be9-4957-9090-876212a5ccef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:38.760679 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6a956-174f-4ffb-8ffb-a0f10082c624 admin admin] RBAC: Adding query filter params (role.id=99835eeda2f64af5bc9173a8370d4568, scope.domain.id=default, user.id=2a89afdaf4304b8588d33fcfb779c592) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:38.760986 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6a956-174f-4ffb-8ffb-a0f10082c624 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:38.762714 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-94c6a956-174f-4ffb-8ffb-a0f10082c624 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:51:38.762714 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 02:51:38.762714 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 02:51:38.763904 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6a956-174f-4ffb-8ffb-a0f10082c624 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:38.768510 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d85d4-3be9-4957-9090-876212a5ccef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:38.770265 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d85d4-3be9-4957-9090-876212a5ccef admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:38.772622 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 8/18] 10.222.0.39 () {56 vars in 1344 bytes} [Tue Aug 31 02:51:38 2021] GET /identity/v3/role_assignments?user.id=2a89afdaf4304b8588d33fcfb779c592&scope.domain.id=default&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 233 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:38.779204 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 11/19] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:51:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 02:51:38.786351 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6a956-174f-4ffb-8ffb-a0f10082c624 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:38.796667 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6a956-174f-4ffb-8ffb-a0f10082c624 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:38.802172 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0633d-b8f5-478c-8b00-a0b807ee351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:38.802908 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0633d-b8f5-478c-8b00-a0b807ee351b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:38.803193 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0633d-b8f5-478c-8b00-a0b807ee351b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:38.803509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0633d-b8f5-478c-8b00-a0b807ee351b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:38.804972 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0633d-b8f5-478c-8b00-a0b807ee351b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:38.806727 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0633d-b8f5-478c-8b00-a0b807ee351b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:38.808679 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 9/20] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:51:38 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:41.322868 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4edab-d388-4edb-acdd-4adf1ebdf797 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:41.323416 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4edab-d388-4edb-acdd-4adf1ebdf797 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:41.323416 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4edab-d388-4edb-acdd-4adf1ebdf797 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:41.325621 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 12/21] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:41.332240 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16e413-de22-4167-8fbc-60cf2bc0d9f1 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:41.333110 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16e413-de22-4167-8fbc-60cf2bc0d9f1 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:41.333614 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16e413-de22-4167-8fbc-60cf2bc0d9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:41.365465 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-0e16e413-de22-4167-8fbc-60cf2bc0d9f1 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:41.367021 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0e16e413-de22-4167-8fbc-60cf2bc0d9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:41.379710 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 10/22] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:51:41.430329 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4edab-d388-4edb-acdd-4adf1ebdf797 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:41.454709 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4edab-d388-4edb-acdd-4adf1ebdf797 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:41.459637 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92ad53-5e03-4b7a-a96c-92aae61bef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:41.460793 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92ad53-5e03-4b7a-a96c-92aae61bef7b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:41.461292 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92ad53-5e03-4b7a-a96c-92aae61bef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:41.461756 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92ad53-5e03-4b7a-a96c-92aae61bef7b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:41.474259 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92ad53-5e03-4b7a-a96c-92aae61bef7b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:41.476587 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92ad53-5e03-4b7a-a96c-92aae61bef7b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:41.494970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-9b92ad53-5e03-4b7a-a96c-92aae61bef7b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:51:41.496868 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 13/23] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:51:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:51:41.504300 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16e413-de22-4167-8fbc-60cf2bc0d9f1 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:41.518871 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16e413-de22-4167-8fbc-60cf2bc0d9f1 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:41.536689 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38de0bf-94d4-47f4-93b0-8720781ac07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:41.537735 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38de0bf-94d4-47f4-93b0-8720781ac07b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:41.538225 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38de0bf-94d4-47f4-93b0-8720781ac07b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:41.538708 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38de0bf-94d4-47f4-93b0-8720781ac07b admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:41.539716 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38de0bf-94d4-47f4-93b0-8720781ac07b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:41.540241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38de0bf-94d4-47f4-93b0-8720781ac07b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:41.541461 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-f38de0bf-94d4-47f4-93b0-8720781ac07b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:51:41.541461 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 02:51:41.541461 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 02:51:41.542706 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38de0bf-94d4-47f4-93b0-8720781ac07b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:41.571986 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c11f92-bc0e-496b-adb0-70b1ba2a4d89 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:41.572591 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c11f92-bc0e-496b-adb0-70b1ba2a4d89 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:41.573082 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c11f92-bc0e-496b-adb0-70b1ba2a4d89 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:41.575020 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 14/24] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:51:41.578815 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 11/25] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:51:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:41.584620 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c11f92-bc0e-496b-adb0-70b1ba2a4d89 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:41.591034 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bafa2a-7922-475c-936e-b182edeb5769 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:41.591605 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bafa2a-7922-475c-936e-b182edeb5769 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:41.592090 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bafa2a-7922-475c-936e-b182edeb5769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:41.608499 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c11f92-bc0e-496b-adb0-70b1ba2a4d89 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:41.617517 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8250c2-d3cf-46fd-b692-c74e299d9dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:41.618192 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8250c2-d3cf-46fd-b692-c74e299d9dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:41.618476 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8250c2-d3cf-46fd-b692-c74e299d9dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:41.618748 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8250c2-d3cf-46fd-b692-c74e299d9dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:41.619482 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8250c2-d3cf-46fd-b692-c74e299d9dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:41.620498 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-8d8250c2-d3cf-46fd-b692-c74e299d9dc9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:51:41.620498 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 02:51:41.620498 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 02:51:41.622058 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8250c2-d3cf-46fd-b692-c74e299d9dc9 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:41.624374 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-36bafa2a-7922-475c-936e-b182edeb5769 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:41.626521 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-36bafa2a-7922-475c-936e-b182edeb5769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:41.636813 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 12/26] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:51:41.673456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bafa2a-7922-475c-936e-b182edeb5769 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:41.697967 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bafa2a-7922-475c-936e-b182edeb5769 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:41.702783 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0f6e2-d465-4381-9aef-d4f0b9a92032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:41.711393 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0f6e2-d465-4381-9aef-d4f0b9a92032 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:41.712443 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0f6e2-d465-4381-9aef-d4f0b9a92032 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:41.713111 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0f6e2-d465-4381-9aef-d4f0b9a92032 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:41.714657 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0f6e2-d465-4381-9aef-d4f0b9a92032 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:41.716460 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-6cd0f6e2-d465-4381-9aef-d4f0b9a92032 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:51:41.716460 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 02:51:41.716460 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 02:51:41.718329 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0f6e2-d465-4381-9aef-d4f0b9a92032 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:41.892902 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 15/27] 10.222.0.39 () {60 vars in 1163 bytes} [Tue Aug 31 02:51:41 2021] POST /identity/v3/projects => generated 301 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:51:41.902387 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463505e3-3349-4eec-a6cc-2006416dfa19 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:41.902700 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463505e3-3349-4eec-a6cc-2006416dfa19 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:41.903144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463505e3-3349-4eec-a6cc-2006416dfa19 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:41.905110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 16/28] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:51:41.921989 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3edb8e-3730-47e7-af06-05600257f087 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:41.923077 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3edb8e-3730-47e7-af06-05600257f087 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:41.923548 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3edb8e-3730-47e7-af06-05600257f087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:41.956556 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-2b3edb8e-3730-47e7-af06-05600257f087 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:41.958525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-2b3edb8e-3730-47e7-af06-05600257f087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:42.011267 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 13/29] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 02:51:41 2021] POST /identity/v3/roles => generated 219 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 02:51:42.039787 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 17/30] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:51:42.083100 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0f6e2-d465-4381-9aef-d4f0b9a92032 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:42.097211 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0f6e2-d465-4381-9aef-d4f0b9a92032 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:42.101871 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97385f-a134-4aa8-b954-8f80ffa5823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:42.102778 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97385f-a134-4aa8-b954-8f80ffa5823e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:42.103136 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97385f-a134-4aa8-b954-8f80ffa5823e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:42.103508 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97385f-a134-4aa8-b954-8f80ffa5823e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:42.135402 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97385f-a134-4aa8-b954-8f80ffa5823e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:51:42.143070 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-1f97385f-a134-4aa8-b954-8f80ffa5823e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:51:42.144663 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 14/31] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:51:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:51:42.151236 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3edb8e-3730-47e7-af06-05600257f087 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:42.161478 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3edb8e-3730-47e7-af06-05600257f087 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:42.177529 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3044bf6-1683-4513-b953-d33d85fb834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:42.178618 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3044bf6-1683-4513-b953-d33d85fb834b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:42.179114 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3044bf6-1683-4513-b953-d33d85fb834b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:42.179634 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3044bf6-1683-4513-b953-d33d85fb834b admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:42.180615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3044bf6-1683-4513-b953-d33d85fb834b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:42.181148 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3044bf6-1683-4513-b953-d33d85fb834b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:42.183223 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3044bf6-1683-4513-b953-d33d85fb834b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:42.195028 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 18/32] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:51:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:42.201374 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97385f-a134-4aa8-b954-8f80ffa5823e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:42.216987 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97385f-a134-4aa8-b954-8f80ffa5823e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:42.221916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e4b13-49e9-44e3-ab4c-3678f5414547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:42.222663 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e4b13-49e9-44e3-ab4c-3678f5414547 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:42.222947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e4b13-49e9-44e3-ab4c-3678f5414547 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:42.223224 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e4b13-49e9-44e3-ab4c-3678f5414547 admin admin] PATH_INFO: `/v3/users/2a89afdaf4304b8588d33fcfb779c592` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:42.225017 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e4b13-49e9-44e3-ab4c-3678f5414547 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a89afdaf4304b8588d33fcfb779c592)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:42.226998 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e4b13-49e9-44e3-ab4c-3678f5414547 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:42.228763 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 15/33] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:51:42 2021] GET /identity/v3/users/2a89afdaf4304b8588d33fcfb779c592 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:42.237304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3044bf6-1683-4513-b953-d33d85fb834b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:42.248828 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3044bf6-1683-4513-b953-d33d85fb834b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:42.256399 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99195a73-9a33-42e8-86fd-13a384200a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:42.257594 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99195a73-9a33-42e8-86fd-13a384200a69 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:42.258088 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99195a73-9a33-42e8-86fd-13a384200a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:42.258579 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99195a73-9a33-42e8-86fd-13a384200a69 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:42.260860 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99195a73-9a33-42e8-86fd-13a384200a69 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:42.262846 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99195a73-9a33-42e8-86fd-13a384200a69 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:42.264835 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 19/34] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:51:42 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:42.272972 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e4b13-49e9-44e3-ab4c-3678f5414547 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:42.289886 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e4b13-49e9-44e3-ab4c-3678f5414547 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:42.294370 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988a05a-2efb-49e6-a7fa-395762a74d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:42.295241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988a05a-2efb-49e6-a7fa-395762a74d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:42.295550 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988a05a-2efb-49e6-a7fa-395762a74d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:42.295827 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988a05a-2efb-49e6-a7fa-395762a74d71 admin admin] PATH_INFO: `/v3/domains/default/users/2a89afdaf4304b8588d33fcfb779c592/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:42.298460 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988a05a-2efb-49e6-a7fa-395762a74d71 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2a89afdaf4304b8588d33fcfb779c592, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:42.299768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-c988a05a-2efb-49e6-a7fa-395762a74d71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:51:42.299768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 02:51:42.299768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 02:51:42.302036 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988a05a-2efb-49e6-a7fa-395762a74d71 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:42.330365 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e6176-2b46-4ee3-a721-d2631e065b2b None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:42.330860 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e6176-2b46-4ee3-a721-d2631e065b2b None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:42.330932 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e6176-2b46-4ee3-a721-d2631e065b2b None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:42.331136 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 16/35] 10.222.0.39 () {58 vars in 1383 bytes} [Tue Aug 31 02:51:42 2021] PUT /identity/v3/domains/default/users/2a89afdaf4304b8588d33fcfb779c592/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:51:42.333032 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 20/36] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:42.339799 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f094ec7-57ec-4ec6-8c41-395a14078acc None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:42.340305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f094ec7-57ec-4ec6-8c41-395a14078acc None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:42.340376 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f094ec7-57ec-4ec6-8c41-395a14078acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:42.373570 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-2f094ec7-57ec-4ec6-8c41-395a14078acc None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:42.375793 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-2f094ec7-57ec-4ec6-8c41-395a14078acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:42.476343 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 17/37] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:51:42.501750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e6176-2b46-4ee3-a721-d2631e065b2b None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:42.517901 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e6176-2b46-4ee3-a721-d2631e065b2b None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:42.522737 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0f57b-5c36-4fe1-85fb-d0dfad1b8e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:42.523431 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0f57b-5c36-4fe1-85fb-d0dfad1b8e04 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:42.523723 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0f57b-5c36-4fe1-85fb-d0dfad1b8e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:42.524002 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0f57b-5c36-4fe1-85fb-d0dfad1b8e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:42.524751 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0f57b-5c36-4fe1-85fb-d0dfad1b8e04 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:42.525761 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-b0c0f57b-5c36-4fe1-85fb-d0dfad1b8e04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:51:42.525761 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 02:51:42.525761 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 02:51:42.526699 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0f57b-5c36-4fe1-85fb-d0dfad1b8e04 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:42.542589 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 21/38] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 02:51:42 2021] POST /identity/v3/roles => generated 225 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:51:42.778506 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6fc36-416f-4691-b8e4-73320da8eed5 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:42.779353 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6fc36-416f-4691-b8e4-73320da8eed5 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:42.779888 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6fc36-416f-4691-b8e4-73320da8eed5 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:42.782394 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 18/39] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:42.789210 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c998f0d-350d-4e9b-9b58-e1c10875b7c6 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:42.789510 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c998f0d-350d-4e9b-9b58-e1c10875b7c6 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:42.789790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c998f0d-350d-4e9b-9b58-e1c10875b7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:42.808680 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-4c998f0d-350d-4e9b-9b58-e1c10875b7c6 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:42.809860 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-4c998f0d-350d-4e9b-9b58-e1c10875b7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:42.819304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 22/40] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:51:42.844009 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6fc36-416f-4691-b8e4-73320da8eed5 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:42.856370 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6fc36-416f-4691-b8e4-73320da8eed5 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:42.861680 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0564b-a1b4-4c27-92fb-316621d32523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:42.862337 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0564b-a1b4-4c27-92fb-316621d32523 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:42.862618 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0564b-a1b4-4c27-92fb-316621d32523 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:42.862893 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0564b-a1b4-4c27-92fb-316621d32523 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:42.863676 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0564b-a1b4-4c27-92fb-316621d32523 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:42.865304 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0564b-a1b4-4c27-92fb-316621d32523 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:42.880517 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 19/41] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 02:51:42 2021] POST /identity/v3/roles => generated 223 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:51:43.246778 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69809e97-89a8-4b2c-884e-95cdc8817b68 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:43.247067 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69809e97-89a8-4b2c-884e-95cdc8817b68 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:43.247346 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69809e97-89a8-4b2c-884e-95cdc8817b68 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:43.249168 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 23/42] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:43.255599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e28aca-fa72-46d6-896a-6f43b8e05c4f None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:43.255915 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e28aca-fa72-46d6-896a-6f43b8e05c4f None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:43.256194 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e28aca-fa72-46d6-896a-6f43b8e05c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:43.274431 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-86e28aca-fa72-46d6-896a-6f43b8e05c4f None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:43.275650 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-86e28aca-fa72-46d6-896a-6f43b8e05c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:43.283220 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 20/43] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:51:43.307438 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69809e97-89a8-4b2c-884e-95cdc8817b68 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:43.320067 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69809e97-89a8-4b2c-884e-95cdc8817b68 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:43.324245 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183c1cb-915c-4085-9c69-238776b50d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:43.325023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183c1cb-915c-4085-9c69-238776b50d5b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:43.325303 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183c1cb-915c-4085-9c69-238776b50d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:43.325575 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183c1cb-915c-4085-9c69-238776b50d5b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:43.326730 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183c1cb-915c-4085-9c69-238776b50d5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:43.329071 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183c1cb-915c-4085-9c69-238776b50d5b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:43.330626 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 24/44] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:51:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:43.336575 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e28aca-fa72-46d6-896a-6f43b8e05c4f None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:43.345471 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e28aca-fa72-46d6-896a-6f43b8e05c4f None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:43.349902 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ee1df-750f-4c27-b02e-1dfff1e33c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:43.350556 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ee1df-750f-4c27-b02e-1dfff1e33c21 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:43.350845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ee1df-750f-4c27-b02e-1dfff1e33c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:43.351127 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ee1df-750f-4c27-b02e-1dfff1e33c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:43.351873 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ee1df-750f-4c27-b02e-1dfff1e33c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:43.352880 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-fc1ee1df-750f-4c27-b02e-1dfff1e33c21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:51:43.352880 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 02:51:43.352880 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 02:51:43.354092 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ee1df-750f-4c27-b02e-1dfff1e33c21 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:43.381831 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 21/45] 10.222.0.39 () {60 vars in 1163 bytes} [Tue Aug 31 02:51:43 2021] POST /identity/v3/projects => generated 312 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 02:51:44.598185 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b65c62-e4a6-4454-bf7c-04b9860525e7 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:44.598726 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b65c62-e4a6-4454-bf7c-04b9860525e7 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:44.598726 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b65c62-e4a6-4454-bf7c-04b9860525e7 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:44.600559 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 25/46] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:44.606398 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7361505-aea6-4794-8333-58ba2b1ed61c None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:44.606813 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7361505-aea6-4794-8333-58ba2b1ed61c None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:44.606958 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7361505-aea6-4794-8333-58ba2b1ed61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:44.624963 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-d7361505-aea6-4794-8333-58ba2b1ed61c None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:44.626220 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d7361505-aea6-4794-8333-58ba2b1ed61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:44.681372 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 22/47] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:51:44.706011 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b65c62-e4a6-4454-bf7c-04b9860525e7 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:44.717832 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b65c62-e4a6-4454-bf7c-04b9860525e7 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:44.722603 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec5aad-cccb-44bb-9092-3c0dc2e54002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:44.723395 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec5aad-cccb-44bb-9092-3c0dc2e54002 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:44.723691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec5aad-cccb-44bb-9092-3c0dc2e54002 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:44.723968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec5aad-cccb-44bb-9092-3c0dc2e54002 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:44.733854 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec5aad-cccb-44bb-9092-3c0dc2e54002 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:51:44.740825 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-78ec5aad-cccb-44bb-9092-3c0dc2e54002 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:51:44.741962 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 26/48] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:51:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:51:44.748163 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7361505-aea6-4794-8333-58ba2b1ed61c None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:44.757610 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7361505-aea6-4794-8333-58ba2b1ed61c None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:44.761911 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc2522-80bd-46ae-ab2e-9115aa638ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:44.762567 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc2522-80bd-46ae-ab2e-9115aa638ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:44.762850 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc2522-80bd-46ae-ab2e-9115aa638ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:44.763123 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc2522-80bd-46ae-ab2e-9115aa638ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:44.763905 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc2522-80bd-46ae-ab2e-9115aa638ed3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:44.764213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc2522-80bd-46ae-ab2e-9115aa638ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:44.765212 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-afbc2522-80bd-46ae-ab2e-9115aa638ed3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:51:44.765212 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 02:51:44.765212 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 02:51:44.766861 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc2522-80bd-46ae-ab2e-9115aa638ed3 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:44.779338 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 23/49] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:51:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:44.785621 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec5aad-cccb-44bb-9092-3c0dc2e54002 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:44.795603 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec5aad-cccb-44bb-9092-3c0dc2e54002 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:44.800249 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a180465-87a8-4c41-bfb4-816a04d78efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:44.801091 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a180465-87a8-4c41-bfb4-816a04d78efb admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:44.801375 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a180465-87a8-4c41-bfb4-816a04d78efb admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:44.801652 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a180465-87a8-4c41-bfb4-816a04d78efb admin admin] PATH_INFO: `/v3/users/2a89afdaf4304b8588d33fcfb779c592` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:44.802817 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a180465-87a8-4c41-bfb4-816a04d78efb admin admin] RBAC: Authorizing `identity:get_user(user_id=2a89afdaf4304b8588d33fcfb779c592)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:44.804849 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a180465-87a8-4c41-bfb4-816a04d78efb admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:44.806475 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 27/50] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:51:44 2021] GET /identity/v3/users/2a89afdaf4304b8588d33fcfb779c592 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:44.812042 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc2522-80bd-46ae-ab2e-9115aa638ed3 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:44.822340 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc2522-80bd-46ae-ab2e-9115aa638ed3 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:44.826679 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ca4ea-d449-4b44-b222-1df6ca6bdd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:44.827485 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ca4ea-d449-4b44-b222-1df6ca6bdd10 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:44.827778 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ca4ea-d449-4b44-b222-1df6ca6bdd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:44.828069 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ca4ea-d449-4b44-b222-1df6ca6bdd10 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:44.829960 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ca4ea-d449-4b44-b222-1df6ca6bdd10 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:44.831704 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ca4ea-d449-4b44-b222-1df6ca6bdd10 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:44.833281 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 24/51] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:51:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:51:44.839141 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a180465-87a8-4c41-bfb4-816a04d78efb admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:44.849324 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a180465-87a8-4c41-bfb4-816a04d78efb admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:44.853644 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5eb97-2600-47fe-a6ae-4bb0bc18e327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:44.854283 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5eb97-2600-47fe-a6ae-4bb0bc18e327 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:44.854571 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5eb97-2600-47fe-a6ae-4bb0bc18e327 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:44.854848 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5eb97-2600-47fe-a6ae-4bb0bc18e327 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:44.855699 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5eb97-2600-47fe-a6ae-4bb0bc18e327 admin admin] RBAC: Adding query filter params (role.id=99835eeda2f64af5bc9173a8370d4568, scope.domain.id=default, user.id=2a89afdaf4304b8588d33fcfb779c592) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:44.856012 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5eb97-2600-47fe-a6ae-4bb0bc18e327 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:44.857005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-b5f5eb97-2600-47fe-a6ae-4bb0bc18e327 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:51:44.857005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 02:51:44.857005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 02:51:44.858155 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5eb97-2600-47fe-a6ae-4bb0bc18e327 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:44.865274 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 28/52] 10.222.0.39 () {56 vars in 1344 bytes} [Tue Aug 31 02:51:44 2021] GET /identity/v3/role_assignments?user.id=2a89afdaf4304b8588d33fcfb779c592&scope.domain.id=default&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:51:45.529791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59036a-c088-46f2-b234-0d135fe7f3c2 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:45.530081 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59036a-c088-46f2-b234-0d135fe7f3c2 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:45.530366 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59036a-c088-46f2-b234-0d135fe7f3c2 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:45.532786 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 25/53] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:45.538591 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eac29-d32f-4172-afaf-22828cfa5dbf None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:45.538888 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eac29-d32f-4172-afaf-22828cfa5dbf None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:45.539173 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eac29-d32f-4172-afaf-22828cfa5dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:45.556969 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-b80eac29-d32f-4172-afaf-22828cfa5dbf None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:45.558154 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b80eac29-d32f-4172-afaf-22828cfa5dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:45.565606 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 29/54] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:51:45.589851 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59036a-c088-46f2-b234-0d135fe7f3c2 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:45.603444 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59036a-c088-46f2-b234-0d135fe7f3c2 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:45.608241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c8954-fffd-4013-9bb6-55f3b1507970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:45.609106 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c8954-fffd-4013-9bb6-55f3b1507970 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:45.610076 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c8954-fffd-4013-9bb6-55f3b1507970 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:45.610382 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c8954-fffd-4013-9bb6-55f3b1507970 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:45.611637 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c8954-fffd-4013-9bb6-55f3b1507970 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:45.613316 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c8954-fffd-4013-9bb6-55f3b1507970 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:45.614910 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 26/55] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:51:45 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:51:45.620874 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eac29-d32f-4172-afaf-22828cfa5dbf None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:45.629980 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eac29-d32f-4172-afaf-22828cfa5dbf None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:45.634321 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4393e-2c8e-43eb-9573-c03fcee90a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:45.634968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4393e-2c8e-43eb-9573-c03fcee90a7d admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:45.635256 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4393e-2c8e-43eb-9573-c03fcee90a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:45.635576 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4393e-2c8e-43eb-9573-c03fcee90a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:45.636285 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4393e-2c8e-43eb-9573-c03fcee90a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:45.638190 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4393e-2c8e-43eb-9573-c03fcee90a7d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:45.661704 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 30/56] 10.222.0.39 () {60 vars in 1162 bytes} [Tue Aug 31 02:51:45 2021] POST /identity/v3/projects => generated 298 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:51:47.862668 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9496e99-f962-4b14-84e2-a2845a076675 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:47.863183 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9496e99-f962-4b14-84e2-a2845a076675 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:47.863265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9496e99-f962-4b14-84e2-a2845a076675 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:47.865014 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 27/57] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:47.870841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79155b5-8c25-417b-9b97-e2dc0bb41a86 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:47.871528 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79155b5-8c25-417b-9b97-e2dc0bb41a86 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:47.871700 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79155b5-8c25-417b-9b97-e2dc0bb41a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:47.889405 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-e79155b5-8c25-417b-9b97-e2dc0bb41a86 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:47.891249 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-e79155b5-8c25-417b-9b97-e2dc0bb41a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:47.945649 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 31/58] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:51:47.970850 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9496e99-f962-4b14-84e2-a2845a076675 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:47.982514 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9496e99-f962-4b14-84e2-a2845a076675 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:47.986810 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d379c-e631-4c63-8bde-8583680fbb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:47.987608 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d379c-e631-4c63-8bde-8583680fbb58 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:47.987893 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d379c-e631-4c63-8bde-8583680fbb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:47.988169 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d379c-e631-4c63-8bde-8583680fbb58 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:47.989316 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d379c-e631-4c63-8bde-8583680fbb58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:47.990980 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d379c-e631-4c63-8bde-8583680fbb58 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:47.992542 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 28/59] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:51:47 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:51:47.998315 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79155b5-8c25-417b-9b97-e2dc0bb41a86 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:48.007517 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79155b5-8c25-417b-9b97-e2dc0bb41a86 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:48.011876 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6391c-80cc-4c4d-b597-30540e08bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:48.012528 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6391c-80cc-4c4d-b597-30540e08bbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:48.012813 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6391c-80cc-4c4d-b597-30540e08bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:48.013091 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6391c-80cc-4c4d-b597-30540e08bbf1 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:48.013797 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6391c-80cc-4c4d-b597-30540e08bbf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:48.014801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-ebe6391c-80cc-4c4d-b597-30540e08bbf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:51:48.014801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 02:51:48.014801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 02:51:48.016692 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6391c-80cc-4c4d-b597-30540e08bbf1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:48.039931 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 32/60] 10.222.0.39 () {60 vars in 1154 bytes} [Tue Aug 31 02:51:47 2021] POST /identity/v3/users => generated 275 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:51:51.495049 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fc20b-e622-458c-b27f-d83d4f7a4559 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.496341 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fc20b-e622-458c-b27f-d83d4f7a4559 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.496840 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fc20b-e622-458c-b27f-d83d4f7a4559 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.499189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 29/61] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:51.505940 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4e528-e26a-4d45-9e66-cd2dce4bd717 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.506415 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4e528-e26a-4d45-9e66-cd2dce4bd717 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.506513 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4e528-e26a-4d45-9e66-cd2dce4bd717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.531060 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-cdd4e528-e26a-4d45-9e66-cd2dce4bd717 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:51.532356 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-cdd4e528-e26a-4d45-9e66-cd2dce4bd717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:51.547059 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 33/62] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:51:51.563419 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77309893-3431-4a38-8e55-ed49ff2ea502 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.563932 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77309893-3431-4a38-8e55-ed49ff2ea502 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.564368 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77309893-3431-4a38-8e55-ed49ff2ea502 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.567755 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 30/63] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:51.572749 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4f756-dda7-447a-b370-7911371529c4 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.573043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4f756-dda7-447a-b370-7911371529c4 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.573323 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4f756-dda7-447a-b370-7911371529c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.583424 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77309893-3431-4a38-8e55-ed49ff2ea502 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.595787 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-84d4f756-dda7-447a-b370-7911371529c4 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:51.596987 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-84d4f756-dda7-447a-b370-7911371529c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:51.602323 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77309893-3431-4a38-8e55-ed49ff2ea502 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.606471 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 34/64] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:51:51.607825 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75720d02-b4cc-4313-b3ac-98a2a5790c6b None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.608113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75720d02-b4cc-4313-b3ac-98a2a5790c6b None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.608397 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75720d02-b4cc-4313-b3ac-98a2a5790c6b None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.610263 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 35/65] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:51.612256 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17510d0d-3f17-4598-a4c0-392dbab7bdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.613056 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17510d0d-3f17-4598-a4c0-392dbab7bdce admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.613345 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17510d0d-3f17-4598-a4c0-392dbab7bdce admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.613626 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17510d0d-3f17-4598-a4c0-392dbab7bdce admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.616221 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f11a0-0ec9-4cce-93f5-45b38dd9edea None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.616503 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f11a0-0ec9-4cce-93f5-45b38dd9edea None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.616783 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f11a0-0ec9-4cce-93f5-45b38dd9edea None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.618445 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 36/66] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:51:51.624414 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845006d-4afd-4f56-b837-b9377890342f None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.624708 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845006d-4afd-4f56-b837-b9377890342f None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.625519 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845006d-4afd-4f56-b837-b9377890342f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.629226 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17510d0d-3f17-4598-a4c0-392dbab7bdce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:51:51.636417 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-17510d0d-3f17-4598-a4c0-392dbab7bdce admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 02:51:51.638146 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 31/67] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:51:51.639617 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dde87-7e2c-4f10-bff4-bfad1b388b6c None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.640108 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dde87-7e2c-4f10-bff4-bfad1b388b6c None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.641193 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dde87-7e2c-4f10-bff4-bfad1b388b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.643865 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-e845006d-4afd-4f56-b837-b9377890342f None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:51.645067 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-e845006d-4afd-4f56-b837-b9377890342f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:51.652834 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 37/68] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:51:51.653464 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845006d-4afd-4f56-b837-b9377890342f None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.661010 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-611dde87-7e2c-4f10-bff4-bfad1b388b6c None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:51.662489 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-611dde87-7e2c-4f10-bff4-bfad1b388b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:51.662668 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845006d-4afd-4f56-b837-b9377890342f None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.667111 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981b069-3143-4340-8cd9-b6d7c5dc8370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.668057 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981b069-3143-4340-8cd9-b6d7c5dc8370 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.668344 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981b069-3143-4340-8cd9-b6d7c5dc8370 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.668624 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981b069-3143-4340-8cd9-b6d7c5dc8370 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.672021 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 32/69] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:51:51.679392 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dde87-7e2c-4f10-bff4-bfad1b388b6c None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.681610 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981b069-3143-4340-8cd9-b6d7c5dc8370 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:51:51.689255 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-2981b069-3143-4340-8cd9-b6d7c5dc8370 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:51:51.690711 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dde87-7e2c-4f10-bff4-bfad1b388b6c None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.690829 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 38/70] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:51:51.691587 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981b069-3143-4340-8cd9-b6d7c5dc8370 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.698709 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c925ed-2e13-44f5-a35a-601a2105fae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.699702 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c925ed-2e13-44f5-a35a-601a2105fae6 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.700188 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c925ed-2e13-44f5-a35a-601a2105fae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.700659 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c925ed-2e13-44f5-a35a-601a2105fae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.701598 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c925ed-2e13-44f5-a35a-601a2105fae6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:51.702097 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c925ed-2e13-44f5-a35a-601a2105fae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:51.702210 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981b069-3143-4340-8cd9-b6d7c5dc8370 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.705549 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c925ed-2e13-44f5-a35a-601a2105fae6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:51.707565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c254870-50af-4e25-a230-7bc8eb3781e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.708349 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c254870-50af-4e25-a230-7bc8eb3781e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.708638 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c254870-50af-4e25-a230-7bc8eb3781e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.708920 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c254870-50af-4e25-a230-7bc8eb3781e2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.716033 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 33/71] 10.222.0.39 () {56 vars in 1123 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:51.716690 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c925ed-2e13-44f5-a35a-601a2105fae6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.724869 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c254870-50af-4e25-a230-7bc8eb3781e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:51:51.727907 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c925ed-2e13-44f5-a35a-601a2105fae6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.732084 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-4c254870-50af-4e25-a230-7bc8eb3781e2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 02:51:51.732252 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc7b0f-fa59-4548-b1fb-c781c46fc2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.732860 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc7b0f-fa59-4548-b1fb-c781c46fc2ec admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.733145 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc7b0f-fa59-4548-b1fb-c781c46fc2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.733511 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 39/72] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:51:51.734274 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c254870-50af-4e25-a230-7bc8eb3781e2 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.738738 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc7b0f-fa59-4548-b1fb-c781c46fc2ec admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.739634 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc7b0f-fa59-4548-b1fb-c781c46fc2ec admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:51.739955 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc7b0f-fa59-4548-b1fb-c781c46fc2ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:51.741593 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc7b0f-fa59-4548-b1fb-c781c46fc2ec admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:51.744287 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c254870-50af-4e25-a230-7bc8eb3781e2 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.749033 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf3bf1-245f-4645-b46a-cfb699e0c856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.750331 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf3bf1-245f-4645-b46a-cfb699e0c856 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.750617 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf3bf1-245f-4645-b46a-cfb699e0c856 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.751104 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf3bf1-245f-4645-b46a-cfb699e0c856 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.751218 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 34/73] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:51.756559 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc7b0f-fa59-4548-b1fb-c781c46fc2ec admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.762150 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf3bf1-245f-4645-b46a-cfb699e0c856 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:51:51.767500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc7b0f-fa59-4548-b1fb-c781c46fc2ec admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.769764 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-b6bf3bf1-245f-4645-b46a-cfb699e0c856 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 02:51:51.770957 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 40/74] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:51:51.771776 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf3bf1-245f-4645-b46a-cfb699e0c856 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.772650 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f68b7-adb7-40e7-b7ee-fcfabbc5ede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.773688 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f68b7-adb7-40e7-b7ee-fcfabbc5ede4 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.774139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f68b7-adb7-40e7-b7ee-fcfabbc5ede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.774599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f68b7-adb7-40e7-b7ee-fcfabbc5ede4 admin admin] PATH_INFO: `/v3/users/0f6084bc6fea49b3a21c2fc85578e04e` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.781329 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf3bf1-245f-4645-b46a-cfb699e0c856 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.785859 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0012d-d7fc-423d-a60f-71f5074ca6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.786494 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0012d-d7fc-423d-a60f-71f5074ca6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.786785 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0012d-d7fc-423d-a60f-71f5074ca6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.787067 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0012d-d7fc-423d-a60f-71f5074ca6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.787842 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0012d-d7fc-423d-a60f-71f5074ca6b9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:51.788154 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0012d-d7fc-423d-a60f-71f5074ca6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:51.789758 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0012d-d7fc-423d-a60f-71f5074ca6b9 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:51.792634 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f68b7-adb7-40e7-b7ee-fcfabbc5ede4 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f6084bc6fea49b3a21c2fc85578e04e)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:51.795558 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f68b7-adb7-40e7-b7ee-fcfabbc5ede4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:51.798008 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 35/76] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/users/0f6084bc6fea49b3a21c2fc85578e04e => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:51.798114 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 41/76] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:51.798921 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0012d-d7fc-423d-a60f-71f5074ca6b9 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.799291 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f68b7-adb7-40e7-b7ee-fcfabbc5ede4 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.808114 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0012d-d7fc-423d-a60f-71f5074ca6b9 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.813299 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f62a1b-53cb-4ca9-be78-f3694ca88024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.814224 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f62a1b-53cb-4ca9-be78-f3694ca88024 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.814336 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f68b7-adb7-40e7-b7ee-fcfabbc5ede4 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.814505 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f62a1b-53cb-4ca9-be78-f3694ca88024 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.814786 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f62a1b-53cb-4ca9-be78-f3694ca88024 admin admin] PATH_INFO: `/v3/users/2a89afdaf4304b8588d33fcfb779c592` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.816003 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f62a1b-53cb-4ca9-be78-f3694ca88024 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a89afdaf4304b8588d33fcfb779c592)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:51.817799 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f62a1b-53cb-4ca9-be78-f3694ca88024 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:51.819413 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 42/77] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/users/2a89afdaf4304b8588d33fcfb779c592 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:51.819834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608436b2-3407-4113-acbd-b8762d712430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.820156 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f62a1b-53cb-4ca9-be78-f3694ca88024 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.821114 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608436b2-3407-4113-acbd-b8762d712430 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.821532 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608436b2-3407-4113-acbd-b8762d712430 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.821938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608436b2-3407-4113-acbd-b8762d712430 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.822825 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608436b2-3407-4113-acbd-b8762d712430 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:51.823261 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608436b2-3407-4113-acbd-b8762d712430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:51.825210 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608436b2-3407-4113-acbd-b8762d712430 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:51.830148 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f62a1b-53cb-4ca9-be78-f3694ca88024 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.834655 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d128c8-d140-43f4-bb29-2ce4f21f3299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.835640 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d128c8-d140-43f4-bb29-2ce4f21f3299 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.835928 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d128c8-d140-43f4-bb29-2ce4f21f3299 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.836210 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d128c8-d140-43f4-bb29-2ce4f21f3299 admin admin] PATH_INFO: `/v3/users/0f6084bc6fea49b3a21c2fc85578e04e` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.836602 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 36/78] 10.222.0.39 () {56 vars in 1123 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:51.837471 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d128c8-d140-43f4-bb29-2ce4f21f3299 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f6084bc6fea49b3a21c2fc85578e04e)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:51.837779 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608436b2-3407-4113-acbd-b8762d712430 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.839621 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d128c8-d140-43f4-bb29-2ce4f21f3299 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:51.841500 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 43/79] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/users/0f6084bc6fea49b3a21c2fc85578e04e => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:51.842266 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d128c8-d140-43f4-bb29-2ce4f21f3299 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.849491 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608436b2-3407-4113-acbd-b8762d712430 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.851747 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d128c8-d140-43f4-bb29-2ce4f21f3299 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.855046 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688d5d9-1a73-4dcc-bc0a-7d56c4d62a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.856082 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d5d9-1a73-4dcc-bc0a-7d56c4d62a3d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.856285 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b2f0e-a6a4-420d-9f42-5cc094a16791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.856689 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d5d9-1a73-4dcc-bc0a-7d56c4d62a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.856908 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b2f0e-a6a4-420d-9f42-5cc094a16791 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.857195 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b2f0e-a6a4-420d-9f42-5cc094a16791 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.857393 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d5d9-1a73-4dcc-bc0a-7d56c4d62a3d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.857494 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b2f0e-a6a4-420d-9f42-5cc094a16791 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.865874 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b2f0e-a6a4-420d-9f42-5cc094a16791 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:51.867281 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688d5d9-1a73-4dcc-bc0a-7d56c4d62a3d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:51.867684 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b2f0e-a6a4-420d-9f42-5cc094a16791 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:51.869423 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688d5d9-1a73-4dcc-bc0a-7d56c4d62a3d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:51.877178 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 44/80] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:51:51.877958 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b2f0e-a6a4-420d-9f42-5cc094a16791 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.886104 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 37/81] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:51:51.886587 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b2f0e-a6a4-420d-9f42-5cc094a16791 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.887423 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688d5d9-1a73-4dcc-bc0a-7d56c4d62a3d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.891982 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475543dc-0859-4416-9971-eb7ce8500ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.892609 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475543dc-0859-4416-9971-eb7ce8500ace admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.892896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475543dc-0859-4416-9971-eb7ce8500ace admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.893175 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475543dc-0859-4416-9971-eb7ce8500ace admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.899482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688d5d9-1a73-4dcc-bc0a-7d56c4d62a3d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.901092 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475543dc-0859-4416-9971-eb7ce8500ace admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:51.902853 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475543dc-0859-4416-9971-eb7ce8500ace admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:51.904720 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7ff10-8914-4e3a-8676-169ed22b0ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.905730 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7ff10-8914-4e3a-8676-169ed22b0ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.906726 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7ff10-8914-4e3a-8676-169ed22b0ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.907619 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7ff10-8914-4e3a-8676-169ed22b0ed3 admin admin] PATH_INFO: `/v3/users/0f6084bc6fea49b3a21c2fc85578e04e` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.908900 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7ff10-8914-4e3a-8676-169ed22b0ed3 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f6084bc6fea49b3a21c2fc85578e04e)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:51.911051 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7ff10-8914-4e3a-8676-169ed22b0ed3 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:51.918254 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 38/83] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/users/0f6084bc6fea49b3a21c2fc85578e04e => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:51.918434 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 45/83] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:51:51.918512 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7ff10-8914-4e3a-8676-169ed22b0ed3 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.918581 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475543dc-0859-4416-9971-eb7ce8500ace admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.925531 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475543dc-0859-4416-9971-eb7ce8500ace admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.928881 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7ff10-8914-4e3a-8676-169ed22b0ed3 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.930498 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac8215-2486-44bd-845e-2e83172ef248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.931388 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac8215-2486-44bd-845e-2e83172ef248 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.931700 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac8215-2486-44bd-845e-2e83172ef248 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.931983 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac8215-2486-44bd-845e-2e83172ef248 admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.933182 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac8215-2486-44bd-845e-2e83172ef248 admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:51.933667 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c42e9-843f-4738-99a8-0779cfd1b5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.934536 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c42e9-843f-4738-99a8-0779cfd1b5fa admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.934827 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c42e9-843f-4738-99a8-0779cfd1b5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.935111 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c42e9-843f-4738-99a8-0779cfd1b5fa admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.935285 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac8215-2486-44bd-845e-2e83172ef248 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:51.936370 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c42e9-843f-4738-99a8-0779cfd1b5fa admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:51.943430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 46/84] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:51.943430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac8215-2486-44bd-845e-2e83172ef248 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.943718 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c42e9-843f-4738-99a8-0779cfd1b5fa admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:51.943718 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 39/85] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:51.943718 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c42e9-843f-4738-99a8-0779cfd1b5fa admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.953427 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c42e9-843f-4738-99a8-0779cfd1b5fa admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.957256 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac8215-2486-44bd-845e-2e83172ef248 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.958159 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9c2bd-dede-4eee-adf4-eb27382d59ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.959142 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9c2bd-dede-4eee-adf4-eb27382d59ee admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.959465 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9c2bd-dede-4eee-adf4-eb27382d59ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.959752 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9c2bd-dede-4eee-adf4-eb27382d59ee admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.960943 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9c2bd-dede-4eee-adf4-eb27382d59ee admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:51.961983 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d7f66-0e36-4460-9667-debf5ed25d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.962639 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d7f66-0e36-4460-9667-debf5ed25d05 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.962926 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d7f66-0e36-4460-9667-debf5ed25d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.963027 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9c2bd-dede-4eee-adf4-eb27382d59ee admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:51.963206 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d7f66-0e36-4460-9667-debf5ed25d05 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.964929 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 40/86] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:51.970267 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9c2bd-dede-4eee-adf4-eb27382d59ee admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.971858 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d7f66-0e36-4460-9667-debf5ed25d05 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:51.973621 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d7f66-0e36-4460-9667-debf5ed25d05 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:51.979691 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9c2bd-dede-4eee-adf4-eb27382d59ee admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:51.988288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06459e-6d87-47c2-8824-d0bcaa898c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:51.988288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06459e-6d87-47c2-8824-d0bcaa898c9b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:51.988288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06459e-6d87-47c2-8824-d0bcaa898c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:51.988288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06459e-6d87-47c2-8824-d0bcaa898c9b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:51.988618 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06459e-6d87-47c2-8824-d0bcaa898c9b admin admin] RBAC: Adding query filter params (role.id=99835eeda2f64af5bc9173a8370d4568, scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51, user.id=2a89afdaf4304b8588d33fcfb779c592) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:51.988618 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06459e-6d87-47c2-8824-d0bcaa898c9b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:51.988736 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 47/87] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:51:51.988736 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d7f66-0e36-4460-9667-debf5ed25d05 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.988862 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06459e-6d87-47c2-8824-d0bcaa898c9b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:51.999536 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 41/88] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/role_assignments?user.id=2a89afdaf4304b8588d33fcfb779c592&scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:51.999536 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06459e-6d87-47c2-8824-d0bcaa898c9b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:51.999771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d7f66-0e36-4460-9667-debf5ed25d05 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:52.003347 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a98e4e-471a-441a-88f2-b78ca0047f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:52.004038 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98e4e-471a-441a-88f2-b78ca0047f67 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:52.004321 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98e4e-471a-441a-88f2-b78ca0047f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:52.004604 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98e4e-471a-441a-88f2-b78ca0047f67 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:52.005443 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a98e4e-471a-441a-88f2-b78ca0047f67 admin admin] RBAC: Adding query filter params (role.id=fd3d7d578a52485f96ce76c2bbe1360d, scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51, user.id=0f6084bc6fea49b3a21c2fc85578e04e) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:52.005758 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a98e4e-471a-441a-88f2-b78ca0047f67 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:52.007721 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a98e4e-471a-441a-88f2-b78ca0047f67 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:52.008327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06459e-6d87-47c2-8824-d0bcaa898c9b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:52.014361 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40808bb8-b54b-42b0-86a5-606f2e1e9ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:52.015043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 48/89] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/role_assignments?user.id=0f6084bc6fea49b3a21c2fc85578e04e&scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51&role.id=fd3d7d578a52485f96ce76c2bbe1360d => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:52.015696 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40808bb8-b54b-42b0-86a5-606f2e1e9ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:52.016013 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a98e4e-471a-441a-88f2-b78ca0047f67 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:52.016508 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40808bb8-b54b-42b0-86a5-606f2e1e9ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:52.016974 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40808bb8-b54b-42b0-86a5-606f2e1e9ab6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:52.023408 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40808bb8-b54b-42b0-86a5-606f2e1e9ab6 admin admin] RBAC: Adding query filter params (role.id=22d670400c514449b9734ad179a36f82, scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51, user.id=0f6084bc6fea49b3a21c2fc85578e04e) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:52.023408 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40808bb8-b54b-42b0-86a5-606f2e1e9ab6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:52.023408 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40808bb8-b54b-42b0-86a5-606f2e1e9ab6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:52.026523 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a98e4e-471a-441a-88f2-b78ca0047f67 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:52.031736 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7a0eb-ed5d-428b-9f16-77cce74936f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:52.035406 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7a0eb-ed5d-428b-9f16-77cce74936f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:52.035406 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7a0eb-ed5d-428b-9f16-77cce74936f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:52.035406 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7a0eb-ed5d-428b-9f16-77cce74936f1 admin admin] PATH_INFO: `/v3/projects/5823cf5e70b144c5a0f0b24bc65c867a` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:52.035406 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7a0eb-ed5d-428b-9f16-77cce74936f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=5823cf5e70b144c5a0f0b24bc65c867a)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:52.036226 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 42/90] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:51:51 2021] GET /identity/v3/role_assignments?user.id=0f6084bc6fea49b3a21c2fc85578e04e&scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51&role.id=22d670400c514449b9734ad179a36f82 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:52.039394 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7a0eb-ed5d-428b-9f16-77cce74936f1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:52.039654 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1c712-803b-4e53-853e-6b7b59db0e7c None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:52.039654 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1c712-803b-4e53-853e-6b7b59db0e7c None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:52.039654 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1c712-803b-4e53-853e-6b7b59db0e7c None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:52.039872 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 49/91] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:51:52 2021] GET /identity/v3/projects/5823cf5e70b144c5a0f0b24bc65c867a => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:52.039949 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 43/92] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:52.047324 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7a0eb-ed5d-428b-9f16-77cce74936f1 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:52.049036 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56c53e-bc47-41c0-8730-1959604f11ac None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:52.049333 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56c53e-bc47-41c0-8730-1959604f11ac None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:52.049621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56c53e-bc47-41c0-8730-1959604f11ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:52.067406 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7a0eb-ed5d-428b-9f16-77cce74936f1 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:52.076410 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7399a98-d3c3-452d-93fd-11a113ee7245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:52.079404 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7399a98-d3c3-452d-93fd-11a113ee7245 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:52.079404 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7399a98-d3c3-452d-93fd-11a113ee7245 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:52.079404 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7399a98-d3c3-452d-93fd-11a113ee7245 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:52.079404 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7399a98-d3c3-452d-93fd-11a113ee7245 admin admin] RBAC: Adding query filter params (role.id=fd3d7d578a52485f96ce76c2bbe1360d, scope.project.id=5823cf5e70b144c5a0f0b24bc65c867a, user.id=0f6084bc6fea49b3a21c2fc85578e04e) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:52.079404 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7399a98-d3c3-452d-93fd-11a113ee7245 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:52.081417 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7399a98-d3c3-452d-93fd-11a113ee7245 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:52.089256 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-fb56c53e-bc47-41c0-8730-1959604f11ac None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:52.090570 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-fb56c53e-bc47-41c0-8730-1959604f11ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:52.097799 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 50/93] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:51:52 2021] GET /identity/v3/role_assignments?user.id=0f6084bc6fea49b3a21c2fc85578e04e&scope.project.id=5823cf5e70b144c5a0f0b24bc65c867a&role.id=fd3d7d578a52485f96ce76c2bbe1360d => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:52.109870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 44/94] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:51:52.144112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7399a98-d3c3-452d-93fd-11a113ee7245 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:52.154826 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7399a98-d3c3-452d-93fd-11a113ee7245 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:52.160516 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94ad71-66d6-4657-8288-cd64bf69323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:52.161350 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94ad71-66d6-4657-8288-cd64bf69323d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:52.161633 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94ad71-66d6-4657-8288-cd64bf69323d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:52.161907 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94ad71-66d6-4657-8288-cd64bf69323d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:52.163307 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94ad71-66d6-4657-8288-cd64bf69323d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:52.165155 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94ad71-66d6-4657-8288-cd64bf69323d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:52.166964 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 51/95] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:51:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:52.179874 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56c53e-bc47-41c0-8730-1959604f11ac None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:52.194002 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56c53e-bc47-41c0-8730-1959604f11ac None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:52.198881 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021ed78-9c31-48af-aea5-7f29d69820ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:52.199627 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021ed78-9c31-48af-aea5-7f29d69820ba admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:52.199917 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021ed78-9c31-48af-aea5-7f29d69820ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:52.200198 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021ed78-9c31-48af-aea5-7f29d69820ba admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:52.200947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021ed78-9c31-48af-aea5-7f29d69820ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:52.204312 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021ed78-9c31-48af-aea5-7f29d69820ba admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:52.238450 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 45/96] 10.222.0.39 () {60 vars in 1163 bytes} [Tue Aug 31 02:51:52 2021] POST /identity/v3/projects => generated 302 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:51:54.582075 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db0065-4ffb-4d04-a99d-5ea9c423a2dd None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:54.583095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db0065-4ffb-4d04-a99d-5ea9c423a2dd None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:54.583619 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db0065-4ffb-4d04-a99d-5ea9c423a2dd None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:54.586226 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 52/97] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:54.592934 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3aeb4-4f49-4a86-9e30-5b2817abbebc None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:54.594437 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3aeb4-4f49-4a86-9e30-5b2817abbebc None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:54.594920 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3aeb4-4f49-4a86-9e30-5b2817abbebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:54.620924 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-90f3aeb4-4f49-4a86-9e30-5b2817abbebc None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:54.622728 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-90f3aeb4-4f49-4a86-9e30-5b2817abbebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:54.676441 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1001479-faee-4004-8855-5d970c75e0ac None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:54.677364 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1001479-faee-4004-8855-5d970c75e0ac None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:54.677364 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1001479-faee-4004-8855-5d970c75e0ac None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:54.679493 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 53/98] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:54.693850 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1b48b-a1b5-4d6e-b1b0-779bc1ddf994 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:54.694266 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1b48b-a1b5-4d6e-b1b0-779bc1ddf994 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:54.694541 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1b48b-a1b5-4d6e-b1b0-779bc1ddf994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:54.700796 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 46/99] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:51:54.725074 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-a4f1b48b-a1b5-4d6e-b1b0-779bc1ddf994 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:54.726597 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a4f1b48b-a1b5-4d6e-b1b0-779bc1ddf994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:54.727892 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3aeb4-4f49-4a86-9e30-5b2817abbebc None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:54.735258 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 54/100] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:51:54.745674 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3aeb4-4f49-4a86-9e30-5b2817abbebc None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:54.756018 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823da5d-8e57-4b75-8864-9b29eae4ecaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:54.756829 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823da5d-8e57-4b75-8864-9b29eae4ecaa admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:54.757114 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823da5d-8e57-4b75-8864-9b29eae4ecaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:54.757390 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823da5d-8e57-4b75-8864-9b29eae4ecaa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:54.774621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823da5d-8e57-4b75-8864-9b29eae4ecaa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:51:54.782374 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-8823da5d-8e57-4b75-8864-9b29eae4ecaa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:51:54.783675 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 47/101] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:51:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:51:54.790362 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1b48b-a1b5-4d6e-b1b0-779bc1ddf994 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:54.791864 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823da5d-8e57-4b75-8864-9b29eae4ecaa admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:54.802738 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823da5d-8e57-4b75-8864-9b29eae4ecaa admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:54.804923 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1b48b-a1b5-4d6e-b1b0-779bc1ddf994 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:54.809946 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf48921-bf9f-4d2d-b36e-29c449b8faa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:54.810776 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf48921-bf9f-4d2d-b36e-29c449b8faa1 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:54.811066 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf48921-bf9f-4d2d-b36e-29c449b8faa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:54.811349 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf48921-bf9f-4d2d-b36e-29c449b8faa1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:54.811655 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ffe7d-4db1-4413-b974-fcee75b38ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:54.812757 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ffe7d-4db1-4413-b974-fcee75b38ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:54.813258 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ffe7d-4db1-4413-b974-fcee75b38ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:54.813746 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ffe7d-4db1-4413-b974-fcee75b38ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:54.814626 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ffe7d-4db1-4413-b974-fcee75b38ee8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:54.815039 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ffe7d-4db1-4413-b974-fcee75b38ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:54.816811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ffe7d-4db1-4413-b974-fcee75b38ee8 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:54.825406 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf48921-bf9f-4d2d-b36e-29c449b8faa1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:51:54.825841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 55/102] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:51:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:54.832968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe24d4-7345-45f0-9e40-f9ed50c449aa None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:54.832968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe24d4-7345-45f0-9e40-f9ed50c449aa None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:54.832968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe24d4-7345-45f0-9e40-f9ed50c449aa None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:54.832968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 56/103] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:54.836376 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe24d4-7345-45f0-9e40-f9ed50c449aa None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:54.839901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-0cf48921-bf9f-4d2d-b36e-29c449b8faa1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 02:51:54.841280 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 48/104] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:51:54 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:51:54.842617 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3933b-e65f-43f6-9dd5-6adbee13277e None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:54.843070 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3933b-e65f-43f6-9dd5-6adbee13277e None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:54.844080 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3933b-e65f-43f6-9dd5-6adbee13277e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:54.851122 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe24d4-7345-45f0-9e40-f9ed50c449aa None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:54.855679 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88996728-ec47-423e-a24e-5b0218dd039d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:54.856648 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88996728-ec47-423e-a24e-5b0218dd039d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:54.857031 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88996728-ec47-423e-a24e-5b0218dd039d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:54.857405 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88996728-ec47-423e-a24e-5b0218dd039d admin admin] PATH_INFO: `/v3/users/2a89afdaf4304b8588d33fcfb779c592` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:54.858702 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88996728-ec47-423e-a24e-5b0218dd039d admin admin] RBAC: Authorizing `identity:get_user(user_id=2a89afdaf4304b8588d33fcfb779c592)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:54.861431 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88996728-ec47-423e-a24e-5b0218dd039d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:54.863170 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 57/105] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:51:54 2021] GET /identity/v3/users/2a89afdaf4304b8588d33fcfb779c592 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:54.864068 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88996728-ec47-423e-a24e-5b0218dd039d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:54.866822 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-c6e3933b-e65f-43f6-9dd5-6adbee13277e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:54.868187 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c6e3933b-e65f-43f6-9dd5-6adbee13277e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:54.874631 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88996728-ec47-423e-a24e-5b0218dd039d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:54.878161 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 49/106] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:51:54.879382 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3933b-e65f-43f6-9dd5-6adbee13277e None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:54.879812 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de377b8f-f191-474e-9d2f-d7580e0d63f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:54.880758 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de377b8f-f191-474e-9d2f-d7580e0d63f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:54.881110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de377b8f-f191-474e-9d2f-d7580e0d63f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:54.881476 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de377b8f-f191-474e-9d2f-d7580e0d63f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:54.882294 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de377b8f-f191-474e-9d2f-d7580e0d63f8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:54.882669 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de377b8f-f191-474e-9d2f-d7580e0d63f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:54.884451 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de377b8f-f191-474e-9d2f-d7580e0d63f8 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:54.891168 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3933b-e65f-43f6-9dd5-6adbee13277e None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:54.895202 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 58/107] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:51:54 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:54.895691 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21799722-956e-47a4-a1fe-0940b8d4df15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:54.896623 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21799722-956e-47a4-a1fe-0940b8d4df15 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:54.896975 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21799722-956e-47a4-a1fe-0940b8d4df15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:54.897341 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21799722-956e-47a4-a1fe-0940b8d4df15 admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:54.897533 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced73750-31b9-4a43-b12a-e169f9aae4e2 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:54.898108 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced73750-31b9-4a43-b12a-e169f9aae4e2 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:54.898595 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced73750-31b9-4a43-b12a-e169f9aae4e2 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:54.898742 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21799722-956e-47a4-a1fe-0940b8d4df15 admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:54.900570 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 59/108] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:54.901436 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced73750-31b9-4a43-b12a-e169f9aae4e2 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:54.901555 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21799722-956e-47a4-a1fe-0940b8d4df15 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:54.903756 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 50/109] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:51:54 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:54.906713 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcb2ee-785b-4557-933a-5cdfc3b61d53 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:54.907119 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcb2ee-785b-4557-933a-5cdfc3b61d53 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:54.907536 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcb2ee-785b-4557-933a-5cdfc3b61d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:54.915057 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced73750-31b9-4a43-b12a-e169f9aae4e2 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:54.919464 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e6b4b-d4d2-42fd-b167-778e6618653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:54.920329 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e6b4b-d4d2-42fd-b167-778e6618653f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:54.920615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e6b4b-d4d2-42fd-b167-778e6618653f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:54.920897 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e6b4b-d4d2-42fd-b167-778e6618653f admin admin] PATH_INFO: `/v3/users/0f6084bc6fea49b3a21c2fc85578e04e` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:54.922610 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e6b4b-d4d2-42fd-b167-778e6618653f admin admin] RBAC: Authorizing `identity:get_user(user_id=0f6084bc6fea49b3a21c2fc85578e04e)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:54.924813 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e6b4b-d4d2-42fd-b167-778e6618653f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:54.926544 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 60/110] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:51:54 2021] GET /identity/v3/users/0f6084bc6fea49b3a21c2fc85578e04e => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:54.927135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e6b4b-d4d2-42fd-b167-778e6618653f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:54.928785 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-04bcb2ee-785b-4557-933a-5cdfc3b61d53 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:54.930199 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-04bcb2ee-785b-4557-933a-5cdfc3b61d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:54.936493 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e6b4b-d4d2-42fd-b167-778e6618653f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:54.939013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 51/111] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:51:54.940186 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcb2ee-785b-4557-933a-5cdfc3b61d53 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:54.941622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb53bd6-1450-46a1-8411-bc5f3463581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:54.942568 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb53bd6-1450-46a1-8411-bc5f3463581d admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:54.942926 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb53bd6-1450-46a1-8411-bc5f3463581d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:54.943277 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb53bd6-1450-46a1-8411-bc5f3463581d admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51/users/2a89afdaf4304b8588d33fcfb779c592/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:54.945333 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb53bd6-1450-46a1-8411-bc5f3463581d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac5876eff2e49d3bc4acac0831e9a51, user_id=2a89afdaf4304b8588d33fcfb779c592, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:54.946408 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-6eb53bd6-1450-46a1-8411-bc5f3463581d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:51:54.946408 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 02:51:54.946408 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 02:51:54.948506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb53bd6-1450-46a1-8411-bc5f3463581d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:54.951211 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcb2ee-785b-4557-933a-5cdfc3b61d53 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:54.956649 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98059c8-5961-4e71-a5ad-f1d6d162a495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:54.957545 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98059c8-5961-4e71-a5ad-f1d6d162a495 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:54.957854 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98059c8-5961-4e71-a5ad-f1d6d162a495 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:54.958161 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98059c8-5961-4e71-a5ad-f1d6d162a495 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:54.965864 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 61/112] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:51:54 2021] PUT /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51/users/2a89afdaf4304b8588d33fcfb779c592/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:51:54.966902 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb53bd6-1450-46a1-8411-bc5f3463581d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:54.970177 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98059c8-5961-4e71-a5ad-f1d6d162a495 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:51:54.977903 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-c98059c8-5961-4e71-a5ad-f1d6d162a495 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 02:51:54.979840 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 52/113] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:51:54 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:51:54.981023 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98059c8-5961-4e71-a5ad-f1d6d162a495 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:54.993048 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98059c8-5961-4e71-a5ad-f1d6d162a495 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:55.034537 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb53bd6-1450-46a1-8411-bc5f3463581d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:55.039395 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69911b-b70b-4d6a-8390-fe5f5a7edeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:55.040292 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69911b-b70b-4d6a-8390-fe5f5a7edeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:55.040586 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69911b-b70b-4d6a-8390-fe5f5a7edeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:55.040865 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69911b-b70b-4d6a-8390-fe5f5a7edeb0 admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:55.042110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69911b-b70b-4d6a-8390-fe5f5a7edeb0 admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:55.044337 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69911b-b70b-4d6a-8390-fe5f5a7edeb0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:55.046143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 62/114] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:51:54 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:55.047670 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69911b-b70b-4d6a-8390-fe5f5a7edeb0 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:55.058650 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69911b-b70b-4d6a-8390-fe5f5a7edeb0 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:55.060130 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fee16-1753-4d94-8628-c725d96de998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:55.060954 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fee16-1753-4d94-8628-c725d96de998 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:55.061344 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fee16-1753-4d94-8628-c725d96de998 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:55.061721 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fee16-1753-4d94-8628-c725d96de998 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:55.063148 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5d21a-b0fc-4819-ab1f-dfc3912c8925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:55.063866 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5d21a-b0fc-4819-ab1f-dfc3912c8925 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:55.064158 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5d21a-b0fc-4819-ab1f-dfc3912c8925 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:55.064444 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5d21a-b0fc-4819-ab1f-dfc3912c8925 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:55.065231 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5d21a-b0fc-4819-ab1f-dfc3912c8925 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:55.065531 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5d21a-b0fc-4819-ab1f-dfc3912c8925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:55.067185 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5d21a-b0fc-4819-ab1f-dfc3912c8925 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:55.074049 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fee16-1753-4d94-8628-c725d96de998 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:51:55.076361 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 63/115] 10.222.0.39 () {56 vars in 1123 bytes} [Tue Aug 31 02:51:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:55.077198 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5d21a-b0fc-4819-ab1f-dfc3912c8925 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:55.084455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-f94fee16-1753-4d94-8628-c725d96de998 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 02:51:55.085647 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 53/116] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:51:54 2021] GET /identity/v3/roles/member => generated 84 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:51:55.086444 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fee16-1753-4d94-8628-c725d96de998 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:55.099720 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5d21a-b0fc-4819-ab1f-dfc3912c8925 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:55.099914 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fee16-1753-4d94-8628-c725d96de998 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:55.105965 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea637ce-8022-411b-a54d-07ef0729dd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:55.106189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342b6a1-cd91-4f3d-baac-405a8ec93762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:55.106278 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea637ce-8022-411b-a54d-07ef0729dd31 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:55.106278 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea637ce-8022-411b-a54d-07ef0729dd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:55.106399 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342b6a1-cd91-4f3d-baac-405a8ec93762 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:55.106473 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea637ce-8022-411b-a54d-07ef0729dd31 admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51/users/0f6084bc6fea49b3a21c2fc85578e04e/roles/22d670400c514449b9734ad179a36f82` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:55.108478 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea637ce-8022-411b-a54d-07ef0729dd31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac5876eff2e49d3bc4acac0831e9a51, user_id=0f6084bc6fea49b3a21c2fc85578e04e, role_id=22d670400c514449b9734ad179a36f82)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:55.108593 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342b6a1-cd91-4f3d-baac-405a8ec93762 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:55.108752 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342b6a1-cd91-4f3d-baac-405a8ec93762 admin admin] PATH_INFO: `/v3/users/0f6084bc6fea49b3a21c2fc85578e04e` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:55.110860 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342b6a1-cd91-4f3d-baac-405a8ec93762 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f6084bc6fea49b3a21c2fc85578e04e)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:55.111980 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea637ce-8022-411b-a54d-07ef0729dd31 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:55.113089 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342b6a1-cd91-4f3d-baac-405a8ec93762 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:55.119878 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 54/117] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:51:55 2021] GET /identity/v3/users/0f6084bc6fea49b3a21c2fc85578e04e => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:55.120867 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342b6a1-cd91-4f3d-baac-405a8ec93762 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:55.132900 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342b6a1-cd91-4f3d-baac-405a8ec93762 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:55.134847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 64/118] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:51:55 2021] PUT /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51/users/0f6084bc6fea49b3a21c2fc85578e04e/roles/22d670400c514449b9734ad179a36f82 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:51:55.136355 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea637ce-8022-411b-a54d-07ef0729dd31 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:55.214131 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea637ce-8022-411b-a54d-07ef0729dd31 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:55.216406 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e8524-00d6-47c0-b76a-a8026d610fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:55.217107 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e8524-00d6-47c0-b76a-a8026d610fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:55.217393 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e8524-00d6-47c0-b76a-a8026d610fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:55.217667 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e8524-00d6-47c0-b76a-a8026d610fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:55.219167 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e8524-00d6-47c0-b76a-a8026d610fc4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:55.220196 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e8524-00d6-47c0-b76a-a8026d610fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:55.221717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fbad5-235d-425e-868f-590049a7ce06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:55.222008 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e8524-00d6-47c0-b76a-a8026d610fc4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:55.223024 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fbad5-235d-425e-868f-590049a7ce06 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:55.223529 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fbad5-235d-425e-868f-590049a7ce06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:55.224061 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fbad5-235d-425e-868f-590049a7ce06 admin admin] PATH_INFO: `/v3/projects/5823cf5e70b144c5a0f0b24bc65c867a` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:55.225626 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fbad5-235d-425e-868f-590049a7ce06 admin admin] RBAC: Authorizing `identity:get_project(project_id=5823cf5e70b144c5a0f0b24bc65c867a)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:55.228214 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fbad5-235d-425e-868f-590049a7ce06 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:55.230625 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 65/119] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:51:55 2021] GET /identity/v3/projects/5823cf5e70b144c5a0f0b24bc65c867a => generated 312 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:55.232024 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 55/120] 10.222.0.39 () {56 vars in 1123 bytes} [Tue Aug 31 02:51:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:55.240472 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fbad5-235d-425e-868f-590049a7ce06 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:55.240674 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e8524-00d6-47c0-b76a-a8026d610fc4 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:55.251684 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fbad5-235d-425e-868f-590049a7ce06 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:55.254472 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e8524-00d6-47c0-b76a-a8026d610fc4 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:55.261376 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0edc3-2f1e-4cb6-80ce-78681e57d3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:55.262309 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0edc3-2f1e-4cb6-80ce-78681e57d3ce admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:55.262593 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0edc3-2f1e-4cb6-80ce-78681e57d3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:55.262867 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0edc3-2f1e-4cb6-80ce-78681e57d3ce admin admin] PATH_INFO: `/v3/users/0f6084bc6fea49b3a21c2fc85578e04e` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:55.264229 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0edc3-2f1e-4cb6-80ce-78681e57d3ce admin admin] RBAC: Authorizing `identity:get_user(user_id=0f6084bc6fea49b3a21c2fc85578e04e)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:55.264444 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfd440-43bd-48e4-83ce-b5b040408ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:55.266201 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfd440-43bd-48e4-83ce-b5b040408ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:55.266710 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfd440-43bd-48e4-83ce-b5b040408ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:55.267172 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0edc3-2f1e-4cb6-80ce-78681e57d3ce admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:55.267398 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfd440-43bd-48e4-83ce-b5b040408ea2 admin admin] PATH_INFO: `/v3/projects/5823cf5e70b144c5a0f0b24bc65c867a/users/0f6084bc6fea49b3a21c2fc85578e04e/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:55.269725 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfd440-43bd-48e4-83ce-b5b040408ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5823cf5e70b144c5a0f0b24bc65c867a, user_id=0f6084bc6fea49b3a21c2fc85578e04e, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:55.272763 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfd440-43bd-48e4-83ce-b5b040408ea2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:55.274159 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 66/121] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:51:55 2021] GET /identity/v3/users/0f6084bc6fea49b3a21c2fc85578e04e => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:55.275537 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0edc3-2f1e-4cb6-80ce-78681e57d3ce admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:55.288149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0edc3-2f1e-4cb6-80ce-78681e57d3ce admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:55.292722 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73462af-b76f-4042-862c-892dd1751503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:55.293640 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73462af-b76f-4042-862c-892dd1751503 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:55.293911 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73462af-b76f-4042-862c-892dd1751503 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:55.294191 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73462af-b76f-4042-862c-892dd1751503 admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:55.295449 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73462af-b76f-4042-862c-892dd1751503 admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:55.297688 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73462af-b76f-4042-862c-892dd1751503 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:55.303443 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 67/122] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:51:55 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:51:55.304997 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218cc69-20be-4c16-8167-ede48b64b456 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:55.305183 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218cc69-20be-4c16-8167-ede48b64b456 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:55.305472 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218cc69-20be-4c16-8167-ede48b64b456 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:55.309144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 68/123] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:55 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:55.309894 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 56/124] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:51:55 2021] PUT /identity/v3/projects/5823cf5e70b144c5a0f0b24bc65c867a/users/0f6084bc6fea49b3a21c2fc85578e04e/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 02:51:55.316354 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218cc69-20be-4c16-8167-ede48b64b456 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:55.317407 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31152477-b7af-43dd-b57a-b1fbcb395fed None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:55.317841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31152477-b7af-43dd-b57a-b1fbcb395fed None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:55.318254 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31152477-b7af-43dd-b57a-b1fbcb395fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:55.339508 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-31152477-b7af-43dd-b57a-b1fbcb395fed None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:55.340997 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-31152477-b7af-43dd-b57a-b1fbcb395fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:55.409454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 57/125] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:51:55.414232 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218cc69-20be-4c16-8167-ede48b64b456 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:55.420526 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a66a29-16da-4bda-b633-6101ae371d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:55.422326 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a66a29-16da-4bda-b633-6101ae371d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:55.423062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a66a29-16da-4bda-b633-6101ae371d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:55.424155 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a66a29-16da-4bda-b633-6101ae371d1a admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51/users/0f6084bc6fea49b3a21c2fc85578e04e/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:55.428458 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a66a29-16da-4bda-b633-6101ae371d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac5876eff2e49d3bc4acac0831e9a51, user_id=0f6084bc6fea49b3a21c2fc85578e04e, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:55.433959 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a66a29-16da-4bda-b633-6101ae371d1a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:55.436879 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31152477-b7af-43dd-b57a-b1fbcb395fed None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:55.451501 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31152477-b7af-43dd-b57a-b1fbcb395fed None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:55.456459 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 69/126] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:51:55 2021] PUT /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51/users/0f6084bc6fea49b3a21c2fc85578e04e/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:51:55.518537 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6338a1c-70b7-4904-89dc-9ec4549e1840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:55.519823 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6338a1c-70b7-4904-89dc-9ec4549e1840 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:55.520303 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6338a1c-70b7-4904-89dc-9ec4549e1840 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:55.520766 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6338a1c-70b7-4904-89dc-9ec4549e1840 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:55.522284 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6338a1c-70b7-4904-89dc-9ec4549e1840 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:55.524296 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6338a1c-70b7-4904-89dc-9ec4549e1840 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:55.526261 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 58/127] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:51:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:55.535398 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a66a29-16da-4bda-b633-6101ae371d1a admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:55.550138 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a66a29-16da-4bda-b633-6101ae371d1a admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:55.566243 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93592c-f8f7-402e-b2da-fc4b7bc132b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:55.566933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93592c-f8f7-402e-b2da-fc4b7bc132b8 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:55.567219 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93592c-f8f7-402e-b2da-fc4b7bc132b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:55.567600 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93592c-f8f7-402e-b2da-fc4b7bc132b8 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:55.568325 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93592c-f8f7-402e-b2da-fc4b7bc132b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:55.570282 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93592c-f8f7-402e-b2da-fc4b7bc132b8 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:55.600070 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 70/128] 10.222.0.39 () {60 vars in 1154 bytes} [Tue Aug 31 02:51:55 2021] POST /identity/v3/users => generated 283 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:51:57.510482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e64a87-761d-47b7-9178-9cf12c44b0ae None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:57.511009 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e64a87-761d-47b7-9178-9cf12c44b0ae None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:57.511092 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e64a87-761d-47b7-9178-9cf12c44b0ae None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:57.513105 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 59/129] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:57.520136 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cac5a-6710-40b1-b0fe-c8e187cd9db1 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:57.520616 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cac5a-6710-40b1-b0fe-c8e187cd9db1 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:57.520710 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cac5a-6710-40b1-b0fe-c8e187cd9db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:57.545412 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-795cac5a-6710-40b1-b0fe-c8e187cd9db1 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:57.546710 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-795cac5a-6710-40b1-b0fe-c8e187cd9db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:57.570480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 71/130] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:51:57.616891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e64a87-761d-47b7-9178-9cf12c44b0ae None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:57.637059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e64a87-761d-47b7-9178-9cf12c44b0ae None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:57.645093 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10c508-55e6-4ca1-9cf7-050474f883ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:57.646153 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10c508-55e6-4ca1-9cf7-050474f883ae admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:57.646667 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10c508-55e6-4ca1-9cf7-050474f883ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:57.647133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10c508-55e6-4ca1-9cf7-050474f883ae admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:57.666611 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10c508-55e6-4ca1-9cf7-050474f883ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:51:57.673584 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-ab10c508-55e6-4ca1-9cf7-050474f883ae admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:51:57.674825 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 60/131] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:51:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:51:57.682475 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cac5a-6710-40b1-b0fe-c8e187cd9db1 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:57.697910 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cac5a-6710-40b1-b0fe-c8e187cd9db1 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:57.711018 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14baf893-8260-4aa9-8418-444d3bab9735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:57.711738 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14baf893-8260-4aa9-8418-444d3bab9735 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:57.712022 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14baf893-8260-4aa9-8418-444d3bab9735 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:57.712296 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14baf893-8260-4aa9-8418-444d3bab9735 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:57.713054 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14baf893-8260-4aa9-8418-444d3bab9735 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:57.713359 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14baf893-8260-4aa9-8418-444d3bab9735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:57.714996 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14baf893-8260-4aa9-8418-444d3bab9735 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:57.731914 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 72/132] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:51:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:57.741265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10c508-55e6-4ca1-9cf7-050474f883ae admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:57.755763 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10c508-55e6-4ca1-9cf7-050474f883ae admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:57.769200 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b28597-685b-44ff-9407-89a9b0b0d647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:57.770028 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b28597-685b-44ff-9407-89a9b0b0d647 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:57.770316 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b28597-685b-44ff-9407-89a9b0b0d647 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:57.770598 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b28597-685b-44ff-9407-89a9b0b0d647 admin admin] PATH_INFO: `/v3/users/2a89afdaf4304b8588d33fcfb779c592` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:57.771867 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b28597-685b-44ff-9407-89a9b0b0d647 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a89afdaf4304b8588d33fcfb779c592)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:57.773737 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b28597-685b-44ff-9407-89a9b0b0d647 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:57.776363 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 61/133] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:51:57 2021] GET /identity/v3/users/2a89afdaf4304b8588d33fcfb779c592 => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:57.786143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14baf893-8260-4aa9-8418-444d3bab9735 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:57.798483 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14baf893-8260-4aa9-8418-444d3bab9735 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:57.811331 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bcedd-aeb0-4da1-9ed1-1fe56f480595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:57.812032 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bcedd-aeb0-4da1-9ed1-1fe56f480595 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:57.812559 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bcedd-aeb0-4da1-9ed1-1fe56f480595 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:57.814044 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bcedd-aeb0-4da1-9ed1-1fe56f480595 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:57.829803 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3bcedd-aeb0-4da1-9ed1-1fe56f480595 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:57.832630 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3bcedd-aeb0-4da1-9ed1-1fe56f480595 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:57.845192 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 73/134] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:51:57 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:51:57.851891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b28597-685b-44ff-9407-89a9b0b0d647 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:57.866565 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b28597-685b-44ff-9407-89a9b0b0d647 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:57.878976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728d1e6-747e-43be-be2e-c79831e1aad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:57.880372 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728d1e6-747e-43be-be2e-c79831e1aad6 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:57.880672 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728d1e6-747e-43be-be2e-c79831e1aad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:57.880948 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728d1e6-747e-43be-be2e-c79831e1aad6 admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:57.882363 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728d1e6-747e-43be-be2e-c79831e1aad6 admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:57.884642 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728d1e6-747e-43be-be2e-c79831e1aad6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:57.891526 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 62/135] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:51:57 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:57.894930 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bcedd-aeb0-4da1-9ed1-1fe56f480595 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:57.914500 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bcedd-aeb0-4da1-9ed1-1fe56f480595 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:57.925744 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea09ab8-9d3e-427b-86a7-4b479305f943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:57.926419 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea09ab8-9d3e-427b-86a7-4b479305f943 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:57.926712 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea09ab8-9d3e-427b-86a7-4b479305f943 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:57.926996 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea09ab8-9d3e-427b-86a7-4b479305f943 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:57.927979 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea09ab8-9d3e-427b-86a7-4b479305f943 admin admin] RBAC: Adding query filter params (role.id=99835eeda2f64af5bc9173a8370d4568, scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51, user.id=2a89afdaf4304b8588d33fcfb779c592) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:57.928301 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea09ab8-9d3e-427b-86a7-4b479305f943 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:57.930586 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea09ab8-9d3e-427b-86a7-4b479305f943 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:57.939667 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 74/136] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:51:57 2021] GET /identity/v3/role_assignments?user.id=2a89afdaf4304b8588d33fcfb779c592&scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:58.023435 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcef49-edae-4cd3-9406-19077a2387c0 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:58.023780 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcef49-edae-4cd3-9406-19077a2387c0 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:58.023943 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcef49-edae-4cd3-9406-19077a2387c0 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:58.025918 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 63/137] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:58.036464 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176cf57-8355-4e15-9043-aab840cbf824 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:58.036934 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176cf57-8355-4e15-9043-aab840cbf824 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:58.037583 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176cf57-8355-4e15-9043-aab840cbf824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:58.066988 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-e176cf57-8355-4e15-9043-aab840cbf824 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:58.068233 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-e176cf57-8355-4e15-9043-aab840cbf824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:58.080237 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 75/138] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:51:58.119788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcef49-edae-4cd3-9406-19077a2387c0 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:58.142221 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcef49-edae-4cd3-9406-19077a2387c0 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:58.150849 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1749202-6cae-4e61-8c5b-ba6c96abe7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:58.152062 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1749202-6cae-4e61-8c5b-ba6c96abe7fa admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:58.152581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1749202-6cae-4e61-8c5b-ba6c96abe7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:58.152986 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1749202-6cae-4e61-8c5b-ba6c96abe7fa admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:58.167097 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca40fc-a548-48b3-ac7a-a4b8b8b42b90 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:58.167442 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca40fc-a548-48b3-ac7a-a4b8b8b42b90 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:58.167692 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca40fc-a548-48b3-ac7a-a4b8b8b42b90 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:58.167792 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1749202-6cae-4e61-8c5b-ba6c96abe7fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:51:58.169791 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 76/139] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:58.175701 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-c1749202-6cae-4e61-8c5b-ba6c96abe7fa admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 02:51:58.176956 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 64/140] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:51:58 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:51:58.180694 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04ccb9-c403-4e03-8d4b-690ff827d527 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:58.180980 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04ccb9-c403-4e03-8d4b-690ff827d527 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:58.182473 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04ccb9-c403-4e03-8d4b-690ff827d527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:58.192597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1749202-6cae-4e61-8c5b-ba6c96abe7fa admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:58.203144 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1749202-6cae-4e61-8c5b-ba6c96abe7fa admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:58.216515 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07183bec-7dfe-4969-b99e-05db64919ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:58.217613 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07183bec-7dfe-4969-b99e-05db64919ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:58.217810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-3b04ccb9-c403-4e03-8d4b-690ff827d527 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:58.218074 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07183bec-7dfe-4969-b99e-05db64919ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:58.219081 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07183bec-7dfe-4969-b99e-05db64919ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:58.220329 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-3b04ccb9-c403-4e03-8d4b-690ff827d527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:58.220444 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07183bec-7dfe-4969-b99e-05db64919ab5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:58.220785 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07183bec-7dfe-4969-b99e-05db64919ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:58.222435 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07183bec-7dfe-4969-b99e-05db64919ab5 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:58.238891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 65/141] 10.222.0.39 () {56 vars in 1123 bytes} [Tue Aug 31 02:51:58 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:51:58.245022 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 77/142] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:51:58.246539 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07183bec-7dfe-4969-b99e-05db64919ab5 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:58.257548 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07183bec-7dfe-4969-b99e-05db64919ab5 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:58.269326 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcee807-6a0f-47e6-8349-5c1328c946dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:58.270268 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcee807-6a0f-47e6-8349-5c1328c946dc admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:58.270553 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcee807-6a0f-47e6-8349-5c1328c946dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:58.270829 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcee807-6a0f-47e6-8349-5c1328c946dc admin admin] PATH_INFO: `/v3/users/0f6084bc6fea49b3a21c2fc85578e04e` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:58.272132 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcee807-6a0f-47e6-8349-5c1328c946dc admin admin] RBAC: Authorizing `identity:get_user(user_id=0f6084bc6fea49b3a21c2fc85578e04e)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:58.274383 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcee807-6a0f-47e6-8349-5c1328c946dc admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:58.276022 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 66/143] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:51:58 2021] GET /identity/v3/users/0f6084bc6fea49b3a21c2fc85578e04e => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:58.287992 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04ccb9-c403-4e03-8d4b-690ff827d527 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:58.297934 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcee807-6a0f-47e6-8349-5c1328c946dc admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:58.304548 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04ccb9-c403-4e03-8d4b-690ff827d527 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:58.315141 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90edf2-af1b-46f4-ac0d-a2711b9d15cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:58.315849 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90edf2-af1b-46f4-ac0d-a2711b9d15cc admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:58.316141 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90edf2-af1b-46f4-ac0d-a2711b9d15cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:58.316422 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90edf2-af1b-46f4-ac0d-a2711b9d15cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:58.319244 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcee807-6a0f-47e6-8349-5c1328c946dc admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:58.332388 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90edf2-af1b-46f4-ac0d-a2711b9d15cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:58.334226 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90edf2-af1b-46f4-ac0d-a2711b9d15cc admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:58.339671 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fba7d4-581d-44b7-993b-cc2020bf15ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:58.340493 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba7d4-581d-44b7-993b-cc2020bf15ba admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:58.340778 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba7d4-581d-44b7-993b-cc2020bf15ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:58.341056 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba7d4-581d-44b7-993b-cc2020bf15ba admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:58.357641 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 78/144] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:51:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:51:58.358687 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fba7d4-581d-44b7-993b-cc2020bf15ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:51:58.364453 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90edf2-af1b-46f4-ac0d-a2711b9d15cc admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:58.372249 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-11fba7d4-581d-44b7-993b-cc2020bf15ba admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 02:51:58.373483 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 67/145] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:51:58 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:51:58.379931 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fba7d4-581d-44b7-993b-cc2020bf15ba admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:58.382381 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90edf2-af1b-46f4-ac0d-a2711b9d15cc admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:58.393157 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5a14d-25bd-419f-8853-ff54dfeb31f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:58.394030 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5a14d-25bd-419f-8853-ff54dfeb31f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:58.394316 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5a14d-25bd-419f-8853-ff54dfeb31f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:58.394593 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5a14d-25bd-419f-8853-ff54dfeb31f7 admin admin] PATH_INFO: `/v3/projects/5823cf5e70b144c5a0f0b24bc65c867a` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:58.400123 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5a14d-25bd-419f-8853-ff54dfeb31f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=5823cf5e70b144c5a0f0b24bc65c867a)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:58.402200 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5a14d-25bd-419f-8853-ff54dfeb31f7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:58.405806 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fba7d4-581d-44b7-993b-cc2020bf15ba admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:58.408670 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 79/146] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:51:58 2021] GET /identity/v3/projects/5823cf5e70b144c5a0f0b24bc65c867a => generated 312 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:51:58.414912 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5a14d-25bd-419f-8853-ff54dfeb31f7 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:58.422152 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01577c51-5229-42ae-b635-3ccb5f38c38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:58.422837 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01577c51-5229-42ae-b635-3ccb5f38c38e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:58.423126 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01577c51-5229-42ae-b635-3ccb5f38c38e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:58.423421 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01577c51-5229-42ae-b635-3ccb5f38c38e admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:58.424199 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01577c51-5229-42ae-b635-3ccb5f38c38e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:58.424509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01577c51-5229-42ae-b635-3ccb5f38c38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:58.426123 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01577c51-5229-42ae-b635-3ccb5f38c38e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:58.432343 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5a14d-25bd-419f-8853-ff54dfeb31f7 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:58.443787 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 68/147] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:51:58 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:51:58.449799 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55aebc-3191-49b9-aacc-bc078c3146de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:58.450855 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55aebc-3191-49b9-aacc-bc078c3146de admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:58.451349 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55aebc-3191-49b9-aacc-bc078c3146de admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:58.451886 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55aebc-3191-49b9-aacc-bc078c3146de admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:58.453326 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55aebc-3191-49b9-aacc-bc078c3146de admin admin] RBAC: Adding query filter params (role.id=fd3d7d578a52485f96ce76c2bbe1360d, scope.project.id=5823cf5e70b144c5a0f0b24bc65c867a, user.id=0f6084bc6fea49b3a21c2fc85578e04e) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:58.453652 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55aebc-3191-49b9-aacc-bc078c3146de admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:58.455592 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55aebc-3191-49b9-aacc-bc078c3146de admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:58.457046 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01577c51-5229-42ae-b635-3ccb5f38c38e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:58.471410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01577c51-5229-42ae-b635-3ccb5f38c38e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:58.472476 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 80/148] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:51:58 2021] GET /identity/v3/role_assignments?user.id=0f6084bc6fea49b3a21c2fc85578e04e&scope.project.id=5823cf5e70b144c5a0f0b24bc65c867a&role.id=fd3d7d578a52485f96ce76c2bbe1360d => generated 608 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:51:58.488487 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276e14d-d346-4408-aa78-6d9c5c936f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:58.489443 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276e14d-d346-4408-aa78-6d9c5c936f6f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:58.489716 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276e14d-d346-4408-aa78-6d9c5c936f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:58.490005 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276e14d-d346-4408-aa78-6d9c5c936f6f admin admin] PATH_INFO: `/v3/users/0f6084bc6fea49b3a21c2fc85578e04e` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:58.491252 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276e14d-d346-4408-aa78-6d9c5c936f6f admin admin] RBAC: Authorizing `identity:get_user(user_id=0f6084bc6fea49b3a21c2fc85578e04e)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:58.493458 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276e14d-d346-4408-aa78-6d9c5c936f6f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:58.495294 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 69/149] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:51:58 2021] GET /identity/v3/users/0f6084bc6fea49b3a21c2fc85578e04e => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:58.505306 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55aebc-3191-49b9-aacc-bc078c3146de admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:58.520154 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55aebc-3191-49b9-aacc-bc078c3146de admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:58.526424 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc854c-798d-4394-ae03-02bace692a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:58.527020 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc854c-798d-4394-ae03-02bace692a61 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:58.527347 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc854c-798d-4394-ae03-02bace692a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:58.527645 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc854c-798d-4394-ae03-02bace692a61 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:58.541484 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc854c-798d-4394-ae03-02bace692a61 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:58.543492 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc854c-798d-4394-ae03-02bace692a61 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:58.557358 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 81/150] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:51:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 02:51:58.563631 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276e14d-d346-4408-aa78-6d9c5c936f6f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:58.579810 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276e14d-d346-4408-aa78-6d9c5c936f6f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:58.587636 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff162fc-3b5f-41fe-a00e-b2d145fda8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:58.588525 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff162fc-3b5f-41fe-a00e-b2d145fda8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:58.588814 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff162fc-3b5f-41fe-a00e-b2d145fda8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:58.589100 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff162fc-3b5f-41fe-a00e-b2d145fda8e8 admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:58.590346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff162fc-3b5f-41fe-a00e-b2d145fda8e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:58.592489 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff162fc-3b5f-41fe-a00e-b2d145fda8e8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:58.595187 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 70/151] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:51:58 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:58.601646 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc854c-798d-4394-ae03-02bace692a61 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:58.614919 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc854c-798d-4394-ae03-02bace692a61 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:58.620808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c5269-6c1d-4984-b484-56a0f0869233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:58.621826 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c5269-6c1d-4984-b484-56a0f0869233 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:58.622109 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c5269-6c1d-4984-b484-56a0f0869233 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:58.622383 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c5269-6c1d-4984-b484-56a0f0869233 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:58.623207 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c5269-6c1d-4984-b484-56a0f0869233 admin admin] RBAC: Adding query filter params (role.id=22d670400c514449b9734ad179a36f82, scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51, user.id=0f6084bc6fea49b3a21c2fc85578e04e) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:58.623550 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c5269-6c1d-4984-b484-56a0f0869233 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:58.625770 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c5269-6c1d-4984-b484-56a0f0869233 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:58.637029 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 82/152] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:51:58 2021] GET /identity/v3/role_assignments?user.id=0f6084bc6fea49b3a21c2fc85578e04e&scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51&role.id=22d670400c514449b9734ad179a36f82 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:59.055878 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47707d-7eef-46f7-bbab-c9ef7eb4ea13 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:59.056262 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47707d-7eef-46f7-bbab-c9ef7eb4ea13 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:59.056450 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47707d-7eef-46f7-bbab-c9ef7eb4ea13 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:59.058482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 71/153] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:59.065368 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e437a9-d20d-4f0a-aafa-5b8c8943e8c0 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:59.065657 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e437a9-d20d-4f0a-aafa-5b8c8943e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:59.065935 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e437a9-d20d-4f0a-aafa-5b8c8943e8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:59.087522 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-39e437a9-d20d-4f0a-aafa-5b8c8943e8c0 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:51:59.088726 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-39e437a9-d20d-4f0a-aafa-5b8c8943e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:51:59.101338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 83/154] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:51:59.150418 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47707d-7eef-46f7-bbab-c9ef7eb4ea13 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:59.169635 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47707d-7eef-46f7-bbab-c9ef7eb4ea13 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:59.179509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74199d60-0a98-4328-8b03-0b95880e5b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:59.180324 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74199d60-0a98-4328-8b03-0b95880e5b4c admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:59.180624 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74199d60-0a98-4328-8b03-0b95880e5b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:59.180898 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74199d60-0a98-4328-8b03-0b95880e5b4c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:59.192025 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74199d60-0a98-4328-8b03-0b95880e5b4c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:51:59.198899 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-74199d60-0a98-4328-8b03-0b95880e5b4c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 02:51:59.204669 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 72/155] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:51:59 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:51:59.211250 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e437a9-d20d-4f0a-aafa-5b8c8943e8c0 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:59.221023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e437a9-d20d-4f0a-aafa-5b8c8943e8c0 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:59.230993 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638c71d-f558-4a73-80a5-16c5d2d1d0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:59.231697 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638c71d-f558-4a73-80a5-16c5d2d1d0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:59.231979 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638c71d-f558-4a73-80a5-16c5d2d1d0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:59.232263 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638c71d-f558-4a73-80a5-16c5d2d1d0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:59.233012 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638c71d-f558-4a73-80a5-16c5d2d1d0a3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:59.233316 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638c71d-f558-4a73-80a5-16c5d2d1d0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:59.235663 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638c71d-f558-4a73-80a5-16c5d2d1d0a3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:59.247397 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 84/156] 10.222.0.39 () {56 vars in 1123 bytes} [Tue Aug 31 02:51:59 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:59.253880 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74199d60-0a98-4328-8b03-0b95880e5b4c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:59.264396 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74199d60-0a98-4328-8b03-0b95880e5b4c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:59.274734 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab523d36-aabd-4180-846e-2427157fb265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:59.275652 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab523d36-aabd-4180-846e-2427157fb265 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:59.275945 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab523d36-aabd-4180-846e-2427157fb265 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:59.276228 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab523d36-aabd-4180-846e-2427157fb265 admin admin] PATH_INFO: `/v3/users/0f6084bc6fea49b3a21c2fc85578e04e` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:59.277454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab523d36-aabd-4180-846e-2427157fb265 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f6084bc6fea49b3a21c2fc85578e04e)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:59.279646 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab523d36-aabd-4180-846e-2427157fb265 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:59.282270 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 73/157] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:51:59 2021] GET /identity/v3/users/0f6084bc6fea49b3a21c2fc85578e04e => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:59.288387 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638c71d-f558-4a73-80a5-16c5d2d1d0a3 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:59.304759 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638c71d-f558-4a73-80a5-16c5d2d1d0a3 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:59.312095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019b385-a2bd-4b1c-b06e-b47b2fe3eaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:59.313213 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019b385-a2bd-4b1c-b06e-b47b2fe3eaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:59.313685 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019b385-a2bd-4b1c-b06e-b47b2fe3eaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:59.313963 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019b385-a2bd-4b1c-b06e-b47b2fe3eaa6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:59.322672 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019b385-a2bd-4b1c-b06e-b47b2fe3eaa6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:59.324499 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019b385-a2bd-4b1c-b06e-b47b2fe3eaa6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:59.337116 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 85/158] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:51:59 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 02:51:59.343338 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab523d36-aabd-4180-846e-2427157fb265 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:59.353407 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab523d36-aabd-4180-846e-2427157fb265 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:59.362290 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a35a1-f0fa-4c2b-b460-f43fb07fc8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:59.363165 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a35a1-f0fa-4c2b-b460-f43fb07fc8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:59.363480 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a35a1-f0fa-4c2b-b460-f43fb07fc8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:59.363758 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a35a1-f0fa-4c2b-b460-f43fb07fc8d7 admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:59.364964 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a35a1-f0fa-4c2b-b460-f43fb07fc8d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:59.367028 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a35a1-f0fa-4c2b-b460-f43fb07fc8d7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:59.368988 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 74/159] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:51:59 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:59.376725 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019b385-a2bd-4b1c-b06e-b47b2fe3eaa6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:51:59.386267 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019b385-a2bd-4b1c-b06e-b47b2fe3eaa6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:51:59.391499 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072c0a8-d577-402b-acd9-03462472ca4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:51:59.392510 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072c0a8-d577-402b-acd9-03462472ca4e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:59.393083 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072c0a8-d577-402b-acd9-03462472ca4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:59.393562 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072c0a8-d577-402b-acd9-03462472ca4e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:59.394659 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072c0a8-d577-402b-acd9-03462472ca4e admin admin] RBAC: Adding query filter params (role.id=fd3d7d578a52485f96ce76c2bbe1360d, scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51, user.id=0f6084bc6fea49b3a21c2fc85578e04e) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:51:59.395170 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072c0a8-d577-402b-acd9-03462472ca4e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:51:59.397388 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072c0a8-d577-402b-acd9-03462472ca4e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:51:59.411523 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 86/160] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:51:59 2021] GET /identity/v3/role_assignments?user.id=0f6084bc6fea49b3a21c2fc85578e04e&scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51&role.id=fd3d7d578a52485f96ce76c2bbe1360d => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:51:59.969885 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b69a0d-8fba-4b78-9f6f-2cc064810604 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:59.970405 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b69a0d-8fba-4b78-9f6f-2cc064810604 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:59.970593 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b69a0d-8fba-4b78-9f6f-2cc064810604 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:51:59.972251 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 75/161] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:51:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:51:59.978345 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88be9ad-d5ac-4310-858a-f8c123c45465 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:51:59.978872 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88be9ad-d5ac-4310-858a-f8c123c45465 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:51:59.978872 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88be9ad-d5ac-4310-858a-f8c123c45465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.008475 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-a88be9ad-d5ac-4310-858a-f8c123c45465 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:00.009688 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a88be9ad-d5ac-4310-858a-f8c123c45465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:00.018367 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 87/162] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:51:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:00.045122 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b69a0d-8fba-4b78-9f6f-2cc064810604 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:00.058897 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b69a0d-8fba-4b78-9f6f-2cc064810604 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:00.067242 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7779561-9496-459f-af8f-b57fb951963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:00.068064 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7779561-9496-459f-af8f-b57fb951963a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.068342 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7779561-9496-459f-af8f-b57fb951963a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.068613 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7779561-9496-459f-af8f-b57fb951963a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.085811 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7779561-9496-459f-af8f-b57fb951963a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:00.092802 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-d7779561-9496-459f-af8f-b57fb951963a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 02:52:00.099764 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 76/163] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:00.101717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88be9ad-d5ac-4310-858a-f8c123c45465 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:00.111750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88be9ad-d5ac-4310-858a-f8c123c45465 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:00.119896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e2670-3aea-4e8b-8c00-b2daa123cc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:00.119896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e2670-3aea-4e8b-8c00-b2daa123cc14 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.119896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e2670-3aea-4e8b-8c00-b2daa123cc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.119896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e2670-3aea-4e8b-8c00-b2daa123cc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.121449 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e2670-3aea-4e8b-8c00-b2daa123cc14 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:00.121449 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e2670-3aea-4e8b-8c00-b2daa123cc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:00.121449 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e2670-3aea-4e8b-8c00-b2daa123cc14 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:00.129406 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 88/164] 10.222.0.39 () {56 vars in 1123 bytes} [Tue Aug 31 02:52:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:00.135776 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7779561-9496-459f-af8f-b57fb951963a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:00.146300 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7779561-9496-459f-af8f-b57fb951963a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:00.150855 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8df5cf-0cf3-4f30-be67-aced56c9830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:00.151748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8df5cf-0cf3-4f30-be67-aced56c9830f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.152034 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8df5cf-0cf3-4f30-be67-aced56c9830f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.152311 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8df5cf-0cf3-4f30-be67-aced56c9830f admin admin] PATH_INFO: `/v3/users/25236dce65d64098adcd0b8966c6c2e1` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.167274 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8df5cf-0cf3-4f30-be67-aced56c9830f admin admin] RBAC: Authorizing `identity:get_user(user_id=25236dce65d64098adcd0b8966c6c2e1)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:00.169523 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8df5cf-0cf3-4f30-be67-aced56c9830f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:00.171389 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 77/165] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:52:00 2021] GET /identity/v3/users/25236dce65d64098adcd0b8966c6c2e1 => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:00.177682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e2670-3aea-4e8b-8c00-b2daa123cc14 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:00.188011 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e2670-3aea-4e8b-8c00-b2daa123cc14 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:00.192745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd7387-bbf6-4d1a-b2f6-e613e7c8fc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:00.193419 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd7387-bbf6-4d1a-b2f6-e613e7c8fc44 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.193755 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd7387-bbf6-4d1a-b2f6-e613e7c8fc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.194032 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd7387-bbf6-4d1a-b2f6-e613e7c8fc44 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.202509 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd7387-bbf6-4d1a-b2f6-e613e7c8fc44 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:00.204953 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd7387-bbf6-4d1a-b2f6-e613e7c8fc44 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:00.214300 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 89/166] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:00.221305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8df5cf-0cf3-4f30-be67-aced56c9830f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:00.231416 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8df5cf-0cf3-4f30-be67-aced56c9830f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:00.236126 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ccb18-71f4-4962-ae12-6c92e8f62308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:00.237035 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ccb18-71f4-4962-ae12-6c92e8f62308 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.237339 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ccb18-71f4-4962-ae12-6c92e8f62308 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.237622 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ccb18-71f4-4962-ae12-6c92e8f62308 admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.238908 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ccb18-71f4-4962-ae12-6c92e8f62308 admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa811d3b72a44de83c79fec2b3d6685)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:00.241122 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ccb18-71f4-4962-ae12-6c92e8f62308 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:00.243013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 78/167] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:00 2021] GET /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:00.249762 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd7387-bbf6-4d1a-b2f6-e613e7c8fc44 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:00.259194 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd7387-bbf6-4d1a-b2f6-e613e7c8fc44 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:00.263891 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e647c-68ee-41b7-8c9e-7deb2aeeb7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:00.264636 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e647c-68ee-41b7-8c9e-7deb2aeeb7be admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.264922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e647c-68ee-41b7-8c9e-7deb2aeeb7be admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.265796 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e647c-68ee-41b7-8c9e-7deb2aeeb7be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.266621 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e647c-68ee-41b7-8c9e-7deb2aeeb7be admin admin] RBAC: Adding query filter params (role.id=fd3d7d578a52485f96ce76c2bbe1360d, scope.project.id=2fa811d3b72a44de83c79fec2b3d6685, user.id=25236dce65d64098adcd0b8966c6c2e1) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:00.266933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e647c-68ee-41b7-8c9e-7deb2aeeb7be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:00.268949 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e647c-68ee-41b7-8c9e-7deb2aeeb7be admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:00.274802 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 90/168] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:00 2021] GET /identity/v3/role_assignments?user.id=25236dce65d64098adcd0b8966c6c2e1&scope.project.id=2fa811d3b72a44de83c79fec2b3d6685&role.id=fd3d7d578a52485f96ce76c2bbe1360d => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:00.616219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90b60d-ba67-4415-a481-cf4050f8731d None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.616590 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90b60d-ba67-4415-a481-cf4050f8731d None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.616876 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90b60d-ba67-4415-a481-cf4050f8731d None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.618992 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 79/169] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:00.625915 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa481d5-c573-4aed-8bc7-2766eec3c0a0 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.626460 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa481d5-c573-4aed-8bc7-2766eec3c0a0 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.626938 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa481d5-c573-4aed-8bc7-2766eec3c0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.646765 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-3fa481d5-c573-4aed-8bc7-2766eec3c0a0 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:00.648387 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-3fa481d5-c573-4aed-8bc7-2766eec3c0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:00.657813 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 91/170] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:00.683659 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90b60d-ba67-4415-a481-cf4050f8731d None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:00.696820 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90b60d-ba67-4415-a481-cf4050f8731d None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:00.701385 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71816f-5d6f-4d4d-b8b5-2606de6932ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:00.702391 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71816f-5d6f-4d4d-b8b5-2606de6932ec admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.703455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71816f-5d6f-4d4d-b8b5-2606de6932ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.703953 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71816f-5d6f-4d4d-b8b5-2606de6932ec admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.714228 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71816f-5d6f-4d4d-b8b5-2606de6932ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:00.722410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-5f71816f-5d6f-4d4d-b8b5-2606de6932ec admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:52:00.723845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 80/171] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:52:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:00.727266 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fa803-2f16-462c-b41d-edff350d63db None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.727266 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fa803-2f16-462c-b41d-edff350d63db None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.727266 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fa803-2f16-462c-b41d-edff350d63db None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.728623 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 92/172] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:00.730586 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71816f-5d6f-4d4d-b8b5-2606de6932ec admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:00.734602 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae0f22-9b7d-43f6-b668-79cdceb32dc3 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.734879 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae0f22-9b7d-43f6-b668-79cdceb32dc3 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.735336 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae0f22-9b7d-43f6-b668-79cdceb32dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.743157 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71816f-5d6f-4d4d-b8b5-2606de6932ec admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:00.748596 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391c4e7-a89f-4b43-84da-17c76e5104c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:00.750103 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391c4e7-a89f-4b43-84da-17c76e5104c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.750693 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391c4e7-a89f-4b43-84da-17c76e5104c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.751162 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391c4e7-a89f-4b43-84da-17c76e5104c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.752239 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391c4e7-a89f-4b43-84da-17c76e5104c2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:00.752737 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-f8ae0f22-9b7d-43f6-b668-79cdceb32dc3 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:00.752994 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391c4e7-a89f-4b43-84da-17c76e5104c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:00.753895 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f8ae0f22-9b7d-43f6-b668-79cdceb32dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:00.755106 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391c4e7-a89f-4b43-84da-17c76e5104c2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:00.761498 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 93/173] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:00.765632 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 81/174] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:00.771880 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae0f22-9b7d-43f6-b668-79cdceb32dc3 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:00.784825 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae0f22-9b7d-43f6-b668-79cdceb32dc3 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:00.789437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa287c-7428-4cec-8cd4-1908f61fd31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:00.790350 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa287c-7428-4cec-8cd4-1908f61fd31a admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.790629 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa287c-7428-4cec-8cd4-1908f61fd31a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.790962 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa287c-7428-4cec-8cd4-1908f61fd31a admin admin] PATH_INFO: `/v3/users/2a89afdaf4304b8588d33fcfb779c592` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.792217 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa287c-7428-4cec-8cd4-1908f61fd31a admin admin] RBAC: Authorizing `identity:get_user(user_id=2a89afdaf4304b8588d33fcfb779c592)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:00.794218 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa287c-7428-4cec-8cd4-1908f61fd31a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:00.794604 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391c4e7-a89f-4b43-84da-17c76e5104c2 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:00.796169 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 94/175] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:52:00 2021] GET /identity/v3/users/2a89afdaf4304b8588d33fcfb779c592 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:00.805221 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa287c-7428-4cec-8cd4-1908f61fd31a admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:00.805815 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391c4e7-a89f-4b43-84da-17c76e5104c2 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:00.810791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ca416-7c3e-4e84-b3a0-a389a8caa4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:00.812591 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ca416-7c3e-4e84-b3a0-a389a8caa4af admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.813026 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ca416-7c3e-4e84-b3a0-a389a8caa4af admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.813870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ca416-7c3e-4e84-b3a0-a389a8caa4af admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.816000 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa287c-7428-4cec-8cd4-1908f61fd31a admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:00.821014 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9941a-391f-45b7-8e66-d8f41efb1c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:00.821862 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9941a-391f-45b7-8e66-d8f41efb1c79 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.822271 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9941a-391f-45b7-8e66-d8f41efb1c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.822642 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9941a-391f-45b7-8e66-d8f41efb1c79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.827305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ca416-7c3e-4e84-b3a0-a389a8caa4af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:00.833059 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9941a-391f-45b7-8e66-d8f41efb1c79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:00.835160 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9941a-391f-45b7-8e66-d8f41efb1c79 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:00.837740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-301ca416-7c3e-4e84-b3a0-a389a8caa4af admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 02:52:00.839189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 82/176] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:00 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:00.847556 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ca416-7c3e-4e84-b3a0-a389a8caa4af admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:00.850640 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 95/177] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 02:52:00.857219 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9941a-391f-45b7-8e66-d8f41efb1c79 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:00.858566 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ca416-7c3e-4e84-b3a0-a389a8caa4af admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:00.864830 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e236a-b081-46b2-a9ef-2d5d2eae5dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:00.865175 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e236a-b081-46b2-a9ef-2d5d2eae5dac admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.865394 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e236a-b081-46b2-a9ef-2d5d2eae5dac admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.865671 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e236a-b081-46b2-a9ef-2d5d2eae5dac admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.866644 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e236a-b081-46b2-a9ef-2d5d2eae5dac admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:00.866894 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e236a-b081-46b2-a9ef-2d5d2eae5dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:00.868628 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e236a-b081-46b2-a9ef-2d5d2eae5dac admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:00.870164 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9941a-391f-45b7-8e66-d8f41efb1c79 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:00.875993 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b5bf3-d8fd-4dbe-8534-8630a04d13b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:00.877148 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b5bf3-d8fd-4dbe-8534-8630a04d13b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.877638 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b5bf3-d8fd-4dbe-8534-8630a04d13b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.878130 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b5bf3-d8fd-4dbe-8534-8630a04d13b3 admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.879557 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b5bf3-d8fd-4dbe-8534-8630a04d13b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa811d3b72a44de83c79fec2b3d6685)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:00.880572 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 83/178] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:00 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:00.882019 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b5bf3-d8fd-4dbe-8534-8630a04d13b3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:00.883909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 96/179] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:00 2021] GET /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:00.890750 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e236a-b081-46b2-a9ef-2d5d2eae5dac admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:00.891848 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b5bf3-d8fd-4dbe-8534-8630a04d13b3 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:00.899463 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e236a-b081-46b2-a9ef-2d5d2eae5dac admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:00.901553 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b5bf3-d8fd-4dbe-8534-8630a04d13b3 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:00.904285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf78f8-ffa8-409a-a109-b9d0ee2388e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:00.905331 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf78f8-ffa8-409a-a109-b9d0ee2388e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.905616 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf78f8-ffa8-409a-a109-b9d0ee2388e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.905939 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf78f8-ffa8-409a-a109-b9d0ee2388e0 admin admin] PATH_INFO: `/v3/users/25236dce65d64098adcd0b8966c6c2e1` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.907740 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a231b-29d4-4bc8-8aed-edcd160e35ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:00.907873 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf78f8-ffa8-409a-a109-b9d0ee2388e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=25236dce65d64098adcd0b8966c6c2e1)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:00.908794 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a231b-29d4-4bc8-8aed-edcd160e35ae admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.909321 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a231b-29d4-4bc8-8aed-edcd160e35ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.909783 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a231b-29d4-4bc8-8aed-edcd160e35ae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.909983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf78f8-ffa8-409a-a109-b9d0ee2388e0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:00.911008 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a231b-29d4-4bc8-8aed-edcd160e35ae admin admin] RBAC: Adding query filter params (role.id=99835eeda2f64af5bc9173a8370d4568, scope.project.id=2fa811d3b72a44de83c79fec2b3d6685, user.id=2a89afdaf4304b8588d33fcfb779c592) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:00.911611 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 84/180] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:52:00 2021] GET /identity/v3/users/25236dce65d64098adcd0b8966c6c2e1 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:00.911712 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a231b-29d4-4bc8-8aed-edcd160e35ae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:00.913796 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a231b-29d4-4bc8-8aed-edcd160e35ae admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:00.917598 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf78f8-ffa8-409a-a109-b9d0ee2388e0 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:00.920583 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 97/181] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:00 2021] GET /identity/v3/role_assignments?user.id=2a89afdaf4304b8588d33fcfb779c592&scope.project.id=2fa811d3b72a44de83c79fec2b3d6685&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:00.922582 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fac225-459d-4715-bba5-2fdd32221534 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.922856 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fac225-459d-4715-bba5-2fdd32221534 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.923129 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fac225-459d-4715-bba5-2fdd32221534 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.928015 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf78f8-ffa8-409a-a109-b9d0ee2388e0 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:00.930657 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 98/182] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:00 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:00.934935 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b9fae-5503-4778-9e3b-b205cab49f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:00.934935 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b9fae-5503-4778-9e3b-b205cab49f9e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.934935 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b9fae-5503-4778-9e3b-b205cab49f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.934935 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b9fae-5503-4778-9e3b-b205cab49f9e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.938736 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c06fd-c7cd-4e2e-bce7-947262f86823 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.939318 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c06fd-c7cd-4e2e-bce7-947262f86823 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.939815 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c06fd-c7cd-4e2e-bce7-947262f86823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.945341 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b9fae-5503-4778-9e3b-b205cab49f9e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:00.947526 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b9fae-5503-4778-9e3b-b205cab49f9e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:00.958622 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 85/183] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 02:52:00.964639 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-d57c06fd-c7cd-4e2e-bce7-947262f86823 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:00.964815 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b9fae-5503-4778-9e3b-b205cab49f9e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:00.966523 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-d57c06fd-c7cd-4e2e-bce7-947262f86823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:00.974884 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b9fae-5503-4778-9e3b-b205cab49f9e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:00.987400 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02faf8-ab42-4232-98b3-ce2142ed106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:00.987400 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02faf8-ab42-4232-98b3-ce2142ed106f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:00.987400 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02faf8-ab42-4232-98b3-ce2142ed106f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:00.987400 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02faf8-ab42-4232-98b3-ce2142ed106f admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:00.987772 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02faf8-ab42-4232-98b3-ce2142ed106f admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa811d3b72a44de83c79fec2b3d6685)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:00.987772 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02faf8-ab42-4232-98b3-ce2142ed106f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:00.987772 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 86/184] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:00 2021] GET /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:00.988219 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 99/185] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:00.994259 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02faf8-ab42-4232-98b3-ce2142ed106f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:01.008205 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02faf8-ab42-4232-98b3-ce2142ed106f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:01.008840 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c06fd-c7cd-4e2e-bce7-947262f86823 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:01.013151 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cb641-1c39-4a95-9ae8-f36688ed027c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:01.013950 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cb641-1c39-4a95-9ae8-f36688ed027c admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:01.014390 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cb641-1c39-4a95-9ae8-f36688ed027c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:01.014675 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cb641-1c39-4a95-9ae8-f36688ed027c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:01.018154 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cb641-1c39-4a95-9ae8-f36688ed027c admin admin] RBAC: Adding query filter params (role.id=22d670400c514449b9734ad179a36f82, scope.project.id=2fa811d3b72a44de83c79fec2b3d6685, user.id=25236dce65d64098adcd0b8966c6c2e1) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:01.018528 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cb641-1c39-4a95-9ae8-f36688ed027c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:01.020636 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cb641-1c39-4a95-9ae8-f36688ed027c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:01.021427 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c06fd-c7cd-4e2e-bce7-947262f86823 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:01.027657 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63569af6-c0b0-4788-a4af-eb5c655684d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:01.028081 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 87/186] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:00 2021] GET /identity/v3/role_assignments?user.id=25236dce65d64098adcd0b8966c6c2e1&scope.project.id=2fa811d3b72a44de83c79fec2b3d6685&role.id=22d670400c514449b9734ad179a36f82 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:01.029035 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63569af6-c0b0-4788-a4af-eb5c655684d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:01.029480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63569af6-c0b0-4788-a4af-eb5c655684d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:01.029915 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63569af6-c0b0-4788-a4af-eb5c655684d2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:01.032128 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63569af6-c0b0-4788-a4af-eb5c655684d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:01.034098 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63569af6-c0b0-4788-a4af-eb5c655684d2 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:01.036132 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 100/187] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:01 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:01.042831 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cb641-1c39-4a95-9ae8-f36688ed027c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:01.057169 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cb641-1c39-4a95-9ae8-f36688ed027c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:01.062062 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104109ad-6569-42b0-ad95-1b69277c8061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:01.063498 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104109ad-6569-42b0-ad95-1b69277c8061 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:01.063857 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104109ad-6569-42b0-ad95-1b69277c8061 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:01.064202 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104109ad-6569-42b0-ad95-1b69277c8061 admin admin] PATH_INFO: `/v3/groups` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:01.064996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104109ad-6569-42b0-ad95-1b69277c8061 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:01.066147 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-104109ad-6569-42b0-ad95-1b69277c8061 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:01.066147 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 02:52:01.066147 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 02:52:01.067605 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104109ad-6569-42b0-ad95-1b69277c8061 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:01.086420 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 88/188] 10.222.0.39 () {60 vars in 1156 bytes} [Tue Aug 31 02:52:01 2021] POST /identity/v3/groups => generated 229 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:52:02.519784 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e9288-f107-452b-9b4d-22fb21d851c2 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:02.520283 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e9288-f107-452b-9b4d-22fb21d851c2 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:02.520358 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e9288-f107-452b-9b4d-22fb21d851c2 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:02.522243 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 101/189] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:02.529440 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2ac9-acb5-43b4-8bc2-aebe0fe8bffa None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:02.530397 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2ac9-acb5-43b4-8bc2-aebe0fe8bffa None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:02.531498 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2ac9-acb5-43b4-8bc2-aebe0fe8bffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:02.549803 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-d1cd2ac9-acb5-43b4-8bc2-aebe0fe8bffa None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:02.551262 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d1cd2ac9-acb5-43b4-8bc2-aebe0fe8bffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:02.559090 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 89/190] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:02.585015 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e9288-f107-452b-9b4d-22fb21d851c2 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:02.598235 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e9288-f107-452b-9b4d-22fb21d851c2 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:02.603170 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadefab-99ec-400c-8b51-19ebc4483c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:02.604205 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadefab-99ec-400c-8b51-19ebc4483c1d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:02.604711 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadefab-99ec-400c-8b51-19ebc4483c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:02.605207 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadefab-99ec-400c-8b51-19ebc4483c1d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:02.621526 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadefab-99ec-400c-8b51-19ebc4483c1d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:02.635906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-ceadefab-99ec-400c-8b51-19ebc4483c1d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 02:52:02.637497 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 102/191] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:02.648494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd2ac9-acb5-43b4-8bc2-aebe0fe8bffa None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:02.658509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd2ac9-acb5-43b4-8bc2-aebe0fe8bffa None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:02.663340 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06eeaa-9cf8-46cc-b5d0-311f82879b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:02.664256 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06eeaa-9cf8-46cc-b5d0-311f82879b18 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:02.664760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06eeaa-9cf8-46cc-b5d0-311f82879b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:02.665235 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06eeaa-9cf8-46cc-b5d0-311f82879b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:02.666202 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06eeaa-9cf8-46cc-b5d0-311f82879b18 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:02.666705 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06eeaa-9cf8-46cc-b5d0-311f82879b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:02.668507 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06eeaa-9cf8-46cc-b5d0-311f82879b18 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:02.677413 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 90/192] 10.222.0.39 () {56 vars in 1123 bytes} [Tue Aug 31 02:52:02 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:02.683757 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadefab-99ec-400c-8b51-19ebc4483c1d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:02.695186 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadefab-99ec-400c-8b51-19ebc4483c1d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:02.704283 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9cd10-9e35-47f6-b087-b24b07a81eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:02.705154 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9cd10-9e35-47f6-b087-b24b07a81eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:02.705433 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9cd10-9e35-47f6-b087-b24b07a81eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:02.705706 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9cd10-9e35-47f6-b087-b24b07a81eb7 admin admin] PATH_INFO: `/v3/users/25236dce65d64098adcd0b8966c6c2e1` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:02.706928 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9cd10-9e35-47f6-b087-b24b07a81eb7 admin admin] RBAC: Authorizing `identity:get_user(user_id=25236dce65d64098adcd0b8966c6c2e1)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:02.709092 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9cd10-9e35-47f6-b087-b24b07a81eb7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:02.710983 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 103/193] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:52:02 2021] GET /identity/v3/users/25236dce65d64098adcd0b8966c6c2e1 => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:02.716985 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06eeaa-9cf8-46cc-b5d0-311f82879b18 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:02.727707 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06eeaa-9cf8-46cc-b5d0-311f82879b18 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:02.732446 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b7ad4-d054-46ce-a5ec-9d6845db28a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:02.733550 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b7ad4-d054-46ce-a5ec-9d6845db28a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:02.734074 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b7ad4-d054-46ce-a5ec-9d6845db28a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:02.734585 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b7ad4-d054-46ce-a5ec-9d6845db28a3 admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:02.736032 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b7ad4-d054-46ce-a5ec-9d6845db28a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa811d3b72a44de83c79fec2b3d6685)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:02.738361 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b7ad4-d054-46ce-a5ec-9d6845db28a3 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:02.740579 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 91/194] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:02 2021] GET /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:02.747133 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9cd10-9e35-47f6-b087-b24b07a81eb7 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:02.757679 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9cd10-9e35-47f6-b087-b24b07a81eb7 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:02.762541 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388706c-6224-4da9-aaf1-78d96e0f1b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:02.763679 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388706c-6224-4da9-aaf1-78d96e0f1b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:02.764168 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388706c-6224-4da9-aaf1-78d96e0f1b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:02.764643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388706c-6224-4da9-aaf1-78d96e0f1b9e admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685/users/25236dce65d64098adcd0b8966c6c2e1/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:02.767501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388706c-6224-4da9-aaf1-78d96e0f1b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa811d3b72a44de83c79fec2b3d6685, user_id=25236dce65d64098adcd0b8966c6c2e1, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:02.770412 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388706c-6224-4da9-aaf1-78d96e0f1b9e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:02.784978 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 104/195] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:52:02 2021] PUT /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685/users/25236dce65d64098adcd0b8966c6c2e1/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:52:03.204621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee8060-4a8c-499a-abf9-d2799a98bba9 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:03.205305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee8060-4a8c-499a-abf9-d2799a98bba9 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:03.205809 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee8060-4a8c-499a-abf9-d2799a98bba9 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:03.207837 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 92/196] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:52:03.214006 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7698f78-29d3-49ca-8338-d57a65056c45 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:03.214301 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7698f78-29d3-49ca-8338-d57a65056c45 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:03.214582 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7698f78-29d3-49ca-8338-d57a65056c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:03.232442 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-b7698f78-29d3-49ca-8338-d57a65056c45 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:03.233654 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b7698f78-29d3-49ca-8338-d57a65056c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:03.266618 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbb307-3e9d-4e53-8a2c-ebeb3c51ffc8 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:03.266931 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbb307-3e9d-4e53-8a2c-ebeb3c51ffc8 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:03.267182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbb307-3e9d-4e53-8a2c-ebeb3c51ffc8 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:03.269393 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 93/197] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:52:03.275771 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c380e-fe01-4762-9529-0ba4d1d46484 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:03.276071 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c380e-fe01-4762-9529-0ba4d1d46484 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:03.276445 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c380e-fe01-4762-9529-0ba4d1d46484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:03.294693 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-611c380e-fe01-4762-9529-0ba4d1d46484 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:03.296114 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-611c380e-fe01-4762-9529-0ba4d1d46484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:03.302543 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 105/198] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:03.305022 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 94/199] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:03.326858 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7698f78-29d3-49ca-8338-d57a65056c45 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:03.329132 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c380e-fe01-4762-9529-0ba4d1d46484 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:03.337643 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c380e-fe01-4762-9529-0ba4d1d46484 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:03.338250 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7698f78-29d3-49ca-8338-d57a65056c45 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:03.342115 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b2949-9728-4a6e-89ed-5acbe0510ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:03.342899 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b2949-9728-4a6e-89ed-5acbe0510ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:03.343115 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2ce49-6ebf-47bb-8de0-8dcb58a794fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:03.343271 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b2949-9728-4a6e-89ed-5acbe0510ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:03.343855 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b2949-9728-4a6e-89ed-5acbe0510ba9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:03.344103 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2ce49-6ebf-47bb-8de0-8dcb58a794fb admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:03.344382 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2ce49-6ebf-47bb-8de0-8dcb58a794fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:03.344651 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2ce49-6ebf-47bb-8de0-8dcb58a794fb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:03.354304 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b2949-9728-4a6e-89ed-5acbe0510ba9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:03.354648 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2ce49-6ebf-47bb-8de0-8dcb58a794fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:03.362116 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-6ee2ce49-6ebf-47bb-8de0-8dcb58a794fb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:52:03.363536 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 106/200] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:52:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:03.364777 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef9fcd-aef1-44c7-9a42-3b336f5a408c None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:03.364883 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef9fcd-aef1-44c7-9a42-3b336f5a408c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:03.364977 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-b93b2949-9728-4a6e-89ed-5acbe0510ba9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 02:52:03.365163 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef9fcd-aef1-44c7-9a42-3b336f5a408c None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:03.366900 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 107/201] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:03.367109 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 95/202] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:03 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:03.372010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef9fcd-aef1-44c7-9a42-3b336f5a408c None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:03.373572 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe47a9-920e-48ca-aac6-3e74e03f16a0 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:03.373860 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe47a9-920e-48ca-aac6-3e74e03f16a0 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:03.374392 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe47a9-920e-48ca-aac6-3e74e03f16a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:03.384702 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef9fcd-aef1-44c7-9a42-3b336f5a408c None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:03.388988 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194cbcb-a6c8-4cda-af6c-770ea2ea3629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:03.389635 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194cbcb-a6c8-4cda-af6c-770ea2ea3629 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:03.389921 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194cbcb-a6c8-4cda-af6c-770ea2ea3629 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:03.390295 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194cbcb-a6c8-4cda-af6c-770ea2ea3629 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:03.391040 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194cbcb-a6c8-4cda-af6c-770ea2ea3629 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:03.391345 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194cbcb-a6c8-4cda-af6c-770ea2ea3629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:03.392958 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194cbcb-a6c8-4cda-af6c-770ea2ea3629 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:03.393054 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-2dbe47a9-920e-48ca-aac6-3e74e03f16a0 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:03.394130 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-2dbe47a9-920e-48ca-aac6-3e74e03f16a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:03.401793 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 96/203] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:03.402374 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe47a9-920e-48ca-aac6-3e74e03f16a0 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:03.407723 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 108/204] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:03.410338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194cbcb-a6c8-4cda-af6c-770ea2ea3629 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:03.416752 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe47a9-920e-48ca-aac6-3e74e03f16a0 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:03.419960 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194cbcb-a6c8-4cda-af6c-770ea2ea3629 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:03.423148 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4339f2-c8f8-4ed2-ac73-2f1d5ad6e6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:03.424392 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4339f2-c8f8-4ed2-ac73-2f1d5ad6e6fd admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:03.424814 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4339f2-c8f8-4ed2-ac73-2f1d5ad6e6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:03.425221 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4339f2-c8f8-4ed2-ac73-2f1d5ad6e6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:03.425686 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a8694-e903-4ed6-9c6a-a60f5bbae069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:03.426337 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4339f2-c8f8-4ed2-ac73-2f1d5ad6e6fd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:03.426644 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4339f2-c8f8-4ed2-ac73-2f1d5ad6e6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:03.426744 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a8694-e903-4ed6-9c6a-a60f5bbae069 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:03.426988 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a8694-e903-4ed6-9c6a-a60f5bbae069 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:03.427272 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a8694-e903-4ed6-9c6a-a60f5bbae069 admin admin] PATH_INFO: `/v3/users/2a89afdaf4304b8588d33fcfb779c592` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:03.428391 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4339f2-c8f8-4ed2-ac73-2f1d5ad6e6fd admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:03.428505 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a8694-e903-4ed6-9c6a-a60f5bbae069 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a89afdaf4304b8588d33fcfb779c592)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:03.430268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a8694-e903-4ed6-9c6a-a60f5bbae069 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:03.432072 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 109/205] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:52:03 2021] GET /identity/v3/users/2a89afdaf4304b8588d33fcfb779c592 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:03.436864 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 97/206] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:03 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:03.438188 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a8694-e903-4ed6-9c6a-a60f5bbae069 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:03.443594 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4339f2-c8f8-4ed2-ac73-2f1d5ad6e6fd admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:03.447731 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a8694-e903-4ed6-9c6a-a60f5bbae069 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:03.452007 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c3cd9-0ed9-43c2-b357-144774d9ef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:03.452865 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4339f2-c8f8-4ed2-ac73-2f1d5ad6e6fd admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:03.453019 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c3cd9-0ed9-43c2-b357-144774d9ef78 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:03.453195 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c3cd9-0ed9-43c2-b357-144774d9ef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:03.453575 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c3cd9-0ed9-43c2-b357-144774d9ef78 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:03.455524 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c3cd9-0ed9-43c2-b357-144774d9ef78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:03.457156 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c3cd9-0ed9-43c2-b357-144774d9ef78 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:03.464160 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 110/207] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:03.464160 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c3cd9-0ed9-43c2-b357-144774d9ef78 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:03.465949 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6633b-caa3-4739-9c53-b553e5ab4df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:03.466905 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6633b-caa3-4739-9c53-b553e5ab4df4 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:03.467192 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6633b-caa3-4739-9c53-b553e5ab4df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:03.467491 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6633b-caa3-4739-9c53-b553e5ab4df4 admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:03.469546 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6633b-caa3-4739-9c53-b553e5ab4df4 admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa811d3b72a44de83c79fec2b3d6685)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:03.471588 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6633b-caa3-4739-9c53-b553e5ab4df4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:03.473364 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 98/208] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:03 2021] GET /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:03.473956 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6633b-caa3-4739-9c53-b553e5ab4df4 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:03.479430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c3cd9-0ed9-43c2-b357-144774d9ef78 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:03.483151 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6633b-caa3-4739-9c53-b553e5ab4df4 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:03.484919 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42c16c-a149-4bee-acc8-6b310874b7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:03.485853 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42c16c-a149-4bee-acc8-6b310874b7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:03.486199 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42c16c-a149-4bee-acc8-6b310874b7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:03.486481 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42c16c-a149-4bee-acc8-6b310874b7e5 admin admin] PATH_INFO: `/v3/users/25236dce65d64098adcd0b8966c6c2e1` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:03.487746 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42c16c-a149-4bee-acc8-6b310874b7e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=25236dce65d64098adcd0b8966c6c2e1)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:03.488826 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f01b8-2b8f-4d62-aa5c-b22268603212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:03.489521 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f01b8-2b8f-4d62-aa5c-b22268603212 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:03.489870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f01b8-2b8f-4d62-aa5c-b22268603212 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:03.489982 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42c16c-a149-4bee-acc8-6b310874b7e5 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:03.490257 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f01b8-2b8f-4d62-aa5c-b22268603212 admin admin] PATH_INFO: `/v3/groups` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:03.490987 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f01b8-2b8f-4d62-aa5c-b22268603212 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:03.491646 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 111/209] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:52:03 2021] GET /identity/v3/users/25236dce65d64098adcd0b8966c6c2e1 => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:03.492350 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42c16c-a149-4bee-acc8-6b310874b7e5 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:03.497740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f01b8-2b8f-4d62-aa5c-b22268603212 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:03.502148 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42c16c-a149-4bee-acc8-6b310874b7e5 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:03.507880 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d72937-55dc-44af-8536-045b4fa27c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:03.508749 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d72937-55dc-44af-8536-045b4fa27c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:03.509033 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d72937-55dc-44af-8536-045b4fa27c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:03.509310 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d72937-55dc-44af-8536-045b4fa27c70 admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685/users/2a89afdaf4304b8588d33fcfb779c592/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:03.511260 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d72937-55dc-44af-8536-045b4fa27c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa811d3b72a44de83c79fec2b3d6685, user_id=2a89afdaf4304b8588d33fcfb779c592, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:03.514145 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d72937-55dc-44af-8536-045b4fa27c70 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:03.515561 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 99/210] 10.222.0.39 () {60 vars in 1156 bytes} [Tue Aug 31 02:52:03 2021] POST /identity/v3/groups => generated 226 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:52:03.516996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f01b8-2b8f-4d62-aa5c-b22268603212 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:03.529267 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f01b8-2b8f-4d62-aa5c-b22268603212 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:03.536203 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27cd89-8aa1-44ab-adb9-94acc222b1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:03.538074 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 112/211] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:52:03 2021] PUT /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685/users/2a89afdaf4304b8588d33fcfb779c592/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:52:03.538645 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27cd89-8aa1-44ab-adb9-94acc222b1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:03.539157 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27cd89-8aa1-44ab-adb9-94acc222b1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:03.539707 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27cd89-8aa1-44ab-adb9-94acc222b1b8 admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:03.541923 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27cd89-8aa1-44ab-adb9-94acc222b1b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa811d3b72a44de83c79fec2b3d6685)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:03.544736 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27cd89-8aa1-44ab-adb9-94acc222b1b8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:03.548291 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 100/212] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:03 2021] GET /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:03.556554 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d72937-55dc-44af-8536-045b4fa27c70 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:03.647572 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d72937-55dc-44af-8536-045b4fa27c70 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:03.654222 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b3205-855c-4c4c-a29e-00eb811d0773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:03.655781 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3205-855c-4c4c-a29e-00eb811d0773 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:03.657060 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3205-855c-4c4c-a29e-00eb811d0773 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:03.657864 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3205-855c-4c4c-a29e-00eb811d0773 admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685/users/25236dce65d64098adcd0b8966c6c2e1/roles/22d670400c514449b9734ad179a36f82` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:03.661116 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b3205-855c-4c4c-a29e-00eb811d0773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa811d3b72a44de83c79fec2b3d6685, user_id=25236dce65d64098adcd0b8966c6c2e1, role_id=22d670400c514449b9734ad179a36f82)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:03.664250 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b3205-855c-4c4c-a29e-00eb811d0773 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:03.681323 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 113/213] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:52:03 2021] PUT /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685/users/25236dce65d64098adcd0b8966c6c2e1/roles/22d670400c514449b9734ad179a36f82 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:52:05.056212 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819c4af-e987-4ccd-a13a-98d3bce92d22 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:05.057222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819c4af-e987-4ccd-a13a-98d3bce92d22 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:05.057700 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819c4af-e987-4ccd-a13a-98d3bce92d22 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:05.059978 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 101/214] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:05.065893 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71e915-3e53-4fe3-ae9d-f735c0606447 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:05.066349 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71e915-3e53-4fe3-ae9d-f735c0606447 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:05.066425 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71e915-3e53-4fe3-ae9d-f735c0606447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:05.084801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-3e71e915-3e53-4fe3-ae9d-f735c0606447 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:05.085979 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-3e71e915-3e53-4fe3-ae9d-f735c0606447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:05.168111 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 114/215] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:05.204569 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819c4af-e987-4ccd-a13a-98d3bce92d22 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:05.216801 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819c4af-e987-4ccd-a13a-98d3bce92d22 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:05.223506 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7b901-d503-4374-98ba-5683b1e6ac43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:05.224297 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7b901-d503-4374-98ba-5683b1e6ac43 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:05.224573 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7b901-d503-4374-98ba-5683b1e6ac43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:05.224847 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7b901-d503-4374-98ba-5683b1e6ac43 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:05.242277 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7b901-d503-4374-98ba-5683b1e6ac43 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:05.249342 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-dab7b901-d503-4374-98ba-5683b1e6ac43 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 02:52:05.251195 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 102/216] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:05 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:05.257645 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71e915-3e53-4fe3-ae9d-f735c0606447 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:05.267264 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71e915-3e53-4fe3-ae9d-f735c0606447 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:05.275374 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2d68c-0fc0-4233-afc5-341c9a362081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:05.276039 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2d68c-0fc0-4233-afc5-341c9a362081 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:05.276317 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2d68c-0fc0-4233-afc5-341c9a362081 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:05.276586 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2d68c-0fc0-4233-afc5-341c9a362081 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:05.277330 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2d68c-0fc0-4233-afc5-341c9a362081 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:05.277630 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2d68c-0fc0-4233-afc5-341c9a362081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:05.279218 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2d68c-0fc0-4233-afc5-341c9a362081 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:05.290918 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 115/217] 10.222.0.39 () {56 vars in 1123 bytes} [Tue Aug 31 02:52:05 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:05.297029 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7b901-d503-4374-98ba-5683b1e6ac43 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:05.313307 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7b901-d503-4374-98ba-5683b1e6ac43 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:05.320021 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c202e-bbc2-4b87-8ffb-8494bf0c476d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:05.320913 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c202e-bbc2-4b87-8ffb-8494bf0c476d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:05.321202 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c202e-bbc2-4b87-8ffb-8494bf0c476d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:05.321483 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c202e-bbc2-4b87-8ffb-8494bf0c476d admin admin] PATH_INFO: `/v3/users/25236dce65d64098adcd0b8966c6c2e1` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:05.322711 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c202e-bbc2-4b87-8ffb-8494bf0c476d admin admin] RBAC: Authorizing `identity:get_user(user_id=25236dce65d64098adcd0b8966c6c2e1)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:05.324872 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c202e-bbc2-4b87-8ffb-8494bf0c476d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:05.326494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 103/218] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:52:05 2021] GET /identity/v3/users/25236dce65d64098adcd0b8966c6c2e1 => generated 283 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:05.332821 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2d68c-0fc0-4233-afc5-341c9a362081 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:05.348444 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2d68c-0fc0-4233-afc5-341c9a362081 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:05.355376 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4cdc5-d768-460b-8d1c-acc7b650bb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:05.356034 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4cdc5-d768-460b-8d1c-acc7b650bb4c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:05.356313 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4cdc5-d768-460b-8d1c-acc7b650bb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:05.356585 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4cdc5-d768-460b-8d1c-acc7b650bb4c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:05.370952 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4cdc5-d768-460b-8d1c-acc7b650bb4c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:05.373022 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4cdc5-d768-460b-8d1c-acc7b650bb4c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:05.389002 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 116/219] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:05.395279 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c202e-bbc2-4b87-8ffb-8494bf0c476d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:05.409592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c202e-bbc2-4b87-8ffb-8494bf0c476d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:05.419472 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7d424-0e84-487e-9509-321da75ede6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:05.420337 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7d424-0e84-487e-9509-321da75ede6a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:05.420620 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7d424-0e84-487e-9509-321da75ede6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:05.420890 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7d424-0e84-487e-9509-321da75ede6a admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:05.428113 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7d424-0e84-487e-9509-321da75ede6a admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa811d3b72a44de83c79fec2b3d6685)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:05.430181 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7d424-0e84-487e-9509-321da75ede6a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:05.432246 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 104/220] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:05 2021] GET /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:05.438904 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4cdc5-d768-460b-8d1c-acc7b650bb4c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:05.452338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4cdc5-d768-460b-8d1c-acc7b650bb4c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:05.459472 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19b591-5c42-4b04-b958-879499f0a41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:05.460133 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19b591-5c42-4b04-b958-879499f0a41a admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:05.460409 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19b591-5c42-4b04-b958-879499f0a41a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:05.460678 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19b591-5c42-4b04-b958-879499f0a41a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:05.461534 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19b591-5c42-4b04-b958-879499f0a41a admin admin] RBAC: Adding query filter params (role.id=fd3d7d578a52485f96ce76c2bbe1360d, scope.project.id=2fa811d3b72a44de83c79fec2b3d6685, user.id=25236dce65d64098adcd0b8966c6c2e1) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:05.461814 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19b591-5c42-4b04-b958-879499f0a41a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:05.463667 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19b591-5c42-4b04-b958-879499f0a41a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:05.475966 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 117/221] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:05 2021] GET /identity/v3/role_assignments?user.id=25236dce65d64098adcd0b8966c6c2e1&scope.project.id=2fa811d3b72a44de83c79fec2b3d6685&role.id=fd3d7d578a52485f96ce76c2bbe1360d => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:06.146199 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c3b3a-1f57-4f5e-98cb-2b900c6746bc None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.146717 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c3b3a-1f57-4f5e-98cb-2b900c6746bc None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.146799 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c3b3a-1f57-4f5e-98cb-2b900c6746bc None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.148578 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 105/222] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:06.154707 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b283e-06f6-4f05-b7bd-b9cbb71ee047 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.155134 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b283e-06f6-4f05-b7bd-b9cbb71ee047 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.155328 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b283e-06f6-4f05-b7bd-b9cbb71ee047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.177950 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-a35b283e-06f6-4f05-b7bd-b9cbb71ee047 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:06.179127 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a35b283e-06f6-4f05-b7bd-b9cbb71ee047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:06.191576 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 118/223] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:06.237285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c3b3a-1f57-4f5e-98cb-2b900c6746bc None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:06.256152 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c3b3a-1f57-4f5e-98cb-2b900c6746bc None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:06.260774 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a051b-133e-4dca-b9d9-b91379d76f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:06.261569 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a051b-133e-4dca-b9d9-b91379d76f18 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.261850 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a051b-133e-4dca-b9d9-b91379d76f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.262124 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a051b-133e-4dca-b9d9-b91379d76f18 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.284565 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a051b-133e-4dca-b9d9-b91379d76f18 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:06.291505 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-4c2a051b-133e-4dca-b9d9-b91379d76f18 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 02:52:06.293043 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 106/224] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:06.301264 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b283e-06f6-4f05-b7bd-b9cbb71ee047 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:06.318644 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b283e-06f6-4f05-b7bd-b9cbb71ee047 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:06.333521 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0413a-22b6-4f0d-8ff9-47b40faffcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:06.334503 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0413a-22b6-4f0d-8ff9-47b40faffcf5 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.334932 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0413a-22b6-4f0d-8ff9-47b40faffcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.335325 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0413a-22b6-4f0d-8ff9-47b40faffcf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.336515 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0413a-22b6-4f0d-8ff9-47b40faffcf5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:06.336980 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0413a-22b6-4f0d-8ff9-47b40faffcf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:06.339544 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0413a-22b6-4f0d-8ff9-47b40faffcf5 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:06.356821 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054d3d4-141b-41a6-ac92-1495c39d76a6 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.356994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 119/225] 10.222.0.39 () {56 vars in 1123 bytes} [Tue Aug 31 02:52:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:06.357186 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054d3d4-141b-41a6-ac92-1495c39d76a6 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.357376 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054d3d4-141b-41a6-ac92-1495c39d76a6 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.359901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 107/226] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:52:06.365740 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0413a-22b6-4f0d-8ff9-47b40faffcf5 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:06.372302 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d5974-e65f-4379-9712-b0ad0990d770 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.372529 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d5974-e65f-4379-9712-b0ad0990d770 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.372814 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d5974-e65f-4379-9712-b0ad0990d770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.387078 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0413a-22b6-4f0d-8ff9-47b40faffcf5 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:06.404869 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da46dff-644e-45b3-80c0-fb6ecfc65c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:06.405525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da46dff-644e-45b3-80c0-fb6ecfc65c4f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.405843 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da46dff-644e-45b3-80c0-fb6ecfc65c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.406125 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da46dff-644e-45b3-80c0-fb6ecfc65c4f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.419210 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-c44d5974-e65f-4379-9712-b0ad0990d770 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:06.420463 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c44d5974-e65f-4379-9712-b0ad0990d770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:06.426390 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da46dff-644e-45b3-80c0-fb6ecfc65c4f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:06.428206 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da46dff-644e-45b3-80c0-fb6ecfc65c4f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:06.444481 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 108/227] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:06.450389 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 120/228] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:06.456526 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d5974-e65f-4379-9712-b0ad0990d770 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:06.469220 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d5974-e65f-4379-9712-b0ad0990d770 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:06.479773 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acb760-292a-46c1-9ca2-0e764d0de6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:06.480649 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acb760-292a-46c1-9ca2-0e764d0de6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.480932 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acb760-292a-46c1-9ca2-0e764d0de6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.481224 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acb760-292a-46c1-9ca2-0e764d0de6a6 admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.482404 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acb760-292a-46c1-9ca2-0e764d0de6a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:06.485076 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acb760-292a-46c1-9ca2-0e764d0de6a6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:06.486754 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 109/229] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:06 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:06.493037 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da46dff-644e-45b3-80c0-fb6ecfc65c4f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:06.505758 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da46dff-644e-45b3-80c0-fb6ecfc65c4f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:06.510552 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61a7cf-b6de-4ec7-880f-2ff03d2002da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:06.511497 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61a7cf-b6de-4ec7-880f-2ff03d2002da admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.511783 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61a7cf-b6de-4ec7-880f-2ff03d2002da admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.512061 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61a7cf-b6de-4ec7-880f-2ff03d2002da admin admin] PATH_INFO: `/v3/groups/8c77cb99e8a04c8283d7eec1c9183279` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.521745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61a7cf-b6de-4ec7-880f-2ff03d2002da admin admin] RBAC: Authorizing `identity:get_group(group_id=8c77cb99e8a04c8283d7eec1c9183279)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:06.522769 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-9a61a7cf-b6de-4ec7-880f-2ff03d2002da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:06.522769 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 02:52:06.522769 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 02:52:06.523995 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61a7cf-b6de-4ec7-880f-2ff03d2002da admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:06.525668 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 121/230] 10.222.0.39 () {56 vars in 1202 bytes} [Tue Aug 31 02:52:06 2021] GET /identity/v3/groups/8c77cb99e8a04c8283d7eec1c9183279 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:06.532662 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acb760-292a-46c1-9ca2-0e764d0de6a6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:06.542464 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acb760-292a-46c1-9ca2-0e764d0de6a6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:06.551517 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef2907-fec8-4703-a558-0a453a71e388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:06.552167 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef2907-fec8-4703-a558-0a453a71e388 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.552454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef2907-fec8-4703-a558-0a453a71e388 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.552729 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef2907-fec8-4703-a558-0a453a71e388 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.553565 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef2907-fec8-4703-a558-0a453a71e388 admin admin] RBAC: Adding query filter params (group.id=8c77cb99e8a04c8283d7eec1c9183279, role.id=fd3d7d578a52485f96ce76c2bbe1360d, scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:06.553869 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef2907-fec8-4703-a558-0a453a71e388 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:06.555740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef2907-fec8-4703-a558-0a453a71e388 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:06.559588 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61a7cf-b6de-4ec7-880f-2ff03d2002da admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:06.570369 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61a7cf-b6de-4ec7-880f-2ff03d2002da admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:06.572841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 110/231] 10.222.0.39 () {56 vars in 1398 bytes} [Tue Aug 31 02:52:06 2021] GET /identity/v3/role_assignments?group.id=8c77cb99e8a04c8283d7eec1c9183279&scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51&role.id=fd3d7d578a52485f96ce76c2bbe1360d => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:06.585780 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1056a-acb2-46b7-8d05-1c6e7ad9e47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:06.586642 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1056a-acb2-46b7-8d05-1c6e7ad9e47e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.586905 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1056a-acb2-46b7-8d05-1c6e7ad9e47e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.587174 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1056a-acb2-46b7-8d05-1c6e7ad9e47e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.606062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1056a-acb2-46b7-8d05-1c6e7ad9e47e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:06.614510 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-4fe1056a-acb2-46b7-8d05-1c6e7ad9e47e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 02:52:06.615812 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 122/232] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:06 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:06.622793 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef2907-fec8-4703-a558-0a453a71e388 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:06.636920 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef2907-fec8-4703-a558-0a453a71e388 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:06.644823 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfb37d-d7c4-4509-9fc8-637b4c61f51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:06.645510 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfb37d-d7c4-4509-9fc8-637b4c61f51e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.645797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfb37d-d7c4-4509-9fc8-637b4c61f51e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.646079 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfb37d-d7c4-4509-9fc8-637b4c61f51e admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.646833 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfb37d-d7c4-4509-9fc8-637b4c61f51e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:06.647139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfb37d-d7c4-4509-9fc8-637b4c61f51e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:06.648773 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfb37d-d7c4-4509-9fc8-637b4c61f51e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:06.664126 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 111/233] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:06 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:06.670116 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1056a-acb2-46b7-8d05-1c6e7ad9e47e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:06.684836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1056a-acb2-46b7-8d05-1c6e7ad9e47e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:06.689608 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbe076-9fec-4480-9a3f-f6ae59fa71ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:06.690489 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbe076-9fec-4480-9a3f-f6ae59fa71ba admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.690770 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbe076-9fec-4480-9a3f-f6ae59fa71ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.691044 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbe076-9fec-4480-9a3f-f6ae59fa71ba admin admin] PATH_INFO: `/v3/users/25236dce65d64098adcd0b8966c6c2e1` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.698325 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbe076-9fec-4480-9a3f-f6ae59fa71ba admin admin] RBAC: Authorizing `identity:get_user(user_id=25236dce65d64098adcd0b8966c6c2e1)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:06.698745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbe076-9fec-4480-9a3f-f6ae59fa71ba admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:06.700348 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 123/234] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:52:06 2021] GET /identity/v3/users/25236dce65d64098adcd0b8966c6c2e1 => generated 283 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:06.707110 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfb37d-d7c4-4509-9fc8-637b4c61f51e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:06.721239 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfb37d-d7c4-4509-9fc8-637b4c61f51e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:06.723755 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fea7a6-340f-4696-8ad4-6b80754f6922 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.724026 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fea7a6-340f-4696-8ad4-6b80754f6922 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.724301 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fea7a6-340f-4696-8ad4-6b80754f6922 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.726069 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 124/235] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:06.731716 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1aa6f-f7a9-4e21-a7c8-2903a73a5b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:06.732371 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1aa6f-f7a9-4e21-a7c8-2903a73a5b77 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.732737 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1aa6f-f7a9-4e21-a7c8-2903a73a5b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.732924 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1aa6f-f7a9-4e21-a7c8-2903a73a5b77 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.735430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebf944-7d3c-4846-976b-b3b1b540ede5 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.735723 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebf944-7d3c-4846-976b-b3b1b540ede5 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.735997 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebf944-7d3c-4846-976b-b3b1b540ede5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.747013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1aa6f-f7a9-4e21-a7c8-2903a73a5b77 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:06.749338 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1aa6f-f7a9-4e21-a7c8-2903a73a5b77 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:06.761574 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 112/236] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:06.767506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-7aebf944-7d3c-4846-976b-b3b1b540ede5 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:06.768711 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-7aebf944-7d3c-4846-976b-b3b1b540ede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:06.774639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1aa6f-f7a9-4e21-a7c8-2903a73a5b77 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:06.784838 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 125/237] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:06.789030 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1aa6f-f7a9-4e21-a7c8-2903a73a5b77 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:06.801455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1286c-3255-4f5a-ade2-b288c526a804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:06.802332 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1286c-3255-4f5a-ade2-b288c526a804 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.802608 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1286c-3255-4f5a-ade2-b288c526a804 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.802879 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1286c-3255-4f5a-ade2-b288c526a804 admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.808417 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1286c-3255-4f5a-ade2-b288c526a804 admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa811d3b72a44de83c79fec2b3d6685)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:06.810520 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1286c-3255-4f5a-ade2-b288c526a804 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:06.813038 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 113/238] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:06 2021] GET /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:06.819206 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebf944-7d3c-4846-976b-b3b1b540ede5 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:06.833816 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1286c-3255-4f5a-ade2-b288c526a804 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:06.837596 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebf944-7d3c-4846-976b-b3b1b540ede5 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:06.849219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1286c-3255-4f5a-ade2-b288c526a804 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:06.852177 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02debe1f-3617-4bfb-820a-02fad7f27bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:06.852864 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02debe1f-3617-4bfb-820a-02fad7f27bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.853152 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02debe1f-3617-4bfb-820a-02fad7f27bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.853429 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02debe1f-3617-4bfb-820a-02fad7f27bb6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.854277 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02debe1f-3617-4bfb-820a-02fad7f27bb6 admin admin] RBAC: Adding query filter params (role.id=22d670400c514449b9734ad179a36f82, scope.project.id=2fa811d3b72a44de83c79fec2b3d6685, user.id=25236dce65d64098adcd0b8966c6c2e1) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:06.854591 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02debe1f-3617-4bfb-820a-02fad7f27bb6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:06.856615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02debe1f-3617-4bfb-820a-02fad7f27bb6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:06.864098 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b393f-a7f3-4089-9166-764e6182baab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:06.864290 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 126/239] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:06 2021] GET /identity/v3/role_assignments?user.id=25236dce65d64098adcd0b8966c6c2e1&scope.project.id=2fa811d3b72a44de83c79fec2b3d6685&role.id=22d670400c514449b9734ad179a36f82 => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:06.864908 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b393f-a7f3-4089-9166-764e6182baab admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.865180 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b393f-a7f3-4089-9166-764e6182baab admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.865455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b393f-a7f3-4089-9166-764e6182baab admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.880327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b393f-a7f3-4089-9166-764e6182baab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:06.888081 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-f36b393f-a7f3-4089-9166-764e6182baab admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:52:06.889672 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 114/240] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:52:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:06.896752 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02debe1f-3617-4bfb-820a-02fad7f27bb6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:06.913053 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02debe1f-3617-4bfb-820a-02fad7f27bb6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:06.922764 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20011f69-5075-4826-b869-995257992b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:06.923466 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20011f69-5075-4826-b869-995257992b87 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.923755 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20011f69-5075-4826-b869-995257992b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.924037 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20011f69-5075-4826-b869-995257992b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.924795 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20011f69-5075-4826-b869-995257992b87 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:06.925102 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20011f69-5075-4826-b869-995257992b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:06.926698 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20011f69-5075-4826-b869-995257992b87 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:06.939491 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 127/241] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:06.947473 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b393f-a7f3-4089-9166-764e6182baab admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:06.965956 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b393f-a7f3-4089-9166-764e6182baab admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:06.975963 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db63ce2-172e-49e6-bb32-ca9125b68dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:06.976996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db63ce2-172e-49e6-bb32-ca9125b68dbf admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:06.977377 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db63ce2-172e-49e6-bb32-ca9125b68dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:06.977750 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db63ce2-172e-49e6-bb32-ca9125b68dbf admin admin] PATH_INFO: `/v3/users/2a89afdaf4304b8588d33fcfb779c592` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:06.984406 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db63ce2-172e-49e6-bb32-ca9125b68dbf admin admin] RBAC: Authorizing `identity:get_user(user_id=2a89afdaf4304b8588d33fcfb779c592)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:06.986426 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db63ce2-172e-49e6-bb32-ca9125b68dbf admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:06.988678 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 115/242] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:52:06 2021] GET /identity/v3/users/2a89afdaf4304b8588d33fcfb779c592 => generated 247 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:06.995140 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20011f69-5075-4826-b869-995257992b87 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:07.009302 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20011f69-5075-4826-b869-995257992b87 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:07.018841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfab24-6b46-4857-ad6c-dfb5642c4c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:07.019511 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfab24-6b46-4857-ad6c-dfb5642c4c43 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:07.019801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfab24-6b46-4857-ad6c-dfb5642c4c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:07.020080 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfab24-6b46-4857-ad6c-dfb5642c4c43 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:07.034202 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfab24-6b46-4857-ad6c-dfb5642c4c43 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:07.036079 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfab24-6b46-4857-ad6c-dfb5642c4c43 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:07.050763 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 128/243] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:07.057114 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db63ce2-172e-49e6-bb32-ca9125b68dbf admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:07.072775 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db63ce2-172e-49e6-bb32-ca9125b68dbf admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:07.083732 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5ede3-d0cb-448a-8bde-de4f23bc9436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:07.084738 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5ede3-d0cb-448a-8bde-de4f23bc9436 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:07.085119 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5ede3-d0cb-448a-8bde-de4f23bc9436 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:07.085483 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5ede3-d0cb-448a-8bde-de4f23bc9436 admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:07.088088 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5ede3-d0cb-448a-8bde-de4f23bc9436 admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa811d3b72a44de83c79fec2b3d6685)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:07.090240 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5ede3-d0cb-448a-8bde-de4f23bc9436 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:07.092363 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 116/244] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:07 2021] GET /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685 => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:07.099467 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfab24-6b46-4857-ad6c-dfb5642c4c43 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:07.112947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfab24-6b46-4857-ad6c-dfb5642c4c43 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:07.123679 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240dc35f-0870-4b91-ac91-017cef019c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:07.124355 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dc35f-0870-4b91-ac91-017cef019c0e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:07.124819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dc35f-0870-4b91-ac91-017cef019c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:07.125105 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dc35f-0870-4b91-ac91-017cef019c0e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:07.125949 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240dc35f-0870-4b91-ac91-017cef019c0e admin admin] RBAC: Adding query filter params (role.id=99835eeda2f64af5bc9173a8370d4568, scope.project.id=2fa811d3b72a44de83c79fec2b3d6685, user.id=2a89afdaf4304b8588d33fcfb779c592) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:07.126261 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240dc35f-0870-4b91-ac91-017cef019c0e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:07.128191 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240dc35f-0870-4b91-ac91-017cef019c0e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:07.138482 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 129/245] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:07 2021] GET /identity/v3/role_assignments?user.id=2a89afdaf4304b8588d33fcfb779c592&scope.project.id=2fa811d3b72a44de83c79fec2b3d6685&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:07.902499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac642f0-6395-4325-b828-351176d362c7 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:07.903178 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac642f0-6395-4325-b828-351176d362c7 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:07.903178 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac642f0-6395-4325-b828-351176d362c7 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:07.904979 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 117/246] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:07.911992 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4f319-c5b6-441a-9b33-8ed6afc0f8bb None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:07.912549 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4f319-c5b6-441a-9b33-8ed6afc0f8bb None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:07.912549 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4f319-c5b6-441a-9b33-8ed6afc0f8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:07.935080 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-9db4f319-c5b6-441a-9b33-8ed6afc0f8bb None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:07.936289 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-9db4f319-c5b6-441a-9b33-8ed6afc0f8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:07.950648 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 130/247] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:07.991710 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac642f0-6395-4325-b828-351176d362c7 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:08.004405 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac642f0-6395-4325-b828-351176d362c7 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:08.008867 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011d61e-afea-4baa-85c1-9deb94851ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:08.009658 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011d61e-afea-4baa-85c1-9deb94851ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:08.009934 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011d61e-afea-4baa-85c1-9deb94851ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:08.010204 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011d61e-afea-4baa-85c1-9deb94851ef7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:08.021728 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011d61e-afea-4baa-85c1-9deb94851ef7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:08.033128 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-e011d61e-afea-4baa-85c1-9deb94851ef7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 02:52:08.034618 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 118/248] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:07 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:08.041043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4f319-c5b6-441a-9b33-8ed6afc0f8bb None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:08.050629 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4f319-c5b6-441a-9b33-8ed6afc0f8bb None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:08.055207 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4482557-9639-4f97-adf5-74796eef88e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:08.055897 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4482557-9639-4f97-adf5-74796eef88e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:08.056177 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4482557-9639-4f97-adf5-74796eef88e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:08.056448 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4482557-9639-4f97-adf5-74796eef88e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:08.057197 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4482557-9639-4f97-adf5-74796eef88e6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:08.057499 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4482557-9639-4f97-adf5-74796eef88e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:08.059096 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4482557-9639-4f97-adf5-74796eef88e6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:08.070994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 131/249] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:08 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:08.077220 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011d61e-afea-4baa-85c1-9deb94851ef7 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:08.087133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011d61e-afea-4baa-85c1-9deb94851ef7 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:08.096293 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0403116-b4a9-4e86-bbec-d13c3d7795d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:08.096943 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403116-b4a9-4e86-bbec-d13c3d7795d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:08.097221 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403116-b4a9-4e86-bbec-d13c3d7795d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:08.097497 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0403116-b4a9-4e86-bbec-d13c3d7795d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:08.121525 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0403116-b4a9-4e86-bbec-d13c3d7795d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:08.123303 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0403116-b4a9-4e86-bbec-d13c3d7795d8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:08.133141 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 119/250] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:08 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:08.139514 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4482557-9639-4f97-adf5-74796eef88e6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:08.149308 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4482557-9639-4f97-adf5-74796eef88e6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:08.160200 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1bf72-f476-4426-99cb-18a6b005cb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:08.160996 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1bf72-f476-4426-99cb-18a6b005cb7d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:08.161272 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1bf72-f476-4426-99cb-18a6b005cb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:08.161545 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1bf72-f476-4426-99cb-18a6b005cb7d admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:08.162745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1bf72-f476-4426-99cb-18a6b005cb7d admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:08.164841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1bf72-f476-4426-99cb-18a6b005cb7d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:08.166817 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 132/251] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:08 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:08.173717 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0403116-b4a9-4e86-bbec-d13c3d7795d8 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:08.182824 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0403116-b4a9-4e86-bbec-d13c3d7795d8 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:08.191031 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e5810-864e-4a73-82a8-a1cd91733760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:08.191904 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e5810-864e-4a73-82a8-a1cd91733760 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:08.192179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e5810-864e-4a73-82a8-a1cd91733760 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:08.192502 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e5810-864e-4a73-82a8-a1cd91733760 admin admin] PATH_INFO: `/v3/groups/8c77cb99e8a04c8283d7eec1c9183279` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:08.193613 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e5810-864e-4a73-82a8-a1cd91733760 admin admin] RBAC: Authorizing `identity:get_group(group_id=8c77cb99e8a04c8283d7eec1c9183279)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:08.194618 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-f37e5810-864e-4a73-82a8-a1cd91733760 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:08.194618 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 02:52:08.194618 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 02:52:08.195811 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e5810-864e-4a73-82a8-a1cd91733760 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:08.197701 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 120/252] 10.222.0.39 () {56 vars in 1202 bytes} [Tue Aug 31 02:52:08 2021] GET /identity/v3/groups/8c77cb99e8a04c8283d7eec1c9183279 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:08.204217 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1bf72-f476-4426-99cb-18a6b005cb7d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:08.213955 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1bf72-f476-4426-99cb-18a6b005cb7d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:08.222650 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd049e2c-c5c1-4c26-a66a-5b6bbe5c8565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:08.223301 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd049e2c-c5c1-4c26-a66a-5b6bbe5c8565 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:08.223617 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd049e2c-c5c1-4c26-a66a-5b6bbe5c8565 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:08.223891 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd049e2c-c5c1-4c26-a66a-5b6bbe5c8565 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:08.224710 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd049e2c-c5c1-4c26-a66a-5b6bbe5c8565 admin admin] RBAC: Adding query filter params (group.id=8c77cb99e8a04c8283d7eec1c9183279, role.id=22d670400c514449b9734ad179a36f82, scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:08.225015 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd049e2c-c5c1-4c26-a66a-5b6bbe5c8565 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:08.226835 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd049e2c-c5c1-4c26-a66a-5b6bbe5c8565 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:08.235970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 133/253] 10.222.0.39 () {56 vars in 1398 bytes} [Tue Aug 31 02:52:08 2021] GET /identity/v3/role_assignments?group.id=8c77cb99e8a04c8283d7eec1c9183279&scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51&role.id=22d670400c514449b9734ad179a36f82 => generated 260 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:08.538693 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0897e3-6c1e-460c-bdb7-787bcd768379 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:08.539073 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0897e3-6c1e-460c-bdb7-787bcd768379 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:08.539245 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0897e3-6c1e-460c-bdb7-787bcd768379 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:08.541055 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 121/254] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:08.547927 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ee9b3-d782-4d8a-8919-0b9ce88d4663 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:08.548214 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ee9b3-d782-4d8a-8919-0b9ce88d4663 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:08.548490 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ee9b3-d782-4d8a-8919-0b9ce88d4663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:08.569443 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-f26ee9b3-d782-4d8a-8919-0b9ce88d4663 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:08.570629 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f26ee9b3-d782-4d8a-8919-0b9ce88d4663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:08.580393 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 134/255] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:08.607619 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0897e3-6c1e-460c-bdb7-787bcd768379 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:08.620733 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0897e3-6c1e-460c-bdb7-787bcd768379 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:08.626288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724927ec-47ec-4099-a2d4-f33d885dda9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:08.627077 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724927ec-47ec-4099-a2d4-f33d885dda9b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:08.627350 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724927ec-47ec-4099-a2d4-f33d885dda9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:08.627641 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724927ec-47ec-4099-a2d4-f33d885dda9b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:08.644396 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724927ec-47ec-4099-a2d4-f33d885dda9b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:08.651197 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-724927ec-47ec-4099-a2d4-f33d885dda9b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 02:52:08.652722 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 122/256] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:08 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:08.659328 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ee9b3-d782-4d8a-8919-0b9ce88d4663 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:08.668283 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ee9b3-d782-4d8a-8919-0b9ce88d4663 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:08.675642 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb34c0-99d6-4caa-b216-f5264a7acb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:08.676307 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb34c0-99d6-4caa-b216-f5264a7acb99 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:08.676582 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb34c0-99d6-4caa-b216-f5264a7acb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:08.676855 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb34c0-99d6-4caa-b216-f5264a7acb99 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:08.677600 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb34c0-99d6-4caa-b216-f5264a7acb99 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:08.677899 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb34c0-99d6-4caa-b216-f5264a7acb99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:08.679513 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb34c0-99d6-4caa-b216-f5264a7acb99 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:08.690768 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 135/257] 10.222.0.39 () {56 vars in 1123 bytes} [Tue Aug 31 02:52:08 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:08.697874 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724927ec-47ec-4099-a2d4-f33d885dda9b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:08.708197 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724927ec-47ec-4099-a2d4-f33d885dda9b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:08.720026 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebbc1b-becb-428f-b522-45df64a611a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:08.720673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebbc1b-becb-428f-b522-45df64a611a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:08.720946 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebbc1b-becb-428f-b522-45df64a611a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:08.721218 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebbc1b-becb-428f-b522-45df64a611a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:08.851740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebbc1b-becb-428f-b522-45df64a611a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:08.853413 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebbc1b-becb-428f-b522-45df64a611a4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:08.863238 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 123/258] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:08 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:08.869238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb34c0-99d6-4caa-b216-f5264a7acb99 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:08.879810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb34c0-99d6-4caa-b216-f5264a7acb99 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:08.884270 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460839a-1898-416f-9ebb-932c87a1a594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:08.885115 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460839a-1898-416f-9ebb-932c87a1a594 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:08.885388 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460839a-1898-416f-9ebb-932c87a1a594 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:08.885659 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460839a-1898-416f-9ebb-932c87a1a594 admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:08.886828 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460839a-1898-416f-9ebb-932c87a1a594 admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa811d3b72a44de83c79fec2b3d6685)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:08.888902 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460839a-1898-416f-9ebb-932c87a1a594 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:08.891502 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 136/259] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:08 2021] GET /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:08.897363 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebbc1b-becb-428f-b522-45df64a611a4 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:08.906670 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebbc1b-becb-428f-b522-45df64a611a4 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:08.911021 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0564aeb-8a6c-43fa-8d60-78e6ad9e90a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:08.911941 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0564aeb-8a6c-43fa-8d60-78e6ad9e90a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:08.912214 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0564aeb-8a6c-43fa-8d60-78e6ad9e90a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:08.912484 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0564aeb-8a6c-43fa-8d60-78e6ad9e90a2 admin admin] PATH_INFO: `/v3/groups/8c77cb99e8a04c8283d7eec1c9183279` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:08.913674 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0564aeb-8a6c-43fa-8d60-78e6ad9e90a2 admin admin] RBAC: Authorizing `identity:get_group(group_id=8c77cb99e8a04c8283d7eec1c9183279)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:08.915587 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0564aeb-8a6c-43fa-8d60-78e6ad9e90a2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:08.917180 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 124/260] 10.222.0.39 () {56 vars in 1202 bytes} [Tue Aug 31 02:52:08 2021] GET /identity/v3/groups/8c77cb99e8a04c8283d7eec1c9183279 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:08.923636 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460839a-1898-416f-9ebb-932c87a1a594 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:08.933283 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460839a-1898-416f-9ebb-932c87a1a594 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:08.938710 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8230bd2-8d54-4f9a-b953-25c1c90e8138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:08.939358 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8230bd2-8d54-4f9a-b953-25c1c90e8138 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:08.939725 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8230bd2-8d54-4f9a-b953-25c1c90e8138 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:08.939996 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8230bd2-8d54-4f9a-b953-25c1c90e8138 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:08.940862 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8230bd2-8d54-4f9a-b953-25c1c90e8138 admin admin] RBAC: Adding query filter params (group.id=8c77cb99e8a04c8283d7eec1c9183279, role.id=fd3d7d578a52485f96ce76c2bbe1360d, scope.project.id=2fa811d3b72a44de83c79fec2b3d6685) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:08.941168 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8230bd2-8d54-4f9a-b953-25c1c90e8138 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:08.943103 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8230bd2-8d54-4f9a-b953-25c1c90e8138 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:08.949028 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 137/261] 10.222.0.39 () {56 vars in 1398 bytes} [Tue Aug 31 02:52:08 2021] GET /identity/v3/role_assignments?group.id=8c77cb99e8a04c8283d7eec1c9183279&scope.project.id=2fa811d3b72a44de83c79fec2b3d6685&role.id=fd3d7d578a52485f96ce76c2bbe1360d => generated 260 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:09.188878 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467fc63-7481-48d2-bf01-be410cc8c0c7 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:09.189223 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467fc63-7481-48d2-bf01-be410cc8c0c7 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:09.189411 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467fc63-7481-48d2-bf01-be410cc8c0c7 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:09.191462 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 125/262] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:09.197836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3751e2-b544-4e62-a6bc-7f10bf23cf20 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:09.198138 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3751e2-b544-4e62-a6bc-7f10bf23cf20 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:09.198381 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3751e2-b544-4e62-a6bc-7f10bf23cf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:09.223760 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-cb3751e2-b544-4e62-a6bc-7f10bf23cf20 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:09.224955 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-cb3751e2-b544-4e62-a6bc-7f10bf23cf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:09.235169 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 138/263] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:09.264275 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467fc63-7481-48d2-bf01-be410cc8c0c7 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:09.279678 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467fc63-7481-48d2-bf01-be410cc8c0c7 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:09.287029 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff47ff-d787-417f-aa79-c2e9349507d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:09.287912 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff47ff-d787-417f-aa79-c2e9349507d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:09.288189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff47ff-d787-417f-aa79-c2e9349507d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:09.288459 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff47ff-d787-417f-aa79-c2e9349507d8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:09.299782 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff47ff-d787-417f-aa79-c2e9349507d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:09.307045 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-c9ff47ff-d787-417f-aa79-c2e9349507d8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 02:52:09.308656 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 126/264] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:09 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:09.314950 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3751e2-b544-4e62-a6bc-7f10bf23cf20 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:09.324160 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3751e2-b544-4e62-a6bc-7f10bf23cf20 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:09.330179 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5dbc5-ef52-4cbe-b456-1773e8abe7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:09.330855 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5dbc5-ef52-4cbe-b456-1773e8abe7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:09.331131 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5dbc5-ef52-4cbe-b456-1773e8abe7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:09.331425 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5dbc5-ef52-4cbe-b456-1773e8abe7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:09.332170 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5dbc5-ef52-4cbe-b456-1773e8abe7c8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:09.332466 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5dbc5-ef52-4cbe-b456-1773e8abe7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:09.334101 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5dbc5-ef52-4cbe-b456-1773e8abe7c8 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:09.345736 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 139/265] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:09 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:09.352108 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff47ff-d787-417f-aa79-c2e9349507d8 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:09.362756 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff47ff-d787-417f-aa79-c2e9349507d8 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:09.372875 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a57f7-69dd-441b-bccb-f918782a94ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:09.373554 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a57f7-69dd-441b-bccb-f918782a94ac admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:09.373835 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a57f7-69dd-441b-bccb-f918782a94ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:09.374154 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a57f7-69dd-441b-bccb-f918782a94ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:09.383819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a57f7-69dd-441b-bccb-f918782a94ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:09.385615 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a57f7-69dd-441b-bccb-f918782a94ac admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:09.400460 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 127/266] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:09.406625 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5dbc5-ef52-4cbe-b456-1773e8abe7c8 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:09.416579 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5dbc5-ef52-4cbe-b456-1773e8abe7c8 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:09.424623 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3f09a-fba8-4e30-ab73-92580ac03d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:09.425589 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3f09a-fba8-4e30-ab73-92580ac03d07 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:09.425831 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3f09a-fba8-4e30-ab73-92580ac03d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:09.426120 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3f09a-fba8-4e30-ab73-92580ac03d07 admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:09.427387 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3f09a-fba8-4e30-ab73-92580ac03d07 admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa811d3b72a44de83c79fec2b3d6685)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:09.429518 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3f09a-fba8-4e30-ab73-92580ac03d07 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:09.431276 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 140/267] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:09 2021] GET /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:09.438352 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a57f7-69dd-441b-bccb-f918782a94ac admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:09.447723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a57f7-69dd-441b-bccb-f918782a94ac admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:09.455883 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab0a41-1d7d-436f-8716-8b6a7816ad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:09.456799 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab0a41-1d7d-436f-8716-8b6a7816ad20 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:09.457076 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab0a41-1d7d-436f-8716-8b6a7816ad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:09.457480 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab0a41-1d7d-436f-8716-8b6a7816ad20 admin admin] PATH_INFO: `/v3/groups/8c77cb99e8a04c8283d7eec1c9183279` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:09.459294 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab0a41-1d7d-436f-8716-8b6a7816ad20 admin admin] RBAC: Authorizing `identity:get_group(group_id=8c77cb99e8a04c8283d7eec1c9183279)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:09.461265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab0a41-1d7d-436f-8716-8b6a7816ad20 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:09.463305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 128/268] 10.222.0.39 () {56 vars in 1202 bytes} [Tue Aug 31 02:52:09 2021] GET /identity/v3/groups/8c77cb99e8a04c8283d7eec1c9183279 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:09.470144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3f09a-fba8-4e30-ab73-92580ac03d07 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:09.480353 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3f09a-fba8-4e30-ab73-92580ac03d07 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:09.488574 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79c9d2-e243-4d1c-8daf-7fbac737452a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:09.489283 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79c9d2-e243-4d1c-8daf-7fbac737452a admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:09.489559 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79c9d2-e243-4d1c-8daf-7fbac737452a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:09.489826 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79c9d2-e243-4d1c-8daf-7fbac737452a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:09.490705 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79c9d2-e243-4d1c-8daf-7fbac737452a admin admin] RBAC: Adding query filter params (group.id=8c77cb99e8a04c8283d7eec1c9183279, role.id=22d670400c514449b9734ad179a36f82, scope.project.id=2fa811d3b72a44de83c79fec2b3d6685) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:09.491066 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79c9d2-e243-4d1c-8daf-7fbac737452a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:09.493115 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79c9d2-e243-4d1c-8daf-7fbac737452a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:09.504014 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 141/269] 10.222.0.39 () {56 vars in 1398 bytes} [Tue Aug 31 02:52:09 2021] GET /identity/v3/role_assignments?group.id=8c77cb99e8a04c8283d7eec1c9183279&scope.project.id=2fa811d3b72a44de83c79fec2b3d6685&role.id=22d670400c514449b9734ad179a36f82 => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:09.631026 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60339a1-fdf8-4c08-b2d8-9683780f5b7c None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:09.631327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60339a1-fdf8-4c08-b2d8-9683780f5b7c None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:09.631511 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60339a1-fdf8-4c08-b2d8-9683780f5b7c None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:09.633323 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 129/270] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:09.640016 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eeb25-f318-4256-bcc9-63e4961ba6c3 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:09.640837 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eeb25-f318-4256-bcc9-63e4961ba6c3 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:09.641109 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eeb25-f318-4256-bcc9-63e4961ba6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:09.664511 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-580eeb25-f318-4256-bcc9-63e4961ba6c3 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:09.665731 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-580eeb25-f318-4256-bcc9-63e4961ba6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:09.674538 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 142/271] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:09.709164 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60339a1-fdf8-4c08-b2d8-9683780f5b7c None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:09.724948 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60339a1-fdf8-4c08-b2d8-9683780f5b7c None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:09.732143 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a115f91-ae51-4855-961c-9358ad493e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:09.733221 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a115f91-ae51-4855-961c-9358ad493e5f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:09.733751 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a115f91-ae51-4855-961c-9358ad493e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:09.734824 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a115f91-ae51-4855-961c-9358ad493e5f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:09.748298 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a115f91-ae51-4855-961c-9358ad493e5f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:09.755763 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-5a115f91-ae51-4855-961c-9358ad493e5f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:52:09.757234 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 130/272] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:52:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:09.763528 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eeb25-f318-4256-bcc9-63e4961ba6c3 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:09.775450 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eeb25-f318-4256-bcc9-63e4961ba6c3 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:09.782154 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a95d47-a4c1-43ca-887b-72e5602bb3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:09.782817 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a95d47-a4c1-43ca-887b-72e5602bb3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:09.783091 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a95d47-a4c1-43ca-887b-72e5602bb3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:09.783381 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a95d47-a4c1-43ca-887b-72e5602bb3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:09.784144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a95d47-a4c1-43ca-887b-72e5602bb3d6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:09.784444 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a95d47-a4c1-43ca-887b-72e5602bb3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:09.786013 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a95d47-a4c1-43ca-887b-72e5602bb3d6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:09.797903 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 143/273] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:09.803604 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a115f91-ae51-4855-961c-9358ad493e5f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:09.815831 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a115f91-ae51-4855-961c-9358ad493e5f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:09.822621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9f2ac-f3f7-4998-8762-7b7a8debe894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:09.823549 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9f2ac-f3f7-4998-8762-7b7a8debe894 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:09.823973 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9f2ac-f3f7-4998-8762-7b7a8debe894 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:09.824388 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9f2ac-f3f7-4998-8762-7b7a8debe894 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:09.839068 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9f2ac-f3f7-4998-8762-7b7a8debe894 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:09.841111 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9f2ac-f3f7-4998-8762-7b7a8debe894 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:09.853000 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 131/274] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:09.859745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a95d47-a4c1-43ca-887b-72e5602bb3d6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:09.873432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a95d47-a4c1-43ca-887b-72e5602bb3d6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:09.881210 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf12b2-7d01-4bca-97bd-b31b9e8c706f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:09.882162 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf12b2-7d01-4bca-97bd-b31b9e8c706f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:09.882651 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf12b2-7d01-4bca-97bd-b31b9e8c706f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:09.883040 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf12b2-7d01-4bca-97bd-b31b9e8c706f admin admin] PATH_INFO: `/v3/projects/8eb33f1e09d7463d8975fc4c37c2e87b` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:09.888180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf12b2-7d01-4bca-97bd-b31b9e8c706f admin admin] RBAC: Authorizing `identity:get_project(project_id=8eb33f1e09d7463d8975fc4c37c2e87b)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:09.890814 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf12b2-7d01-4bca-97bd-b31b9e8c706f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:09.892934 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 144/275] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:09 2021] GET /identity/v3/projects/8eb33f1e09d7463d8975fc4c37c2e87b => generated 344 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:09.898944 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9f2ac-f3f7-4998-8762-7b7a8debe894 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:09.913682 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9f2ac-f3f7-4998-8762-7b7a8debe894 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:09.919689 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42357f4e-9514-48a8-9e4e-4c4b6a376751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:09.920737 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357f4e-9514-48a8-9e4e-4c4b6a376751 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:09.921160 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357f4e-9514-48a8-9e4e-4c4b6a376751 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:09.922108 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42357f4e-9514-48a8-9e4e-4c4b6a376751 admin admin] PATH_INFO: `/v3/groups/b4489c38eb204e299667023bc5d99912` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:09.933654 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42357f4e-9514-48a8-9e4e-4c4b6a376751 admin admin] RBAC: Authorizing `identity:get_group(group_id=b4489c38eb204e299667023bc5d99912)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:09.935819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42357f4e-9514-48a8-9e4e-4c4b6a376751 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:09.937873 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 132/276] 10.222.0.39 () {56 vars in 1202 bytes} [Tue Aug 31 02:52:09 2021] GET /identity/v3/groups/b4489c38eb204e299667023bc5d99912 => generated 229 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:09.944718 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf12b2-7d01-4bca-97bd-b31b9e8c706f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:09.956792 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf12b2-7d01-4bca-97bd-b31b9e8c706f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:09.967827 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ac102-bd91-4c19-9e2a-d308ef0ccb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:09.969530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ac102-bd91-4c19-9e2a-d308ef0ccb66 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:09.969961 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ac102-bd91-4c19-9e2a-d308ef0ccb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:09.970380 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ac102-bd91-4c19-9e2a-d308ef0ccb66 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:09.971403 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ac102-bd91-4c19-9e2a-d308ef0ccb66 admin admin] RBAC: Adding query filter params (group.id=b4489c38eb204e299667023bc5d99912, role.id=99835eeda2f64af5bc9173a8370d4568, scope.project.id=8eb33f1e09d7463d8975fc4c37c2e87b) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:09.971865 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ac102-bd91-4c19-9e2a-d308ef0ccb66 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:09.973937 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ac102-bd91-4c19-9e2a-d308ef0ccb66 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:09.980506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 145/277] 10.222.0.39 () {56 vars in 1398 bytes} [Tue Aug 31 02:52:09 2021] GET /identity/v3/role_assignments?group.id=b4489c38eb204e299667023bc5d99912&scope.project.id=8eb33f1e09d7463d8975fc4c37c2e87b&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:10.041094 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3209eb6-0b59-42da-a77b-6f9b53ec8ac8 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:10.041610 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3209eb6-0b59-42da-a77b-6f9b53ec8ac8 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:10.042032 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3209eb6-0b59-42da-a77b-6f9b53ec8ac8 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:10.044001 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 133/278] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:10.051000 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b2ece-add9-4909-8dbb-0a58743e3278 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:10.051290 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b2ece-add9-4909-8dbb-0a58743e3278 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:10.051603 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b2ece-add9-4909-8dbb-0a58743e3278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:10.074563 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-7c3b2ece-add9-4909-8dbb-0a58743e3278 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:10.076903 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-7c3b2ece-add9-4909-8dbb-0a58743e3278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:10.091321 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 146/279] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:10.141623 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3209eb6-0b59-42da-a77b-6f9b53ec8ac8 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:10.156260 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3209eb6-0b59-42da-a77b-6f9b53ec8ac8 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:10.161419 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9135f65-db9f-4b10-913a-bae90a0ba006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:10.162581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9135f65-db9f-4b10-913a-bae90a0ba006 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:10.163108 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9135f65-db9f-4b10-913a-bae90a0ba006 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:10.163621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9135f65-db9f-4b10-913a-bae90a0ba006 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:10.181836 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9135f65-db9f-4b10-913a-bae90a0ba006 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:10.189833 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-b9135f65-db9f-4b10-913a-bae90a0ba006 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 02:52:10.191478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 134/280] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:10.198314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b2ece-add9-4909-8dbb-0a58743e3278 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:10.208957 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b2ece-add9-4909-8dbb-0a58743e3278 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:10.219891 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418d429-01d2-4fb8-9570-b917c82f0088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:10.220938 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418d429-01d2-4fb8-9570-b917c82f0088 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:10.221468 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418d429-01d2-4fb8-9570-b917c82f0088 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:10.221939 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418d429-01d2-4fb8-9570-b917c82f0088 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:10.222939 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418d429-01d2-4fb8-9570-b917c82f0088 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:10.223463 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418d429-01d2-4fb8-9570-b917c82f0088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:10.225400 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418d429-01d2-4fb8-9570-b917c82f0088 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:10.235027 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 147/281] 10.222.0.39 () {56 vars in 1123 bytes} [Tue Aug 31 02:52:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:10.241444 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9135f65-db9f-4b10-913a-bae90a0ba006 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:10.254079 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9135f65-db9f-4b10-913a-bae90a0ba006 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:10.259857 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9567e-0e30-4492-ad20-ea98370e7819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:10.261013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9567e-0e30-4492-ad20-ea98370e7819 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:10.261496 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9567e-0e30-4492-ad20-ea98370e7819 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:10.262002 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9567e-0e30-4492-ad20-ea98370e7819 admin admin] PATH_INFO: `/v3/groups/8c77cb99e8a04c8283d7eec1c9183279` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:10.263460 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9567e-0e30-4492-ad20-ea98370e7819 admin admin] RBAC: Authorizing `identity:get_group(group_id=8c77cb99e8a04c8283d7eec1c9183279)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:10.266476 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9567e-0e30-4492-ad20-ea98370e7819 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:10.268376 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 135/282] 10.222.0.39 () {56 vars in 1202 bytes} [Tue Aug 31 02:52:10 2021] GET /identity/v3/groups/8c77cb99e8a04c8283d7eec1c9183279 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:10.275195 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418d429-01d2-4fb8-9570-b917c82f0088 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:10.286005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418d429-01d2-4fb8-9570-b917c82f0088 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:10.291786 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae007b9-2f09-4ba4-9c71-61e1ecca5e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:10.292915 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae007b9-2f09-4ba4-9c71-61e1ecca5e7f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:10.293454 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae007b9-2f09-4ba4-9c71-61e1ecca5e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:10.293943 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae007b9-2f09-4ba4-9c71-61e1ecca5e7f admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:10.297920 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae007b9-2f09-4ba4-9c71-61e1ecca5e7f admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:10.300299 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae007b9-2f09-4ba4-9c71-61e1ecca5e7f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:10.302683 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 148/283] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:10 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:10.308765 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9567e-0e30-4492-ad20-ea98370e7819 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:10.319574 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9567e-0e30-4492-ad20-ea98370e7819 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:10.332899 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3f1f2-ab78-484b-b9d0-bb45d71e911d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:10.333782 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3f1f2-ab78-484b-b9d0-bb45d71e911d admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:10.334062 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3f1f2-ab78-484b-b9d0-bb45d71e911d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:10.334333 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3f1f2-ab78-484b-b9d0-bb45d71e911d admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51/groups/8c77cb99e8a04c8283d7eec1c9183279/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:10.340633 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3f1f2-ab78-484b-b9d0-bb45d71e911d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac5876eff2e49d3bc4acac0831e9a51, group_id=8c77cb99e8a04c8283d7eec1c9183279, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:10.343287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3f1f2-ab78-484b-b9d0-bb45d71e911d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:10.360159 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 136/284] 10.222.0.39 () {58 vars in 1464 bytes} [Tue Aug 31 02:52:10 2021] PUT /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51/groups/8c77cb99e8a04c8283d7eec1c9183279/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:52:11.239563 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac14539-2efa-4068-b55c-0a9f096d4bc9 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:11.240560 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac14539-2efa-4068-b55c-0a9f096d4bc9 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:11.241045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac14539-2efa-4068-b55c-0a9f096d4bc9 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:11.243046 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 149/285] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:11.249579 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68dd81c-b4b4-43f5-a330-296a98279fa4 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:11.250045 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68dd81c-b4b4-43f5-a330-296a98279fa4 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:11.250129 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68dd81c-b4b4-43f5-a330-296a98279fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:11.276367 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-f68dd81c-b4b4-43f5-a330-296a98279fa4 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:11.277553 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f68dd81c-b4b4-43f5-a330-296a98279fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:11.345531 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 137/286] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:11.387624 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac14539-2efa-4068-b55c-0a9f096d4bc9 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:11.404401 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac14539-2efa-4068-b55c-0a9f096d4bc9 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:11.415005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bff1a-0cfc-4a48-a119-5b0c372b4aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:11.416185 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bff1a-0cfc-4a48-a119-5b0c372b4aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:11.416685 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bff1a-0cfc-4a48-a119-5b0c372b4aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:11.417176 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bff1a-0cfc-4a48-a119-5b0c372b4aa0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:11.429242 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bff1a-0cfc-4a48-a119-5b0c372b4aa0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:11.436745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-729bff1a-0cfc-4a48-a119-5b0c372b4aa0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 02:52:11.443398 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 150/287] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:11 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:11.446011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68dd81c-b4b4-43f5-a330-296a98279fa4 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:11.460234 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68dd81c-b4b4-43f5-a330-296a98279fa4 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:11.472608 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eab03-60b7-4da9-9857-087553c0617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:11.473329 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eab03-60b7-4da9-9857-087553c0617b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:11.473668 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eab03-60b7-4da9-9857-087553c0617b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:11.473945 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eab03-60b7-4da9-9857-087553c0617b admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:11.474702 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eab03-60b7-4da9-9857-087553c0617b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:11.475004 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eab03-60b7-4da9-9857-087553c0617b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:11.476706 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eab03-60b7-4da9-9857-087553c0617b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:11.487015 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 138/288] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:11.493052 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bff1a-0cfc-4a48-a119-5b0c372b4aa0 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:11.504637 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bff1a-0cfc-4a48-a119-5b0c372b4aa0 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:11.515065 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0802162-b7db-4e98-8290-16864ba1219c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:11.516429 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0802162-b7db-4e98-8290-16864ba1219c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:11.516926 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0802162-b7db-4e98-8290-16864ba1219c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:11.517407 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0802162-b7db-4e98-8290-16864ba1219c admin admin] PATH_INFO: `/v3/groups/8c77cb99e8a04c8283d7eec1c9183279` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:11.518813 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0802162-b7db-4e98-8290-16864ba1219c admin admin] RBAC: Authorizing `identity:get_group(group_id=8c77cb99e8a04c8283d7eec1c9183279)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:11.520947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0802162-b7db-4e98-8290-16864ba1219c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:11.522760 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 151/289] 10.222.0.39 () {56 vars in 1202 bytes} [Tue Aug 31 02:52:11 2021] GET /identity/v3/groups/8c77cb99e8a04c8283d7eec1c9183279 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:11.529148 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eab03-60b7-4da9-9857-087553c0617b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:11.539278 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eab03-60b7-4da9-9857-087553c0617b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:11.548191 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192664f-4ea0-47b8-a60d-d567286c4a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:11.549049 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192664f-4ea0-47b8-a60d-d567286c4a0c admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:11.549380 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192664f-4ea0-47b8-a60d-d567286c4a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:11.549653 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192664f-4ea0-47b8-a60d-d567286c4a0c admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:11.556151 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192664f-4ea0-47b8-a60d-d567286c4a0c admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:11.558354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192664f-4ea0-47b8-a60d-d567286c4a0c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:11.560444 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 139/290] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:11 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:11.567182 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0802162-b7db-4e98-8290-16864ba1219c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:11.577271 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0802162-b7db-4e98-8290-16864ba1219c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:11.587047 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00124432-886a-42f0-829d-c91de0b9b8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:11.588876 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00124432-886a-42f0-829d-c91de0b9b8be admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:11.589745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00124432-886a-42f0-829d-c91de0b9b8be admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:11.590414 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00124432-886a-42f0-829d-c91de0b9b8be admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51/groups/8c77cb99e8a04c8283d7eec1c9183279/roles/22d670400c514449b9734ad179a36f82` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:11.593048 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00124432-886a-42f0-829d-c91de0b9b8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac5876eff2e49d3bc4acac0831e9a51, group_id=8c77cb99e8a04c8283d7eec1c9183279, role_id=22d670400c514449b9734ad179a36f82)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:11.595965 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00124432-886a-42f0-829d-c91de0b9b8be admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:11.616347 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 152/291] 10.222.0.39 () {58 vars in 1464 bytes} [Tue Aug 31 02:52:11 2021] PUT /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51/groups/8c77cb99e8a04c8283d7eec1c9183279/roles/22d670400c514449b9734ad179a36f82 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:52:11.992978 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf7406-f28c-4a53-88a7-ab611ef1e2ca None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:11.993318 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf7406-f28c-4a53-88a7-ab611ef1e2ca None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:11.993531 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf7406-f28c-4a53-88a7-ab611ef1e2ca None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:11.995631 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 140/292] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:12.002137 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec29ed-fe52-4108-90bf-b6fee7491fba None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:12.002426 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec29ed-fe52-4108-90bf-b6fee7491fba None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:12.002704 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec29ed-fe52-4108-90bf-b6fee7491fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:12.021643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-66ec29ed-fe52-4108-90bf-b6fee7491fba None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:12.022824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-66ec29ed-fe52-4108-90bf-b6fee7491fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:12.083810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 153/293] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 31 02:52:12.111376 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf7406-f28c-4a53-88a7-ab611ef1e2ca None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:12.131344 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf7406-f28c-4a53-88a7-ab611ef1e2ca None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:12.135780 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ea439-3089-4769-9baf-c6d9abc7effe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:12.136565 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ea439-3089-4769-9baf-c6d9abc7effe admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:12.136842 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ea439-3089-4769-9baf-c6d9abc7effe admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:12.137110 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ea439-3089-4769-9baf-c6d9abc7effe admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:12.153590 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ea439-3089-4769-9baf-c6d9abc7effe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:12.161471 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-ec1ea439-3089-4769-9baf-c6d9abc7effe admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 02:52:12.162815 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 141/294] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:12 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:12.169375 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec29ed-fe52-4108-90bf-b6fee7491fba None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:12.179131 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec29ed-fe52-4108-90bf-b6fee7491fba None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:12.185857 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c621f-d2db-4367-83ed-101715a1003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:12.186539 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c621f-d2db-4367-83ed-101715a1003a admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:12.186917 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c621f-d2db-4367-83ed-101715a1003a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:12.187122 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c621f-d2db-4367-83ed-101715a1003a admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:12.187939 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c621f-d2db-4367-83ed-101715a1003a admin admin] RBAC: Adding query filter params (name=member) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:12.188242 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c621f-d2db-4367-83ed-101715a1003a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:12.189965 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c621f-d2db-4367-83ed-101715a1003a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:12.203033 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 154/295] 10.222.0.39 () {56 vars in 1123 bytes} [Tue Aug 31 02:52:12 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:12.209489 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ea439-3089-4769-9baf-c6d9abc7effe admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:12.221038 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ea439-3089-4769-9baf-c6d9abc7effe admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:12.231619 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516a047-bc70-4ca4-b5e8-834c0dfcc632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:12.232529 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516a047-bc70-4ca4-b5e8-834c0dfcc632 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:12.232810 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516a047-bc70-4ca4-b5e8-834c0dfcc632 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:12.233084 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516a047-bc70-4ca4-b5e8-834c0dfcc632 admin admin] PATH_INFO: `/v3/groups/8c77cb99e8a04c8283d7eec1c9183279` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:12.234541 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516a047-bc70-4ca4-b5e8-834c0dfcc632 admin admin] RBAC: Authorizing `identity:get_group(group_id=8c77cb99e8a04c8283d7eec1c9183279)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:12.236638 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516a047-bc70-4ca4-b5e8-834c0dfcc632 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:12.238588 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 142/296] 10.222.0.39 () {56 vars in 1202 bytes} [Tue Aug 31 02:52:12 2021] GET /identity/v3/groups/8c77cb99e8a04c8283d7eec1c9183279 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:12.244677 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c621f-d2db-4367-83ed-101715a1003a admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:12.255526 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c621f-d2db-4367-83ed-101715a1003a admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:12.260588 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c33b0-6182-43bc-b8fc-3ef995f4e00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:12.261469 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c33b0-6182-43bc-b8fc-3ef995f4e00c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:12.261758 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c33b0-6182-43bc-b8fc-3ef995f4e00c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:12.262071 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c33b0-6182-43bc-b8fc-3ef995f4e00c admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:12.264250 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c33b0-6182-43bc-b8fc-3ef995f4e00c admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa811d3b72a44de83c79fec2b3d6685)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:12.266984 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c33b0-6182-43bc-b8fc-3ef995f4e00c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:12.268748 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 155/297] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:12 2021] GET /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:12.275201 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516a047-bc70-4ca4-b5e8-834c0dfcc632 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:12.276867 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447a97d-7870-41ba-a0a6-ed1a6893d621 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:12.277159 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447a97d-7870-41ba-a0a6-ed1a6893d621 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:12.277439 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447a97d-7870-41ba-a0a6-ed1a6893d621 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:12.279336 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 156/298] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:12.289534 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516a047-bc70-4ca4-b5e8-834c0dfcc632 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:12.293636 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f44fee-baca-4a9c-bda4-568c3109c877 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:12.293926 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f44fee-baca-4a9c-bda4-568c3109c877 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:12.294210 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f44fee-baca-4a9c-bda4-568c3109c877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:12.296992 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08814079-ee35-402e-84ea-508d198dccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:12.298173 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08814079-ee35-402e-84ea-508d198dccb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:12.298658 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08814079-ee35-402e-84ea-508d198dccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:12.299132 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08814079-ee35-402e-84ea-508d198dccb6 admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685/groups/8c77cb99e8a04c8283d7eec1c9183279/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:12.301321 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08814079-ee35-402e-84ea-508d198dccb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa811d3b72a44de83c79fec2b3d6685, group_id=8c77cb99e8a04c8283d7eec1c9183279, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:12.304414 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08814079-ee35-402e-84ea-508d198dccb6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:12.321216 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 143/299] 10.222.0.39 () {58 vars in 1464 bytes} [Tue Aug 31 02:52:12 2021] PUT /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685/groups/8c77cb99e8a04c8283d7eec1c9183279/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:52:12.325897 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-31f44fee-baca-4a9c-bda4-568c3109c877 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:12.327080 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-31f44fee-baca-4a9c-bda4-568c3109c877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:12.417388 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 157/300] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:12.454192 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08814079-ee35-402e-84ea-508d198dccb6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:12.469564 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08814079-ee35-402e-84ea-508d198dccb6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:12.477463 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7418a-8aa4-4423-9b46-9a3908df46c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:12.478641 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7418a-8aa4-4423-9b46-9a3908df46c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:12.479207 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7418a-8aa4-4423-9b46-9a3908df46c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:12.479705 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7418a-8aa4-4423-9b46-9a3908df46c8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:12.502589 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7418a-8aa4-4423-9b46-9a3908df46c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:12.510266 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-4db7418a-8aa4-4423-9b46-9a3908df46c8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 02:52:12.511718 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 144/301] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:12 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:12.518847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f44fee-baca-4a9c-bda4-568c3109c877 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:12.533650 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f44fee-baca-4a9c-bda4-568c3109c877 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:12.543808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d43cf2-d78b-444d-9088-9daf9651136f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:12.544494 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d43cf2-d78b-444d-9088-9daf9651136f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:12.544781 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d43cf2-d78b-444d-9088-9daf9651136f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:12.545061 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d43cf2-d78b-444d-9088-9daf9651136f admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:12.545831 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d43cf2-d78b-444d-9088-9daf9651136f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:12.546171 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d43cf2-d78b-444d-9088-9daf9651136f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:12.548062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d43cf2-d78b-444d-9088-9daf9651136f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:12.564382 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 158/302] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:12 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:12.570617 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7418a-8aa4-4423-9b46-9a3908df46c8 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:12.584585 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7418a-8aa4-4423-9b46-9a3908df46c8 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:12.592105 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92bbad-936c-4d7b-8eca-9733dae4b785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:12.593794 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92bbad-936c-4d7b-8eca-9733dae4b785 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:12.594302 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92bbad-936c-4d7b-8eca-9733dae4b785 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:12.594775 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92bbad-936c-4d7b-8eca-9733dae4b785 admin admin] PATH_INFO: `/v3/groups/8c77cb99e8a04c8283d7eec1c9183279` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:12.598261 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92bbad-936c-4d7b-8eca-9733dae4b785 admin admin] RBAC: Authorizing `identity:get_group(group_id=8c77cb99e8a04c8283d7eec1c9183279)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:12.600445 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92bbad-936c-4d7b-8eca-9733dae4b785 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:12.602410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 145/303] 10.222.0.39 () {56 vars in 1202 bytes} [Tue Aug 31 02:52:12 2021] GET /identity/v3/groups/8c77cb99e8a04c8283d7eec1c9183279 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:12.609364 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d43cf2-d78b-444d-9088-9daf9651136f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:12.625816 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d43cf2-d78b-444d-9088-9daf9651136f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:12.634728 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a842e-2266-4c9e-bede-127fb66ae33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:12.635667 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a842e-2266-4c9e-bede-127fb66ae33c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:12.635953 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a842e-2266-4c9e-bede-127fb66ae33c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:12.636227 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a842e-2266-4c9e-bede-127fb66ae33c admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:12.639249 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a842e-2266-4c9e-bede-127fb66ae33c admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa811d3b72a44de83c79fec2b3d6685)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:12.641566 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a842e-2266-4c9e-bede-127fb66ae33c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:12.643601 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 159/304] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:12 2021] GET /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:12.649475 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92bbad-936c-4d7b-8eca-9733dae4b785 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:12.662995 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92bbad-936c-4d7b-8eca-9733dae4b785 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:12.667665 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37be2a3-8270-4aa9-9756-8b070722a12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:12.668581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37be2a3-8270-4aa9-9756-8b070722a12f admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:12.668863 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37be2a3-8270-4aa9-9756-8b070722a12f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:12.669139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37be2a3-8270-4aa9-9756-8b070722a12f admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685/groups/8c77cb99e8a04c8283d7eec1c9183279/roles/22d670400c514449b9734ad179a36f82` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:12.672099 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37be2a3-8270-4aa9-9756-8b070722a12f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa811d3b72a44de83c79fec2b3d6685, group_id=8c77cb99e8a04c8283d7eec1c9183279, role_id=22d670400c514449b9734ad179a36f82)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:12.674937 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37be2a3-8270-4aa9-9756-8b070722a12f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:12.695085 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 146/305] 10.222.0.39 () {58 vars in 1464 bytes} [Tue Aug 31 02:52:12 2021] PUT /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685/groups/8c77cb99e8a04c8283d7eec1c9183279/roles/22d670400c514449b9734ad179a36f82 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:52:12.982183 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9159e-85aa-42d4-ae79-90adfed2e930 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:12.982849 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9159e-85aa-42d4-ae79-90adfed2e930 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:12.983339 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9159e-85aa-42d4-ae79-90adfed2e930 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:12.986300 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 160/306] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:12.992182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05821b05-45b0-406f-b75c-b863c77e87d6 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:12.992712 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05821b05-45b0-406f-b75c-b863c77e87d6 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:12.993189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05821b05-45b0-406f-b75c-b863c77e87d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:13.014985 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-05821b05-45b0-406f-b75c-b863c77e87d6 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:13.016652 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-05821b05-45b0-406f-b75c-b863c77e87d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:13.081458 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 147/307] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:13.122750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9159e-85aa-42d4-ae79-90adfed2e930 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:13.148619 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9159e-85aa-42d4-ae79-90adfed2e930 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:13.157522 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf5c00-2e5d-43d1-a683-91d8c8d43e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:13.158322 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf5c00-2e5d-43d1-a683-91d8c8d43e05 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:13.158603 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf5c00-2e5d-43d1-a683-91d8c8d43e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:13.158878 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf5c00-2e5d-43d1-a683-91d8c8d43e05 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:13.176732 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf5c00-2e5d-43d1-a683-91d8c8d43e05 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:13.183764 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-eabf5c00-2e5d-43d1-a683-91d8c8d43e05 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:52:13.190999 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 161/308] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:52:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:13.192598 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05821b05-45b0-406f-b75c-b863c77e87d6 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:13.206729 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05821b05-45b0-406f-b75c-b863c77e87d6 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:13.220386 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58303f1-9637-4e81-b474-cb20a26602fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:13.221818 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58303f1-9637-4e81-b474-cb20a26602fa admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:13.222556 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58303f1-9637-4e81-b474-cb20a26602fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:13.223272 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58303f1-9637-4e81-b474-cb20a26602fa admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:13.224719 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58303f1-9637-4e81-b474-cb20a26602fa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:13.225451 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58303f1-9637-4e81-b474-cb20a26602fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:13.228435 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58303f1-9637-4e81-b474-cb20a26602fa admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:13.244304 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 148/309] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:13.250681 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf5c00-2e5d-43d1-a683-91d8c8d43e05 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:13.265061 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf5c00-2e5d-43d1-a683-91d8c8d43e05 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:13.275304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaf6bd-1ae2-4a65-b2a4-eeef577c6f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:13.276174 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf6bd-1ae2-4a65-b2a4-eeef577c6f3e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:13.276456 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf6bd-1ae2-4a65-b2a4-eeef577c6f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:13.276732 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf6bd-1ae2-4a65-b2a4-eeef577c6f3e admin admin] PATH_INFO: `/v3/groups/b4489c38eb204e299667023bc5d99912` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:13.280404 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaf6bd-1ae2-4a65-b2a4-eeef577c6f3e admin admin] RBAC: Authorizing `identity:get_group(group_id=b4489c38eb204e299667023bc5d99912)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:13.286020 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaf6bd-1ae2-4a65-b2a4-eeef577c6f3e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:13.288093 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 162/310] 10.222.0.39 () {56 vars in 1202 bytes} [Tue Aug 31 02:52:13 2021] GET /identity/v3/groups/b4489c38eb204e299667023bc5d99912 => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:13.294316 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58303f1-9637-4e81-b474-cb20a26602fa admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:13.309260 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58303f1-9637-4e81-b474-cb20a26602fa admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:13.317388 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc1251-339b-449b-9731-38631efe214e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:13.318528 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc1251-339b-449b-9731-38631efe214e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:13.319037 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc1251-339b-449b-9731-38631efe214e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:13.319604 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc1251-339b-449b-9731-38631efe214e admin admin] PATH_INFO: `/v3/projects/8eb33f1e09d7463d8975fc4c37c2e87b` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:13.321943 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc1251-339b-449b-9731-38631efe214e admin admin] RBAC: Authorizing `identity:get_project(project_id=8eb33f1e09d7463d8975fc4c37c2e87b)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:13.324085 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc1251-339b-449b-9731-38631efe214e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:13.326352 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 149/311] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:13 2021] GET /identity/v3/projects/8eb33f1e09d7463d8975fc4c37c2e87b => generated 344 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:13.332552 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaf6bd-1ae2-4a65-b2a4-eeef577c6f3e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:13.348440 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaf6bd-1ae2-4a65-b2a4-eeef577c6f3e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:13.360010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591b949-b622-4e72-99d5-862abaee3c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:13.360890 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591b949-b622-4e72-99d5-862abaee3c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:13.361172 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591b949-b622-4e72-99d5-862abaee3c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:13.361446 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591b949-b622-4e72-99d5-862abaee3c28 admin admin] PATH_INFO: `/v3/projects/8eb33f1e09d7463d8975fc4c37c2e87b/groups/b4489c38eb204e299667023bc5d99912/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:13.363469 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591b949-b622-4e72-99d5-862abaee3c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eb33f1e09d7463d8975fc4c37c2e87b, group_id=b4489c38eb204e299667023bc5d99912, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:13.366099 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591b949-b622-4e72-99d5-862abaee3c28 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:13.382525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 163/312] 10.222.0.39 () {58 vars in 1464 bytes} [Tue Aug 31 02:52:13 2021] PUT /identity/v3/projects/8eb33f1e09d7463d8975fc4c37c2e87b/groups/b4489c38eb204e299667023bc5d99912/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:52:13.531874 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5bb70-bbd7-4797-b10a-472a71e338df None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:13.532869 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5bb70-bbd7-4797-b10a-472a71e338df None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:13.533388 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5bb70-bbd7-4797-b10a-472a71e338df None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:13.535909 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 150/313] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:13 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:13.544255 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3ee7b-b2b9-40d4-979a-6753895b23c6 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:13.544551 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3ee7b-b2b9-40d4-979a-6753895b23c6 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:13.544808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3ee7b-b2b9-40d4-979a-6753895b23c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:13.568393 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-18d3ee7b-b2b9-40d4-979a-6753895b23c6 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:13.569598 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-18d3ee7b-b2b9-40d4-979a-6753895b23c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:13.647303 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 164/314] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:13.673404 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5bb70-bbd7-4797-b10a-472a71e338df None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:13.686031 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5bb70-bbd7-4797-b10a-472a71e338df None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:13.693318 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eabca3-d474-4c6d-a2d9-8b544336c65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:13.694217 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eabca3-d474-4c6d-a2d9-8b544336c65b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:13.694504 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eabca3-d474-4c6d-a2d9-8b544336c65b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:13.694783 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eabca3-d474-4c6d-a2d9-8b544336c65b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:13.708079 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eabca3-d474-4c6d-a2d9-8b544336c65b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:13.715337 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-37eabca3-d474-4c6d-a2d9-8b544336c65b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 02:52:13.719047 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 151/315] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:13 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:13.724428 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3ee7b-b2b9-40d4-979a-6753895b23c6 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:13.736311 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3ee7b-b2b9-40d4-979a-6753895b23c6 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:13.740995 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498666c-7199-44bb-86f5-1eb8a96f436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:13.741721 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498666c-7199-44bb-86f5-1eb8a96f436c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:13.742003 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498666c-7199-44bb-86f5-1eb8a96f436c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:13.742324 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498666c-7199-44bb-86f5-1eb8a96f436c admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:13.743084 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498666c-7199-44bb-86f5-1eb8a96f436c admin admin] RBAC: Adding query filter params (name=member) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:13.743402 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498666c-7199-44bb-86f5-1eb8a96f436c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:13.745092 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498666c-7199-44bb-86f5-1eb8a96f436c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:13.757358 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 165/316] 10.222.0.39 () {56 vars in 1123 bytes} [Tue Aug 31 02:52:13 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:13.763567 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eabca3-d474-4c6d-a2d9-8b544336c65b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:13.775798 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eabca3-d474-4c6d-a2d9-8b544336c65b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:13.782141 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f24bc-40f7-4860-9cbf-edfb07567881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:13.782779 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f24bc-40f7-4860-9cbf-edfb07567881 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:13.783112 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f24bc-40f7-4860-9cbf-edfb07567881 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:13.783410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f24bc-40f7-4860-9cbf-edfb07567881 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:13.792170 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f24bc-40f7-4860-9cbf-edfb07567881 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:13.793977 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f24bc-40f7-4860-9cbf-edfb07567881 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:13.804368 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 152/317] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:13.810895 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498666c-7199-44bb-86f5-1eb8a96f436c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:13.820965 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498666c-7199-44bb-86f5-1eb8a96f436c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:13.825776 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7635626-351c-40da-80c9-367949c15cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:13.826682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7635626-351c-40da-80c9-367949c15cda admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:13.826966 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7635626-351c-40da-80c9-367949c15cda admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:13.827237 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7635626-351c-40da-80c9-367949c15cda admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:13.829095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7635626-351c-40da-80c9-367949c15cda admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:13.831315 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7635626-351c-40da-80c9-367949c15cda admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:13.834368 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 166/318] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:13 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:13.839590 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f24bc-40f7-4860-9cbf-edfb07567881 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:13.850201 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f24bc-40f7-4860-9cbf-edfb07567881 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:13.856139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddff74a-a5ad-4e36-94a9-df82be7dfcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:13.857091 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddff74a-a5ad-4e36-94a9-df82be7dfcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:13.857371 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddff74a-a5ad-4e36-94a9-df82be7dfcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:13.857638 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddff74a-a5ad-4e36-94a9-df82be7dfcc7 admin admin] PATH_INFO: `/v3/groups/8c77cb99e8a04c8283d7eec1c9183279` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:13.858928 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddff74a-a5ad-4e36-94a9-df82be7dfcc7 admin admin] RBAC: Authorizing `identity:get_group(group_id=8c77cb99e8a04c8283d7eec1c9183279)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:13.860995 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddff74a-a5ad-4e36-94a9-df82be7dfcc7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:13.862819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 153/319] 10.222.0.39 () {56 vars in 1202 bytes} [Tue Aug 31 02:52:13 2021] GET /identity/v3/groups/8c77cb99e8a04c8283d7eec1c9183279 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:13.869281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7635626-351c-40da-80c9-367949c15cda admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:13.880047 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7635626-351c-40da-80c9-367949c15cda admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:13.884727 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5708a3-019e-4880-9236-2fe7347ae3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:13.885469 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5708a3-019e-4880-9236-2fe7347ae3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:13.885748 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5708a3-019e-4880-9236-2fe7347ae3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:13.886022 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5708a3-019e-4880-9236-2fe7347ae3d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:13.886886 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5708a3-019e-4880-9236-2fe7347ae3d1 admin admin] RBAC: Adding query filter params (group.id=8c77cb99e8a04c8283d7eec1c9183279, role.id=fd3d7d578a52485f96ce76c2bbe1360d, scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:13.887195 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5708a3-019e-4880-9236-2fe7347ae3d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:13.889248 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5708a3-019e-4880-9236-2fe7347ae3d1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:13.903578 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 167/320] 10.222.0.39 () {56 vars in 1398 bytes} [Tue Aug 31 02:52:13 2021] GET /identity/v3/role_assignments?group.id=8c77cb99e8a04c8283d7eec1c9183279&scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51&role.id=fd3d7d578a52485f96ce76c2bbe1360d => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:14.783802 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635ed50-196b-4baa-9b93-b64d6e76dd4d None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:14.784523 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635ed50-196b-4baa-9b93-b64d6e76dd4d None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:14.784523 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635ed50-196b-4baa-9b93-b64d6e76dd4d None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:14.786390 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 154/321] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:14.792649 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fb226-8b78-4c47-a876-a38c4d96aae7 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:14.793154 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fb226-8b78-4c47-a876-a38c4d96aae7 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:14.793320 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fb226-8b78-4c47-a876-a38c4d96aae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:14.811779 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-538fb226-8b78-4c47-a876-a38c4d96aae7 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:14.812977 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-538fb226-8b78-4c47-a876-a38c4d96aae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:14.821016 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 168/322] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:14.848517 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635ed50-196b-4baa-9b93-b64d6e76dd4d None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:14.862552 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635ed50-196b-4baa-9b93-b64d6e76dd4d None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:14.868835 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88f179-1bd2-45a9-96a6-852f4ce19996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:14.869648 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88f179-1bd2-45a9-96a6-852f4ce19996 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:14.869963 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88f179-1bd2-45a9-96a6-852f4ce19996 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:14.870199 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88f179-1bd2-45a9-96a6-852f4ce19996 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:14.885614 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88f179-1bd2-45a9-96a6-852f4ce19996 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:14.893331 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-3d88f179-1bd2-45a9-96a6-852f4ce19996 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 02:52:14.894600 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 155/323] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:14 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:14.901831 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fb226-8b78-4c47-a876-a38c4d96aae7 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:14.914607 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fb226-8b78-4c47-a876-a38c4d96aae7 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:14.921933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d2d03-869c-4fbd-83f8-43e3c942b68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:14.922615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d2d03-869c-4fbd-83f8-43e3c942b68b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:14.922953 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d2d03-869c-4fbd-83f8-43e3c942b68b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:14.923480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d2d03-869c-4fbd-83f8-43e3c942b68b admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:14.924864 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d2d03-869c-4fbd-83f8-43e3c942b68b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:14.925238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d2d03-869c-4fbd-83f8-43e3c942b68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:14.926850 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d2d03-869c-4fbd-83f8-43e3c942b68b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:14.938821 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 169/324] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:14 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:14.945023 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88f179-1bd2-45a9-96a6-852f4ce19996 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:14.958052 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88f179-1bd2-45a9-96a6-852f4ce19996 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:14.962826 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d943589-58aa-4db7-952e-b8c357af5e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:14.963698 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d943589-58aa-4db7-952e-b8c357af5e9f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:14.964189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d943589-58aa-4db7-952e-b8c357af5e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:14.964641 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d943589-58aa-4db7-952e-b8c357af5e9f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:14.978935 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d943589-58aa-4db7-952e-b8c357af5e9f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:14.981611 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d943589-58aa-4db7-952e-b8c357af5e9f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:14.991611 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 156/325] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:14.998159 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d2d03-869c-4fbd-83f8-43e3c942b68b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:15.010587 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d2d03-869c-4fbd-83f8-43e3c942b68b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:15.017859 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9800b-36d5-4c85-bf40-cde0a0a8a6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:15.018724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9800b-36d5-4c85-bf40-cde0a0a8a6ac admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.019057 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9800b-36d5-4c85-bf40-cde0a0a8a6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.019333 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9800b-36d5-4c85-bf40-cde0a0a8a6ac admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.020609 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9800b-36d5-4c85-bf40-cde0a0a8a6ac admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:15.022816 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9800b-36d5-4c85-bf40-cde0a0a8a6ac admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:15.024791 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 170/326] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:14 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:15.031147 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d943589-58aa-4db7-952e-b8c357af5e9f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:15.040369 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d943589-58aa-4db7-952e-b8c357af5e9f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:15.049070 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cde838-683e-46f4-843f-42e6ae53501c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:15.049934 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cde838-683e-46f4-843f-42e6ae53501c admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.050311 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cde838-683e-46f4-843f-42e6ae53501c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.050591 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cde838-683e-46f4-843f-42e6ae53501c admin admin] PATH_INFO: `/v3/groups/8c77cb99e8a04c8283d7eec1c9183279` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.051844 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cde838-683e-46f4-843f-42e6ae53501c admin admin] RBAC: Authorizing `identity:get_group(group_id=8c77cb99e8a04c8283d7eec1c9183279)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:15.053908 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cde838-683e-46f4-843f-42e6ae53501c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:15.055907 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 157/327] 10.222.0.39 () {56 vars in 1202 bytes} [Tue Aug 31 02:52:15 2021] GET /identity/v3/groups/8c77cb99e8a04c8283d7eec1c9183279 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:15.062592 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9800b-36d5-4c85-bf40-cde0a0a8a6ac admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:15.075260 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9800b-36d5-4c85-bf40-cde0a0a8a6ac admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:15.080977 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6cdca-d677-45fe-a8b8-4ec03f724aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:15.081686 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6cdca-d677-45fe-a8b8-4ec03f724aea admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.081970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6cdca-d677-45fe-a8b8-4ec03f724aea admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.082298 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6cdca-d677-45fe-a8b8-4ec03f724aea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.083144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6cdca-d677-45fe-a8b8-4ec03f724aea admin admin] RBAC: Adding query filter params (group.id=8c77cb99e8a04c8283d7eec1c9183279, role.id=22d670400c514449b9734ad179a36f82, scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:15.083482 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6cdca-d677-45fe-a8b8-4ec03f724aea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:15.085537 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6cdca-d677-45fe-a8b8-4ec03f724aea admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:15.097972 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 171/328] 10.222.0.39 () {56 vars in 1398 bytes} [Tue Aug 31 02:52:15 2021] GET /identity/v3/role_assignments?group.id=8c77cb99e8a04c8283d7eec1c9183279&scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51&role.id=22d670400c514449b9734ad179a36f82 => generated 611 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:15.185290 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6f40f-d53d-49b3-9823-712fba2457f0 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.185979 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6f40f-d53d-49b3-9823-712fba2457f0 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.186475 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6f40f-d53d-49b3-9823-712fba2457f0 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.188751 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 158/329] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:15.196288 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355fcfc-e2f9-42f2-83b5-4b3289b302f7 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.196934 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355fcfc-e2f9-42f2-83b5-4b3289b302f7 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.197509 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355fcfc-e2f9-42f2-83b5-4b3289b302f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.217845 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-e355fcfc-e2f9-42f2-83b5-4b3289b302f7 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:15.219524 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-e355fcfc-e2f9-42f2-83b5-4b3289b302f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:15.231508 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 172/330] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:15.254175 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6f40f-d53d-49b3-9823-712fba2457f0 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:15.268225 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6f40f-d53d-49b3-9823-712fba2457f0 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:15.273265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd002fa1-8765-494d-8e6f-7308b15d9ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:15.274478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd002fa1-8765-494d-8e6f-7308b15d9ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.275022 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd002fa1-8765-494d-8e6f-7308b15d9ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.275572 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd002fa1-8765-494d-8e6f-7308b15d9ee3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.290747 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd002fa1-8765-494d-8e6f-7308b15d9ee3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:15.298619 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-fd002fa1-8765-494d-8e6f-7308b15d9ee3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 02:52:15.300203 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 159/331] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:15 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:15.307141 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355fcfc-e2f9-42f2-83b5-4b3289b302f7 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:15.317156 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355fcfc-e2f9-42f2-83b5-4b3289b302f7 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:15.324773 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98260617-f100-46b7-9195-00259177fbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:15.325449 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98260617-f100-46b7-9195-00259177fbea admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.325734 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98260617-f100-46b7-9195-00259177fbea admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.326008 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98260617-f100-46b7-9195-00259177fbea admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.326762 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98260617-f100-46b7-9195-00259177fbea admin admin] RBAC: Adding query filter params (name=member) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:15.327071 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98260617-f100-46b7-9195-00259177fbea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:15.329677 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98260617-f100-46b7-9195-00259177fbea admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:15.341123 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 173/332] 10.222.0.39 () {56 vars in 1123 bytes} [Tue Aug 31 02:52:15 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:15.348361 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd002fa1-8765-494d-8e6f-7308b15d9ee3 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:15.358411 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd002fa1-8765-494d-8e6f-7308b15d9ee3 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:15.367086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095463e-bf39-4708-8b85-0644fd04fceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:15.368049 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095463e-bf39-4708-8b85-0644fd04fceb admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.368575 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095463e-bf39-4708-8b85-0644fd04fceb admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.369034 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095463e-bf39-4708-8b85-0644fd04fceb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.381476 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095463e-bf39-4708-8b85-0644fd04fceb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:15.382753 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095463e-bf39-4708-8b85-0644fd04fceb admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:15.395179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 160/333] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:15.402406 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98260617-f100-46b7-9195-00259177fbea admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:15.415303 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98260617-f100-46b7-9195-00259177fbea admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:15.420427 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de0416-16c4-4b58-8079-d0cfc58b5a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:15.422418 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de0416-16c4-4b58-8079-d0cfc58b5a91 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.422887 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de0416-16c4-4b58-8079-d0cfc58b5a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.423417 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de0416-16c4-4b58-8079-d0cfc58b5a91 admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.424853 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de0416-16c4-4b58-8079-d0cfc58b5a91 admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa811d3b72a44de83c79fec2b3d6685)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:15.427460 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de0416-16c4-4b58-8079-d0cfc58b5a91 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:15.434573 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 174/334] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:15 2021] GET /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:15.436238 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095463e-bf39-4708-8b85-0644fd04fceb admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:15.445485 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095463e-bf39-4708-8b85-0644fd04fceb admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:15.449976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132af3a4-a5cc-410c-a910-20ea90abe527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:15.450842 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132af3a4-a5cc-410c-a910-20ea90abe527 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.451112 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132af3a4-a5cc-410c-a910-20ea90abe527 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.451465 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132af3a4-a5cc-410c-a910-20ea90abe527 admin admin] PATH_INFO: `/v3/groups/8c77cb99e8a04c8283d7eec1c9183279` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.453395 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132af3a4-a5cc-410c-a910-20ea90abe527 admin admin] RBAC: Authorizing `identity:get_group(group_id=8c77cb99e8a04c8283d7eec1c9183279)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:15.455301 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132af3a4-a5cc-410c-a910-20ea90abe527 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:15.457250 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 161/335] 10.222.0.39 () {56 vars in 1202 bytes} [Tue Aug 31 02:52:15 2021] GET /identity/v3/groups/8c77cb99e8a04c8283d7eec1c9183279 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:15.464055 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de0416-16c4-4b58-8079-d0cfc58b5a91 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:15.472332 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef894d5-0a30-4ea7-92c6-e9b4176a6048 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.472619 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef894d5-0a30-4ea7-92c6-e9b4176a6048 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.472898 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef894d5-0a30-4ea7-92c6-e9b4176a6048 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.474656 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 162/336] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:52:15.476294 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de0416-16c4-4b58-8079-d0cfc58b5a91 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:15.480424 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d686f0-df0b-4fec-bb90-7468c1148b28 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.480695 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d686f0-df0b-4fec-bb90-7468c1148b28 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.480969 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d686f0-df0b-4fec-bb90-7468c1148b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.482071 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37bb7b-58fe-4d99-a53f-41f1490b688b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:15.483062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37bb7b-58fe-4d99-a53f-41f1490b688b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.483672 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37bb7b-58fe-4d99-a53f-41f1490b688b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.484413 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37bb7b-58fe-4d99-a53f-41f1490b688b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.485386 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37bb7b-58fe-4d99-a53f-41f1490b688b admin admin] RBAC: Adding query filter params (group.id=8c77cb99e8a04c8283d7eec1c9183279, role.id=fd3d7d578a52485f96ce76c2bbe1360d, scope.project.id=2fa811d3b72a44de83c79fec2b3d6685) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:15.485911 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37bb7b-58fe-4d99-a53f-41f1490b688b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:15.489081 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37bb7b-58fe-4d99-a53f-41f1490b688b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:15.500785 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 175/337] 10.222.0.39 () {56 vars in 1398 bytes} [Tue Aug 31 02:52:15 2021] GET /identity/v3/role_assignments?group.id=8c77cb99e8a04c8283d7eec1c9183279&scope.project.id=2fa811d3b72a44de83c79fec2b3d6685&role.id=fd3d7d578a52485f96ce76c2bbe1360d => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:15.502910 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-07d686f0-df0b-4fec-bb90-7468c1148b28 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:15.503589 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-07d686f0-df0b-4fec-bb90-7468c1148b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:15.516613 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 163/338] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:15.542145 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37bb7b-58fe-4d99-a53f-41f1490b688b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:15.553787 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37bb7b-58fe-4d99-a53f-41f1490b688b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:15.558892 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5425b-3171-4948-88f2-6c4f9b340766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:15.560088 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5425b-3171-4948-88f2-6c4f9b340766 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.560481 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5425b-3171-4948-88f2-6c4f9b340766 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.560865 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5425b-3171-4948-88f2-6c4f9b340766 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.575706 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5425b-3171-4948-88f2-6c4f9b340766 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:15.584561 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-3ca5425b-3171-4948-88f2-6c4f9b340766 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 02:52:15.586039 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 176/339] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:15 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:15.593380 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d686f0-df0b-4fec-bb90-7468c1148b28 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:15.603113 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d686f0-df0b-4fec-bb90-7468c1148b28 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:15.608003 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3aaa2-4fe8-44f6-9af0-71a006e5ea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:15.609012 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3aaa2-4fe8-44f6-9af0-71a006e5ea83 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.609374 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3aaa2-4fe8-44f6-9af0-71a006e5ea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.609750 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3aaa2-4fe8-44f6-9af0-71a006e5ea83 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.610643 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3aaa2-4fe8-44f6-9af0-71a006e5ea83 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:15.611072 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3aaa2-4fe8-44f6-9af0-71a006e5ea83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:15.612862 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3aaa2-4fe8-44f6-9af0-71a006e5ea83 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:15.622858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 164/340] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:15 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:15.629807 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5425b-3171-4948-88f2-6c4f9b340766 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:15.640909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5425b-3171-4948-88f2-6c4f9b340766 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:15.645648 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740c750-b295-443e-9ba7-e9a9b682aeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:15.646301 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740c750-b295-443e-9ba7-e9a9b682aeff admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.646583 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740c750-b295-443e-9ba7-e9a9b682aeff admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.646855 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740c750-b295-443e-9ba7-e9a9b682aeff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.655402 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740c750-b295-443e-9ba7-e9a9b682aeff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:15.657226 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740c750-b295-443e-9ba7-e9a9b682aeff admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:15.666804 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 177/341] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:15.673163 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3aaa2-4fe8-44f6-9af0-71a006e5ea83 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:15.683208 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3aaa2-4fe8-44f6-9af0-71a006e5ea83 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:15.688461 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36b032-ec5b-40df-bdbf-ae7c1d93bdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:15.689436 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36b032-ec5b-40df-bdbf-ae7c1d93bdbc admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.689816 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36b032-ec5b-40df-bdbf-ae7c1d93bdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.690211 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36b032-ec5b-40df-bdbf-ae7c1d93bdbc admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.691487 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36b032-ec5b-40df-bdbf-ae7c1d93bdbc admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa811d3b72a44de83c79fec2b3d6685)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:15.693544 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36b032-ec5b-40df-bdbf-ae7c1d93bdbc admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:15.695217 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 165/342] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:15 2021] GET /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:15.701357 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740c750-b295-443e-9ba7-e9a9b682aeff admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:15.711132 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740c750-b295-443e-9ba7-e9a9b682aeff admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:15.715853 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4626146-2035-4264-a5d9-7f57d3310cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:15.716691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4626146-2035-4264-a5d9-7f57d3310cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.716965 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4626146-2035-4264-a5d9-7f57d3310cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.717227 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4626146-2035-4264-a5d9-7f57d3310cc1 admin admin] PATH_INFO: `/v3/groups/8c77cb99e8a04c8283d7eec1c9183279` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.718444 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4626146-2035-4264-a5d9-7f57d3310cc1 admin admin] RBAC: Authorizing `identity:get_group(group_id=8c77cb99e8a04c8283d7eec1c9183279)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:15.720385 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4626146-2035-4264-a5d9-7f57d3310cc1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:15.722149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 178/343] 10.222.0.39 () {56 vars in 1202 bytes} [Tue Aug 31 02:52:15 2021] GET /identity/v3/groups/8c77cb99e8a04c8283d7eec1c9183279 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:15.728350 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36b032-ec5b-40df-bdbf-ae7c1d93bdbc admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:15.738355 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36b032-ec5b-40df-bdbf-ae7c1d93bdbc admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:15.742731 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf92e0-b1a7-472d-8d96-512a3f50b016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:15.743468 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf92e0-b1a7-472d-8d96-512a3f50b016 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:15.743810 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf92e0-b1a7-472d-8d96-512a3f50b016 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:15.744151 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf92e0-b1a7-472d-8d96-512a3f50b016 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:15.745037 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf92e0-b1a7-472d-8d96-512a3f50b016 admin admin] RBAC: Adding query filter params (group.id=8c77cb99e8a04c8283d7eec1c9183279, role.id=22d670400c514449b9734ad179a36f82, scope.project.id=2fa811d3b72a44de83c79fec2b3d6685) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:15.745416 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf92e0-b1a7-472d-8d96-512a3f50b016 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:15.747585 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf92e0-b1a7-472d-8d96-512a3f50b016 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:15.755651 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 166/344] 10.222.0.39 () {56 vars in 1398 bytes} [Tue Aug 31 02:52:15 2021] GET /identity/v3/role_assignments?group.id=8c77cb99e8a04c8283d7eec1c9183279&scope.project.id=2fa811d3b72a44de83c79fec2b3d6685&role.id=22d670400c514449b9734ad179a36f82 => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:16.112655 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1393d3-a27a-49d5-8b0f-a8e77a68101c None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:16.113160 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1393d3-a27a-49d5-8b0f-a8e77a68101c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:16.113270 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1393d3-a27a-49d5-8b0f-a8e77a68101c None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:16.114978 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 179/345] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:16.120978 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd994e-a3d9-4fe2-be2f-0948d3212304 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:16.121638 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd994e-a3d9-4fe2-be2f-0948d3212304 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:16.121783 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd994e-a3d9-4fe2-be2f-0948d3212304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:16.140557 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-4cfd994e-a3d9-4fe2-be2f-0948d3212304 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:16.141723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-4cfd994e-a3d9-4fe2-be2f-0948d3212304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:16.148873 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 167/346] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:16.173327 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1393d3-a27a-49d5-8b0f-a8e77a68101c None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:16.185055 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1393d3-a27a-49d5-8b0f-a8e77a68101c None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:16.189874 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaca4ff-31db-46b1-a3e1-1bed1b5b9483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:16.190639 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaca4ff-31db-46b1-a3e1-1bed1b5b9483 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:16.190924 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaca4ff-31db-46b1-a3e1-1bed1b5b9483 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:16.191202 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaca4ff-31db-46b1-a3e1-1bed1b5b9483 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:16.201171 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaca4ff-31db-46b1-a3e1-1bed1b5b9483 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:16.207982 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-caaca4ff-31db-46b1-a3e1-1bed1b5b9483 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:52:16.209112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 180/347] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:52:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:16.214998 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd994e-a3d9-4fe2-be2f-0948d3212304 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:16.224235 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd994e-a3d9-4fe2-be2f-0948d3212304 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:16.228425 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a564bcd-99a0-4b89-8c61-ea47f8ad633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:16.229059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a564bcd-99a0-4b89-8c61-ea47f8ad633a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:16.229339 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a564bcd-99a0-4b89-8c61-ea47f8ad633a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:16.229604 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a564bcd-99a0-4b89-8c61-ea47f8ad633a admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:16.230334 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a564bcd-99a0-4b89-8c61-ea47f8ad633a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:16.230656 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a564bcd-99a0-4b89-8c61-ea47f8ad633a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:16.232266 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a564bcd-99a0-4b89-8c61-ea47f8ad633a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:16.240713 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 168/348] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:16.246621 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaca4ff-31db-46b1-a3e1-1bed1b5b9483 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:16.256126 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaca4ff-31db-46b1-a3e1-1bed1b5b9483 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:16.260336 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ba946-4a28-48d2-a747-ed01704851ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:16.260943 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ba946-4a28-48d2-a747-ed01704851ff admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:16.261221 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ba946-4a28-48d2-a747-ed01704851ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:16.261488 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ba946-4a28-48d2-a747-ed01704851ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:16.269718 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ba946-4a28-48d2-a747-ed01704851ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:16.271443 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ba946-4a28-48d2-a747-ed01704851ff admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:16.279712 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 181/349] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:16 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:16.285961 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a564bcd-99a0-4b89-8c61-ea47f8ad633a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:16.297372 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a564bcd-99a0-4b89-8c61-ea47f8ad633a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:16.302148 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5af2c5-133a-45dc-b5d8-04d1dd63a539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:16.302989 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5af2c5-133a-45dc-b5d8-04d1dd63a539 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:16.303347 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5af2c5-133a-45dc-b5d8-04d1dd63a539 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:16.303786 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5af2c5-133a-45dc-b5d8-04d1dd63a539 admin admin] PATH_INFO: `/v3/projects/8eb33f1e09d7463d8975fc4c37c2e87b` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:16.305088 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5af2c5-133a-45dc-b5d8-04d1dd63a539 admin admin] RBAC: Authorizing `identity:get_project(project_id=8eb33f1e09d7463d8975fc4c37c2e87b)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:16.307711 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5af2c5-133a-45dc-b5d8-04d1dd63a539 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:16.309338 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 169/350] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:52:16 2021] GET /identity/v3/projects/8eb33f1e09d7463d8975fc4c37c2e87b => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:16.315768 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ba946-4a28-48d2-a747-ed01704851ff admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:16.324378 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ba946-4a28-48d2-a747-ed01704851ff admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:16.328974 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dab90-6bb5-4a9d-9a1c-2c35c4f80067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:16.329797 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dab90-6bb5-4a9d-9a1c-2c35c4f80067 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:16.330072 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dab90-6bb5-4a9d-9a1c-2c35c4f80067 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:16.330337 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dab90-6bb5-4a9d-9a1c-2c35c4f80067 admin admin] PATH_INFO: `/v3/groups/b4489c38eb204e299667023bc5d99912` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:16.331536 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dab90-6bb5-4a9d-9a1c-2c35c4f80067 admin admin] RBAC: Authorizing `identity:get_group(group_id=b4489c38eb204e299667023bc5d99912)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:16.333377 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dab90-6bb5-4a9d-9a1c-2c35c4f80067 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:16.334899 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 182/351] 10.222.0.39 () {56 vars in 1202 bytes} [Tue Aug 31 02:52:16 2021] GET /identity/v3/groups/b4489c38eb204e299667023bc5d99912 => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:16.340612 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5af2c5-133a-45dc-b5d8-04d1dd63a539 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:16.350252 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5af2c5-133a-45dc-b5d8-04d1dd63a539 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:16.354389 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7241e7-dfa0-4554-b9ac-d63ab962e849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:16.354998 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7241e7-dfa0-4554-b9ac-d63ab962e849 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:16.355279 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7241e7-dfa0-4554-b9ac-d63ab962e849 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:16.355579 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7241e7-dfa0-4554-b9ac-d63ab962e849 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:16.356380 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7241e7-dfa0-4554-b9ac-d63ab962e849 admin admin] RBAC: Adding query filter params (group.id=b4489c38eb204e299667023bc5d99912, role.id=99835eeda2f64af5bc9173a8370d4568, scope.project.id=8eb33f1e09d7463d8975fc4c37c2e87b) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:16.356687 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7241e7-dfa0-4554-b9ac-d63ab962e849 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:16.358472 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7241e7-dfa0-4554-b9ac-d63ab962e849 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:16.364993 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 170/352] 10.222.0.39 () {56 vars in 1398 bytes} [Tue Aug 31 02:52:16 2021] GET /identity/v3/role_assignments?group.id=b4489c38eb204e299667023bc5d99912&scope.project.id=8eb33f1e09d7463d8975fc4c37c2e87b&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:19.137087 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b102cf-df5d-4a1e-b32c-76eff5e7a442 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:19.137609 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b102cf-df5d-4a1e-b32c-76eff5e7a442 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:19.137609 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b102cf-df5d-4a1e-b32c-76eff5e7a442 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:19.139588 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 183/353] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:19.146491 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8ab75-9f05-4eea-8675-a0f659e78b3e None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:19.147385 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8ab75-9f05-4eea-8675-a0f659e78b3e None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:19.147864 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8ab75-9f05-4eea-8675-a0f659e78b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:19.168059 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d392e-809b-4142-946c-a59ac761ffab None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:19.168656 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d392e-809b-4142-946c-a59ac761ffab None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:19.169128 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d392e-809b-4142-946c-a59ac761ffab None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:19.171135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 184/354] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:52:19.176350 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-aba8ab75-9f05-4eea-8675-a0f659e78b3e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:19.177827 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-aba8ab75-9f05-4eea-8675-a0f659e78b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:19.184022 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbc5bb-431a-4a06-98ab-5e44c4ca76e3 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:19.184543 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbc5bb-431a-4a06-98ab-5e44c4ca76e3 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:19.185033 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbc5bb-431a-4a06-98ab-5e44c4ca76e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:19.195539 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 171/355] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:19.212913 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-cdfbc5bb-431a-4a06-98ab-5e44c4ca76e3 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:19.214398 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-cdfbc5bb-431a-4a06-98ab-5e44c4ca76e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:19.226869 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 185/356] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:19.266531 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8ab75-9f05-4eea-8675-a0f659e78b3e None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:19.267187 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbc5bb-431a-4a06-98ab-5e44c4ca76e3 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:19.277889 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbc5bb-431a-4a06-98ab-5e44c4ca76e3 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:19.282483 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8ab75-9f05-4eea-8675-a0f659e78b3e None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:19.288732 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8541087-7aea-4dd7-8147-5ed1dc1d6d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:19.289770 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8541087-7aea-4dd7-8147-5ed1dc1d6d15 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:19.290560 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8541087-7aea-4dd7-8147-5ed1dc1d6d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:19.291567 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8541087-7aea-4dd7-8147-5ed1dc1d6d15 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:19.292274 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5ab87-0b7d-4e63-9ee8-8da1f241d7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:19.293771 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5ab87-0b7d-4e63-9ee8-8da1f241d7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:19.294428 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5ab87-0b7d-4e63-9ee8-8da1f241d7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:19.296243 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5ab87-0b7d-4e63-9ee8-8da1f241d7c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:19.313407 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8541087-7aea-4dd7-8147-5ed1dc1d6d15 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:19.313999 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5ab87-0b7d-4e63-9ee8-8da1f241d7c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:19.315819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8541087-7aea-4dd7-8147-5ed1dc1d6d15 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:19.315927 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5ab87-0b7d-4e63-9ee8-8da1f241d7c2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:19.334435 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-98f5ab87-0b7d-4e63-9ee8-8da1f241d7c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:19.335983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 172/357] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:19.344372 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5ab87-0b7d-4e63-9ee8-8da1f241d7c2 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:19.350898 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-e8541087-7aea-4dd7-8147-5ed1dc1d6d15 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:19.358632 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5ab87-0b7d-4e63-9ee8-8da1f241d7c2 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:19.359012 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 186/358] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:19.360720 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8541087-7aea-4dd7-8147-5ed1dc1d6d15 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:19.373945 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2847c2-524a-4e4a-b505-1795a508c6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:19.375709 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2847c2-524a-4e4a-b505-1795a508c6ee admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:19.376144 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2847c2-524a-4e4a-b505-1795a508c6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:19.376564 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2847c2-524a-4e4a-b505-1795a508c6ee admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:19.377500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2847c2-524a-4e4a-b505-1795a508c6ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:19.377965 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2847c2-524a-4e4a-b505-1795a508c6ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:19.380107 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2847c2-524a-4e4a-b505-1795a508c6ee admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:19.382460 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8541087-7aea-4dd7-8147-5ed1dc1d6d15 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:19.397427 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e45ee9-1c03-4110-bf83-111780741718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:19.398369 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e45ee9-1c03-4110-bf83-111780741718 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:19.398798 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e45ee9-1c03-4110-bf83-111780741718 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:19.399216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e45ee9-1c03-4110-bf83-111780741718 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:19.400114 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e45ee9-1c03-4110-bf83-111780741718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:19.400559 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e45ee9-1c03-4110-bf83-111780741718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:19.401724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-32e45ee9-1c03-4110-bf83-111780741718 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:19.401724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 02:52:19.401724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 02:52:19.403790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e45ee9-1c03-4110-bf83-111780741718 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:19.408378 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 173/359] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:19.416952 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2847c2-524a-4e4a-b505-1795a508c6ee admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:19.437980 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2847c2-524a-4e4a-b505-1795a508c6ee admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:19.449541 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 187/360] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:19.451044 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e45ee9-1c03-4110-bf83-111780741718 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:19.453425 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1ea58-dcb9-48dd-a8f0-477f48300ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:19.454265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1ea58-dcb9-48dd-a8f0-477f48300ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:19.454858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1ea58-dcb9-48dd-a8f0-477f48300ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:19.455279 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1ea58-dcb9-48dd-a8f0-477f48300ba8 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:19.456151 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1ea58-dcb9-48dd-a8f0-477f48300ba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:19.457308 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-c1c1ea58-dcb9-48dd-a8f0-477f48300ba8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:19.457308 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 02:52:19.457308 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 02:52:19.458823 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1ea58-dcb9-48dd-a8f0-477f48300ba8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:19.470342 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e45ee9-1c03-4110-bf83-111780741718 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:19.479102 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1f1f7-eaa4-4730-99e1-565092ff7cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:19.479860 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1f1f7-eaa4-4730-99e1-565092ff7cea admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:19.480139 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1f1f7-eaa4-4730-99e1-565092ff7cea admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:19.480416 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1f1f7-eaa4-4730-99e1-565092ff7cea admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:19.481212 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1f1f7-eaa4-4730-99e1-565092ff7cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:19.483395 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1f1f7-eaa4-4730-99e1-565092ff7cea admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:19.501708 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 174/361] 10.222.0.39 () {60 vars in 1154 bytes} [Tue Aug 31 02:52:19 2021] POST /identity/v3/users => generated 246 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 02:52:19.503344 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53806f-e5b4-4256-8b8d-e49649748d10 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:19.503663 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53806f-e5b4-4256-8b8d-e49649748d10 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:19.504245 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53806f-e5b4-4256-8b8d-e49649748d10 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:19.509858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 175/362] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:19 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:19.515082 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76620dd4-0a1f-4a2d-8c96-17b19adc9352 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:19.515386 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76620dd4-0a1f-4a2d-8c96-17b19adc9352 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:19.515696 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76620dd4-0a1f-4a2d-8c96-17b19adc9352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:19.517239 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 188/363] 10.222.0.39 () {60 vars in 1154 bytes} [Tue Aug 31 02:52:19 2021] POST /identity/v3/users => generated 248 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:52:19.538454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-76620dd4-0a1f-4a2d-8c96-17b19adc9352 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:19.539881 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-76620dd4-0a1f-4a2d-8c96-17b19adc9352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:19.549128 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 176/364] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:19.574767 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1f1f7-eaa4-4730-99e1-565092ff7cea admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:19.585906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1f1f7-eaa4-4730-99e1-565092ff7cea admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:19.591039 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783044c-3869-41e3-9bfa-0a40947e9f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:19.592024 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783044c-3869-41e3-9bfa-0a40947e9f45 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:19.592310 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783044c-3869-41e3-9bfa-0a40947e9f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:19.592605 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783044c-3869-41e3-9bfa-0a40947e9f45 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:19.608521 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783044c-3869-41e3-9bfa-0a40947e9f45 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:19.610876 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783044c-3869-41e3-9bfa-0a40947e9f45 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:19.629389 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-d783044c-3869-41e3-9bfa-0a40947e9f45 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:19.630774 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 189/365] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:19.637317 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76620dd4-0a1f-4a2d-8c96-17b19adc9352 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:19.651242 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76620dd4-0a1f-4a2d-8c96-17b19adc9352 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:19.661864 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a673d1-1b7c-44d4-824e-bc4d44882a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:19.662546 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a673d1-1b7c-44d4-824e-bc4d44882a4a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:19.662829 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a673d1-1b7c-44d4-824e-bc4d44882a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:19.663100 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a673d1-1b7c-44d4-824e-bc4d44882a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:19.663871 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a673d1-1b7c-44d4-824e-bc4d44882a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:19.664175 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a673d1-1b7c-44d4-824e-bc4d44882a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:19.665811 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a673d1-1b7c-44d4-824e-bc4d44882a4a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:19.682768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 177/366] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:19.689078 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783044c-3869-41e3-9bfa-0a40947e9f45 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:19.705569 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783044c-3869-41e3-9bfa-0a40947e9f45 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:19.713096 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c4bc5-e500-42a5-bfcc-0fac55168bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:19.713781 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c4bc5-e500-42a5-bfcc-0fac55168bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:19.714057 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c4bc5-e500-42a5-bfcc-0fac55168bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:19.714326 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c4bc5-e500-42a5-bfcc-0fac55168bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:19.715045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c4bc5-e500-42a5-bfcc-0fac55168bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:19.717154 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c4bc5-e500-42a5-bfcc-0fac55168bf5 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:19.750307 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 190/367] 10.222.0.39 () {60 vars in 1154 bytes} [Tue Aug 31 02:52:19 2021] POST /identity/v3/users => generated 248 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:52:20.152895 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775da176-4d47-4bf8-9bfa-8a28db809d43 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:20.153514 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775da176-4d47-4bf8-9bfa-8a28db809d43 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:20.153514 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775da176-4d47-4bf8-9bfa-8a28db809d43 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:20.155531 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 178/368] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:20.161801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c9a0e-7308-4dfe-b381-66af65a48e78 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:20.162338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c9a0e-7308-4dfe-b381-66af65a48e78 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:20.162338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c9a0e-7308-4dfe-b381-66af65a48e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:20.186402 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-5c0c9a0e-7308-4dfe-b381-66af65a48e78 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:20.188160 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-5c0c9a0e-7308-4dfe-b381-66af65a48e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:20.204700 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 191/369] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:20.243519 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775da176-4d47-4bf8-9bfa-8a28db809d43 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:20.260968 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775da176-4d47-4bf8-9bfa-8a28db809d43 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:20.266200 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65635625-f4fe-479e-a921-a2016fa98100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:20.267061 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65635625-f4fe-479e-a921-a2016fa98100 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:20.267343 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65635625-f4fe-479e-a921-a2016fa98100 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:20.267638 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65635625-f4fe-479e-a921-a2016fa98100 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:20.282173 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65635625-f4fe-479e-a921-a2016fa98100 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:20.284050 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65635625-f4fe-479e-a921-a2016fa98100 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:20.301688 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-65635625-f4fe-479e-a921-a2016fa98100 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:20.302868 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 179/370] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:20.309106 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c9a0e-7308-4dfe-b381-66af65a48e78 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:20.320499 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c9a0e-7308-4dfe-b381-66af65a48e78 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:20.326731 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789b63b-e3de-4425-a07d-fa224e2311ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:20.328013 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789b63b-e3de-4425-a07d-fa224e2311ad admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:20.328293 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789b63b-e3de-4425-a07d-fa224e2311ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:20.328560 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789b63b-e3de-4425-a07d-fa224e2311ad admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:20.329265 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789b63b-e3de-4425-a07d-fa224e2311ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:20.329561 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789b63b-e3de-4425-a07d-fa224e2311ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:20.331334 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789b63b-e3de-4425-a07d-fa224e2311ad admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:20.345743 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 192/371] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:20.351483 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65635625-f4fe-479e-a921-a2016fa98100 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:20.364149 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65635625-f4fe-479e-a921-a2016fa98100 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:20.368688 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a8df6-2211-40ed-afc6-931376fcf223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:20.369398 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a8df6-2211-40ed-afc6-931376fcf223 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:20.369673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a8df6-2211-40ed-afc6-931376fcf223 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:20.370047 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a8df6-2211-40ed-afc6-931376fcf223 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:20.370701 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a8df6-2211-40ed-afc6-931376fcf223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:20.374931 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a8df6-2211-40ed-afc6-931376fcf223 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:20.401961 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 180/372] 10.222.0.39 () {60 vars in 1154 bytes} [Tue Aug 31 02:52:20 2021] POST /identity/v3/users => generated 249 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:52:20.634177 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f4f07-4ddf-40e0-89f8-8345072f8695 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:20.634613 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f4f07-4ddf-40e0-89f8-8345072f8695 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:20.634613 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f4f07-4ddf-40e0-89f8-8345072f8695 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:20.636501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 193/373] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:20.644402 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09623040-f857-49fd-9824-8bf703b590d1 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:20.644402 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09623040-f857-49fd-9824-8bf703b590d1 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:20.644402 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09623040-f857-49fd-9824-8bf703b590d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:20.668443 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-09623040-f857-49fd-9824-8bf703b590d1 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:20.669992 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-09623040-f857-49fd-9824-8bf703b590d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:20.683009 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 181/374] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:20.709906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f4f07-4ddf-40e0-89f8-8345072f8695 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:20.725542 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f4f07-4ddf-40e0-89f8-8345072f8695 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:20.732130 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57930239-5f57-46d2-a4c0-bfdda89ddb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:20.733036 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930239-5f57-46d2-a4c0-bfdda89ddb98 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:20.733581 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930239-5f57-46d2-a4c0-bfdda89ddb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:20.734279 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930239-5f57-46d2-a4c0-bfdda89ddb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:20.735327 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57930239-5f57-46d2-a4c0-bfdda89ddb98 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:20.737176 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57930239-5f57-46d2-a4c0-bfdda89ddb98 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:20.745555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.sql.core [None req-57930239-5f57-46d2-a4c0-bfdda89ddb98 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 02:52:20.745555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 02:52:20.745555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [parameters: {'id': '81e1f38922dc4c6282ca2c9f04a2e567', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 02:52:20.745555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73351) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 02:52:20.762080 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-57930239-5f57-46d2-a4c0-bfdda89ddb98 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 02:52:20.764064 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 194/375] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 02:52:20 2021] POST /identity/v3/roles => generated 144 bytes in 54 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:20.771209 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09623040-f857-49fd-9824-8bf703b590d1 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:20.780562 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09623040-f857-49fd-9824-8bf703b590d1 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:20.787931 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5951e-795f-4a9d-8f15-fbb47590db2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:20.789005 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5951e-795f-4a9d-8f15-fbb47590db2d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:20.789508 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5951e-795f-4a9d-8f15-fbb47590db2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:20.789983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5951e-795f-4a9d-8f15-fbb47590db2d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:20.805774 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5951e-795f-4a9d-8f15-fbb47590db2d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:20.814049 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-18a5951e-795f-4a9d-8f15-fbb47590db2d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 02:52:20.815528 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 182/376] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:20 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:20.822317 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57930239-5f57-46d2-a4c0-bfdda89ddb98 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:20.837088 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57930239-5f57-46d2-a4c0-bfdda89ddb98 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:20.844515 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ddea9-65e1-4284-8cc4-035fe81b630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:20.845432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ddea9-65e1-4284-8cc4-035fe81b630f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:20.845963 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ddea9-65e1-4284-8cc4-035fe81b630f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:20.846439 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ddea9-65e1-4284-8cc4-035fe81b630f admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:20.847424 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ddea9-65e1-4284-8cc4-035fe81b630f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:20.847934 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ddea9-65e1-4284-8cc4-035fe81b630f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:20.849749 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ddea9-65e1-4284-8cc4-035fe81b630f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:20.863001 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 195/377] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:20 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:22.304720 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea7fa7-dd70-4e77-8315-3e57d71992b2 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.305728 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea7fa7-dd70-4e77-8315-3e57d71992b2 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.306221 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea7fa7-dd70-4e77-8315-3e57d71992b2 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.308578 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 183/378] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:22.315274 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87968a1d-e90d-4c48-bdb4-926c243d7ed0 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.316177 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87968a1d-e90d-4c48-bdb4-926c243d7ed0 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.316679 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87968a1d-e90d-4c48-bdb4-926c243d7ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.345604 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-87968a1d-e90d-4c48-bdb4-926c243d7ed0 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:22.347219 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-87968a1d-e90d-4c48-bdb4-926c243d7ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:22.359413 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 196/379] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:22.414244 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea7fa7-dd70-4e77-8315-3e57d71992b2 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:22.433291 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea7fa7-dd70-4e77-8315-3e57d71992b2 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:22.440851 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b4590-6f65-4864-bd3e-0f7d2a4c706c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:22.443226 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b08bf-c18b-4d78-8219-aba0b4c4d960 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.443762 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b08bf-c18b-4d78-8219-aba0b4c4d960 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.444237 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b08bf-c18b-4d78-8219-aba0b4c4d960 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.446212 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 197/380] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:22.446717 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b4590-6f65-4864-bd3e-0f7d2a4c706c admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.447224 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b4590-6f65-4864-bd3e-0f7d2a4c706c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.447729 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b4590-6f65-4864-bd3e-0f7d2a4c706c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.452112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16ba4d-985a-4d52-8249-661153665fac None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.452453 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16ba4d-985a-4d52-8249-661153665fac None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.452736 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16ba4d-985a-4d52-8249-661153665fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.475712 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b4590-6f65-4864-bd3e-0f7d2a4c706c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:22.483205 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-695b4590-6f65-4864-bd3e-0f7d2a4c706c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:52:22.488171 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 184/381] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:22.489548 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-5b16ba4d-985a-4d52-8249-661153665fac None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:22.491003 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-5b16ba4d-985a-4d52-8249-661153665fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:22.499748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b4590-6f65-4864-bd3e-0f7d2a4c706c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:22.502449 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 198/382] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:22.510531 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b4590-6f65-4864-bd3e-0f7d2a4c706c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:22.515393 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39743b3-eb54-444d-9f1c-8b1ce6117e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:22.516332 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39743b3-eb54-444d-9f1c-8b1ce6117e25 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.516839 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39743b3-eb54-444d-9f1c-8b1ce6117e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.517318 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39743b3-eb54-444d-9f1c-8b1ce6117e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.518341 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39743b3-eb54-444d-9f1c-8b1ce6117e25 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:22.518899 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39743b3-eb54-444d-9f1c-8b1ce6117e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:22.520730 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39743b3-eb54-444d-9f1c-8b1ce6117e25 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:22.530043 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 185/383] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:52:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:22.536426 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16ba4d-985a-4d52-8249-661153665fac None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:22.540138 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39743b3-eb54-444d-9f1c-8b1ce6117e25 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:22.550358 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39743b3-eb54-444d-9f1c-8b1ce6117e25 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:22.551064 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16ba4d-985a-4d52-8249-661153665fac None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:22.560449 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77f605-35fd-4964-9d20-6acc7e81f364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:22.562868 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2f23c-f48d-4d8b-bb11-2baded3287f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:22.563953 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2f23c-f48d-4d8b-bb11-2baded3287f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.564548 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77f605-35fd-4964-9d20-6acc7e81f364 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.565062 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77f605-35fd-4964-9d20-6acc7e81f364 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.565536 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2f23c-f48d-4d8b-bb11-2baded3287f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.566057 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77f605-35fd-4964-9d20-6acc7e81f364 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.566524 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2f23c-f48d-4d8b-bb11-2baded3287f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.582095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2f23c-f48d-4d8b-bb11-2baded3287f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:22.583979 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2f23c-f48d-4d8b-bb11-2baded3287f5 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:22.584401 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77f605-35fd-4964-9d20-6acc7e81f364 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:22.593018 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-ae77f605-35fd-4964-9d20-6acc7e81f364 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:52:22.594748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 186/384] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:22.596229 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fcec0-31e7-4328-a943-98b36e0b8941 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.596739 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fcec0-31e7-4328-a943-98b36e0b8941 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.597270 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fcec0-31e7-4328-a943-98b36e0b8941 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.599134 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 187/385] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:22.605319 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dce17d-2470-4fa6-aaab-f8cf25ff575a None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.605823 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dce17d-2470-4fa6-aaab-f8cf25ff575a None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.606387 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dce17d-2470-4fa6-aaab-f8cf25ff575a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.606908 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-dea2f23c-f48d-4d8b-bb11-2baded3287f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:22.609850 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 199/386] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:22.609963 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2f23c-f48d-4d8b-bb11-2baded3287f5 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:22.624192 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2f23c-f48d-4d8b-bb11-2baded3287f5 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:22.628861 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755435d-7547-48a7-a97e-a9b5fb0b4180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:22.629185 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-16dce17d-2470-4fa6-aaab-f8cf25ff575a None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:22.629530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755435d-7547-48a7-a97e-a9b5fb0b4180 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.629813 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755435d-7547-48a7-a97e-a9b5fb0b4180 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.630087 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755435d-7547-48a7-a97e-a9b5fb0b4180 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.630836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755435d-7547-48a7-a97e-a9b5fb0b4180 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:22.631141 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755435d-7547-48a7-a97e-a9b5fb0b4180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:22.631729 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-16dce17d-2470-4fa6-aaab-f8cf25ff575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:22.632788 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755435d-7547-48a7-a97e-a9b5fb0b4180 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:22.640958 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 188/387] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:22.647391 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dce17d-2470-4fa6-aaab-f8cf25ff575a None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:22.647611 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 200/388] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:52:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:22.650121 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755435d-7547-48a7-a97e-a9b5fb0b4180 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:22.660159 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755435d-7547-48a7-a97e-a9b5fb0b4180 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:22.660339 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dce17d-2470-4fa6-aaab-f8cf25ff575a None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:22.664765 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27b7f7-af8d-42ab-a620-5f39db50df54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:22.665526 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27b7f7-af8d-42ab-a620-5f39db50df54 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.665819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27b7f7-af8d-42ab-a620-5f39db50df54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.666096 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27b7f7-af8d-42ab-a620-5f39db50df54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.673221 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e97eb5-5aa9-459f-b6d8-05ba85e2d49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:22.673977 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e97eb5-5aa9-459f-b6d8-05ba85e2d49d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.674299 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e97eb5-5aa9-459f-b6d8-05ba85e2d49d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.674572 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e97eb5-5aa9-459f-b6d8-05ba85e2d49d admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.675306 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e97eb5-5aa9-459f-b6d8-05ba85e2d49d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:22.675692 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e97eb5-5aa9-459f-b6d8-05ba85e2d49d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:22.677400 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e97eb5-5aa9-459f-b6d8-05ba85e2d49d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:22.679845 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27b7f7-af8d-42ab-a620-5f39db50df54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:22.681803 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27b7f7-af8d-42ab-a620-5f39db50df54 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:22.694521 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 189/389] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:22.695723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e97eb5-5aa9-459f-b6d8-05ba85e2d49d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:22.708444 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-7d27b7f7-af8d-42ab-a620-5f39db50df54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:22.709744 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e97eb5-5aa9-459f-b6d8-05ba85e2d49d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:22.714464 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929f2db-21a4-4fd2-833d-613c4fa3ef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:22.714804 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 201/390] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:22.715725 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929f2db-21a4-4fd2-833d-613c4fa3ef85 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.715833 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27b7f7-af8d-42ab-a620-5f39db50df54 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:22.716412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929f2db-21a4-4fd2-833d-613c4fa3ef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.716999 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929f2db-21a4-4fd2-833d-613c4fa3ef85 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.726166 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27b7f7-af8d-42ab-a620-5f39db50df54 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:22.730912 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1c5d-a291-41d2-8ae3-c05497eb03a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:22.731826 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1c5d-a291-41d2-8ae3-c05497eb03a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.732308 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1c5d-a291-41d2-8ae3-c05497eb03a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.732416 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1c5d-a291-41d2-8ae3-c05497eb03a2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.736665 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929f2db-21a4-4fd2-833d-613c4fa3ef85 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:22.743982 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-e929f2db-21a4-4fd2-833d-613c4fa3ef85 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:52:22.745902 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 190/391] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:22.752652 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929f2db-21a4-4fd2-833d-613c4fa3ef85 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:22.765479 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929f2db-21a4-4fd2-833d-613c4fa3ef85 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:22.770557 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558f653-a49f-4c85-91b4-b6f0b00b1128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:22.771625 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558f653-a49f-4c85-91b4-b6f0b00b1128 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.772214 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558f653-a49f-4c85-91b4-b6f0b00b1128 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.772688 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558f653-a49f-4c85-91b4-b6f0b00b1128 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.773640 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558f653-a49f-4c85-91b4-b6f0b00b1128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:22.774147 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558f653-a49f-4c85-91b4-b6f0b00b1128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:22.776041 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558f653-a49f-4c85-91b4-b6f0b00b1128 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:22.789320 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 191/392] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:22.790584 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558f653-a49f-4c85-91b4-b6f0b00b1128 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:22.804385 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558f653-a49f-4c85-91b4-b6f0b00b1128 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:22.809451 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04b82a-727f-4d97-b150-6140261933ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:22.810480 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04b82a-727f-4d97-b150-6140261933ce admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.811024 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04b82a-727f-4d97-b150-6140261933ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.811688 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04b82a-727f-4d97-b150-6140261933ce admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.812731 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04b82a-727f-4d97-b150-6140261933ce admin admin] RBAC: Adding query filter params (name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:22.813247 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04b82a-727f-4d97-b150-6140261933ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:22.815095 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04b82a-727f-4d97-b150-6140261933ce admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:22.825046 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 192/393] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:52:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:22.832140 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04b82a-727f-4d97-b150-6140261933ce admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:22.842608 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04b82a-727f-4d97-b150-6140261933ce admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:22.847756 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8b99c-715c-45ba-88b7-2d7d5ee5ff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:22.848847 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8b99c-715c-45ba-88b7-2d7d5ee5ff5e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.849363 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8b99c-715c-45ba-88b7-2d7d5ee5ff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.849846 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8b99c-715c-45ba-88b7-2d7d5ee5ff5e admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.851606 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d1c5d-a291-41d2-8ae3-c05497eb03a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:22.854023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d1c5d-a291-41d2-8ae3-c05497eb03a2 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:22.860681 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8b99c-715c-45ba-88b7-2d7d5ee5ff5e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:22.863322 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8b99c-715c-45ba-88b7-2d7d5ee5ff5e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:22.868763 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-d40d1c5d-a291-41d2-8ae3-c05497eb03a2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 02:52:22.870033 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 202/394] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Aug 31 02:52:22 2021] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:22.876244 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1c5d-a291-41d2-8ae3-c05497eb03a2 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:22.878830 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-4ea8b99c-715c-45ba-88b7-2d7d5ee5ff5e admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 02:52:22.880270 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 193/395] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:22 2021] GET /identity/v3/users/glance => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:22.881241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8b99c-715c-45ba-88b7-2d7d5ee5ff5e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:22.892280 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1c5d-a291-41d2-8ae3-c05497eb03a2 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:22.892724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8b99c-715c-45ba-88b7-2d7d5ee5ff5e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:22.896782 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d0e41-d95c-4e03-bc4f-e45f2475b070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:22.897565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d0e41-d95c-4e03-bc4f-e45f2475b070 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.897849 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d0e41-d95c-4e03-bc4f-e45f2475b070 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.898126 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d0e41-d95c-4e03-bc4f-e45f2475b070 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.898577 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a0f6c-dc37-4d6f-b4f6-0d7f8b3a4057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:22.899622 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a0f6c-dc37-4d6f-b4f6-0d7f8b3a4057 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.900295 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a0f6c-dc37-4d6f-b4f6-0d7f8b3a4057 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.900774 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a0f6c-dc37-4d6f-b4f6-0d7f8b3a4057 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.902130 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a0f6c-dc37-4d6f-b4f6-0d7f8b3a4057 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:22.902643 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a0f6c-dc37-4d6f-b4f6-0d7f8b3a4057 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:22.903903 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-3b4a0f6c-dc37-4d6f-b4f6-0d7f8b3a4057 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:22.903903 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 02:52:22.903903 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 02:52:22.905464 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a0f6c-dc37-4d6f-b4f6-0d7f8b3a4057 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:22.914041 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d0e41-d95c-4e03-bc4f-e45f2475b070 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:22.916012 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d0e41-d95c-4e03-bc4f-e45f2475b070 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:22.935049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-ef4d0e41-d95c-4e03-bc4f-e45f2475b070 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:22.936394 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 203/396] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:22.937679 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d0e41-d95c-4e03-bc4f-e45f2475b070 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:22.947105 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d0e41-d95c-4e03-bc4f-e45f2475b070 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:22.950945 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 194/397] 10.222.0.39 () {56 vars in 1155 bytes} [Tue Aug 31 02:52:22 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:22.954125 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a0f6c-dc37-4d6f-b4f6-0d7f8b3a4057 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:22.955823 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55445c6e-211d-4b56-9ebe-8654249a6d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:22.956500 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55445c6e-211d-4b56-9ebe-8654249a6d4a admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.956788 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55445c6e-211d-4b56-9ebe-8654249a6d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.957063 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55445c6e-211d-4b56-9ebe-8654249a6d4a admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.957896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55445c6e-211d-4b56-9ebe-8654249a6d4a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:22.958203 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55445c6e-211d-4b56-9ebe-8654249a6d4a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:22.959207 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-55445c6e-211d-4b56-9ebe-8654249a6d4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:22.959207 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 02:52:22.959207 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 02:52:22.960373 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55445c6e-211d-4b56-9ebe-8654249a6d4a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:22.966562 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a0f6c-dc37-4d6f-b4f6-0d7f8b3a4057 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:22.971877 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710810f-a896-4865-afdf-c0a0ad6f9dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:22.972809 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710810f-a896-4865-afdf-c0a0ad6f9dae admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:22.973296 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710810f-a896-4865-afdf-c0a0ad6f9dae admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:22.974762 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710810f-a896-4865-afdf-c0a0ad6f9dae admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:22.975806 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710810f-a896-4865-afdf-c0a0ad6f9dae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:22.976340 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710810f-a896-4865-afdf-c0a0ad6f9dae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:22.978261 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710810f-a896-4865-afdf-c0a0ad6f9dae admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:22.994931 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 195/398] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:22.996818 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710810f-a896-4865-afdf-c0a0ad6f9dae admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.000101 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 204/399] 10.222.0.39 () {56 vars in 1159 bytes} [Tue Aug 31 02:52:22 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:23.005726 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55445c6e-211d-4b56-9ebe-8654249a6d4a admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.008696 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710810f-a896-4865-afdf-c0a0ad6f9dae admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.014496 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb33cb6-528a-4c95-ab48-c79c494b8c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.015448 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55445c6e-211d-4b56-9ebe-8654249a6d4a admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.015762 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb33cb6-528a-4c95-ab48-c79c494b8c8f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.016320 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb33cb6-528a-4c95-ab48-c79c494b8c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.016796 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb33cb6-528a-4c95-ab48-c79c494b8c8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.020043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058be4c-58c8-478d-80d2-179b56029741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.020834 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058be4c-58c8-478d-80d2-179b56029741 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.021112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058be4c-58c8-478d-80d2-179b56029741 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.021391 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058be4c-58c8-478d-80d2-179b56029741 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.028233 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb33cb6-528a-4c95-ab48-c79c494b8c8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.031213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb33cb6-528a-4c95-ab48-c79c494b8c8f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.031323 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058be4c-58c8-478d-80d2-179b56029741 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.033366 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058be4c-58c8-478d-80d2-179b56029741 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.042726 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 196/400] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:23.043828 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb33cb6-528a-4c95-ab48-c79c494b8c8f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.052190 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-f058be4c-58c8-478d-80d2-179b56029741 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 02:52:23.053541 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 205/401] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:23.055402 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058be4c-58c8-478d-80d2-179b56029741 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.057466 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb33cb6-528a-4c95-ab48-c79c494b8c8f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.063010 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2c33b-d68a-4d8c-8aab-a754cf6b76b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.064274 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2c33b-d68a-4d8c-8aab-a754cf6b76b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.064771 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2c33b-d68a-4d8c-8aab-a754cf6b76b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.065250 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2c33b-d68a-4d8c-8aab-a754cf6b76b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.065702 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058be4c-58c8-478d-80d2-179b56029741 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.070480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da33d31-7eda-4ca9-b09f-c9894badf869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.071295 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da33d31-7eda-4ca9-b09f-c9894badf869 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.071785 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da33d31-7eda-4ca9-b09f-c9894badf869 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.072295 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da33d31-7eda-4ca9-b09f-c9894badf869 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.080252 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2c33b-d68a-4d8c-8aab-a754cf6b76b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.083186 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2c33b-d68a-4d8c-8aab-a754cf6b76b8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.084762 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da33d31-7eda-4ca9-b09f-c9894badf869 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.086599 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da33d31-7eda-4ca9-b09f-c9894badf869 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.096074 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 197/402] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:23.097154 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2c33b-d68a-4d8c-8aab-a754cf6b76b8 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.107258 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2c33b-d68a-4d8c-8aab-a754cf6b76b8 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.112181 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c4087-8395-4b88-b103-c8c035084615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.113064 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c4087-8395-4b88-b103-c8c035084615 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.113614 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c4087-8395-4b88-b103-c8c035084615 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.114103 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-4da33d31-7eda-4ca9-b09f-c9894badf869 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:23.114349 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c4087-8395-4b88-b103-c8c035084615 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.115410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c4087-8395-4b88-b103-c8c035084615 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:23.115920 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c4087-8395-4b88-b103-c8c035084615 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.118059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c4087-8395-4b88-b103-c8c035084615 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.126340 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 206/403] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:23.127255 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da33d31-7eda-4ca9-b09f-c9894badf869 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.136816 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da33d31-7eda-4ca9-b09f-c9894badf869 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.142289 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee20a01-2b81-42a5-903c-f9a38b614571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.143132 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 198/404] 10.222.0.39 () {56 vars in 1159 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:23.143411 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee20a01-2b81-42a5-903c-f9a38b614571 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.143722 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee20a01-2b81-42a5-903c-f9a38b614571 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.144000 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee20a01-2b81-42a5-903c-f9a38b614571 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.145086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c4087-8395-4b88-b103-c8c035084615 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.155186 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee20a01-2b81-42a5-903c-f9a38b614571 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.157219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c4087-8395-4b88-b103-c8c035084615 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.157406 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee20a01-2b81-42a5-903c-f9a38b614571 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.163086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8867d-e3c7-45bd-8788-de6e415dbc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.164685 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8867d-e3c7-45bd-8788-de6e415dbc8a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.165180 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8867d-e3c7-45bd-8788-de6e415dbc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.166131 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8867d-e3c7-45bd-8788-de6e415dbc8a admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.167432 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8867d-e3c7-45bd-8788-de6e415dbc8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:23.168000 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8867d-e3c7-45bd-8788-de6e415dbc8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.169892 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8867d-e3c7-45bd-8788-de6e415dbc8a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.174284 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-eee20a01-2b81-42a5-903c-f9a38b614571 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:23.175749 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 207/405] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:23.180362 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee20a01-2b81-42a5-903c-f9a38b614571 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.185741 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 199/406] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:23.187647 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8867d-e3c7-45bd-8788-de6e415dbc8a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.198216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee20a01-2b81-42a5-903c-f9a38b614571 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.200136 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8867d-e3c7-45bd-8788-de6e415dbc8a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.203824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608432db-2731-4f4e-9d82-f7bd341b7c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.204492 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608432db-2731-4f4e-9d82-f7bd341b7c7d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.204778 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608432db-2731-4f4e-9d82-f7bd341b7c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.205056 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608432db-2731-4f4e-9d82-f7bd341b7c7d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.207803 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77c17b-7d2b-4207-b840-bcfad3abe8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.208814 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77c17b-7d2b-4207-b840-bcfad3abe8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.209323 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77c17b-7d2b-4207-b840-bcfad3abe8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.209821 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77c17b-7d2b-4207-b840-bcfad3abe8a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.211015 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77c17b-7d2b-4207-b840-bcfad3abe8a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:23.212213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77c17b-7d2b-4207-b840-bcfad3abe8a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.213798 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608432db-2731-4f4e-9d82-f7bd341b7c7d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.214724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77c17b-7d2b-4207-b840-bcfad3abe8a0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.215591 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608432db-2731-4f4e-9d82-f7bd341b7c7d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.224665 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 208/407] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:23.225560 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608432db-2731-4f4e-9d82-f7bd341b7c7d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.230606 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 200/408] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:23.231723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77c17b-7d2b-4207-b840-bcfad3abe8a0 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.240126 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608432db-2731-4f4e-9d82-f7bd341b7c7d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.243663 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77c17b-7d2b-4207-b840-bcfad3abe8a0 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.244808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd539c-b595-46a6-82ab-29a3a17a85ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.245622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd539c-b595-46a6-82ab-29a3a17a85ad admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.245876 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd539c-b595-46a6-82ab-29a3a17a85ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.246423 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd539c-b595-46a6-82ab-29a3a17a85ad admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.251121 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2673d-844e-4ad6-87fe-872d7c7228cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.252255 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2673d-844e-4ad6-87fe-872d7c7228cc admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.252778 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2673d-844e-4ad6-87fe-872d7c7228cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.253255 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2673d-844e-4ad6-87fe-872d7c7228cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.254588 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd539c-b595-46a6-82ab-29a3a17a85ad admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.256575 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd539c-b595-46a6-82ab-29a3a17a85ad admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.267014 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2673d-844e-4ad6-87fe-872d7c7228cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.269247 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2673d-844e-4ad6-87fe-872d7c7228cc admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.270801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-b9dd539c-b595-46a6-82ab-29a3a17a85ad admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:23.272326 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 209/409] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:23.273239 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd539c-b595-46a6-82ab-29a3a17a85ad admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.282753 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd539c-b595-46a6-82ab-29a3a17a85ad admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.287086 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be266ae-36d2-49e9-b1cc-4569e4717968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.287876 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be266ae-36d2-49e9-b1cc-4569e4717968 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.288157 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be266ae-36d2-49e9-b1cc-4569e4717968 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.288431 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be266ae-36d2-49e9-b1cc-4569e4717968 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.291092 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-6bd2673d-844e-4ad6-87fe-872d7c7228cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:23.292301 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 201/410] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:23.295394 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be266ae-36d2-49e9-b1cc-4569e4717968 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.297697 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be266ae-36d2-49e9-b1cc-4569e4717968 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.298665 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ac6cb-0392-4ec4-a058-b9e7b1b5aacd None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.298959 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ac6cb-0392-4ec4-a058-b9e7b1b5aacd None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.299258 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ac6cb-0392-4ec4-a058-b9e7b1b5aacd None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.301117 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 202/411] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:23 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:23.304142 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ac6cb-0392-4ec4-a058-b9e7b1b5aacd None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.312238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-9be266ae-36d2-49e9-b1cc-4569e4717968 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:23.313650 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 210/412] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:23.317504 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ac6cb-0392-4ec4-a058-b9e7b1b5aacd None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.319341 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be266ae-36d2-49e9-b1cc-4569e4717968 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.322240 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5b0d1-8456-4a87-ba2b-c459200bb2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.322990 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5b0d1-8456-4a87-ba2b-c459200bb2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.323348 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5b0d1-8456-4a87-ba2b-c459200bb2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.323789 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5b0d1-8456-4a87-ba2b-c459200bb2d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.324651 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5b0d1-8456-4a87-ba2b-c459200bb2d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:23.325028 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5b0d1-8456-4a87-ba2b-c459200bb2d4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.326103 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-fea5b0d1-8456-4a87-ba2b-c459200bb2d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:23.326103 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 02:52:23.326103 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 02:52:23.327997 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5b0d1-8456-4a87-ba2b-c459200bb2d4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.330473 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be266ae-36d2-49e9-b1cc-4569e4717968 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.335292 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d846d-e9fd-42e6-819f-60d573283470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.336155 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d846d-e9fd-42e6-819f-60d573283470 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.336629 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d846d-e9fd-42e6-819f-60d573283470 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.337110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d846d-e9fd-42e6-819f-60d573283470 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.338072 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d846d-e9fd-42e6-819f-60d573283470 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:23.338554 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d846d-e9fd-42e6-819f-60d573283470 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.340263 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d846d-e9fd-42e6-819f-60d573283470 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.351345 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 203/413] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:23.351345 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0da3ca-6935-4be6-988e-2e26057c47ba None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.351345 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0da3ca-6935-4be6-988e-2e26057c47ba None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.351345 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0da3ca-6935-4be6-988e-2e26057c47ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.352224 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 211/414] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:23.353050 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d846d-e9fd-42e6-819f-60d573283470 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.366782 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d846d-e9fd-42e6-819f-60d573283470 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.371495 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abda0a4-bd18-425d-ab80-3131d6928dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.372135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abda0a4-bd18-425d-ab80-3131d6928dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.372419 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abda0a4-bd18-425d-ab80-3131d6928dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.372691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abda0a4-bd18-425d-ab80-3131d6928dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.373460 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abda0a4-bd18-425d-ab80-3131d6928dc0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:23.373767 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abda0a4-bd18-425d-ab80-3131d6928dc0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.373877 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-ab0da3ca-6935-4be6-988e-2e26057c47ba None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:23.375750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-1abda0a4-bd18-425d-ab80-3131d6928dc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:23.375750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 02:52:23.375750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 02:52:23.375980 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-ab0da3ca-6935-4be6-988e-2e26057c47ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:23.376897 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abda0a4-bd18-425d-ab80-3131d6928dc0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.383806 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 204/415] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:23.387392 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0da3ca-6935-4be6-988e-2e26057c47ba None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.396636 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0da3ca-6935-4be6-988e-2e26057c47ba None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.401525 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa65fe-8988-4308-aa34-e682827989ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.402362 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa65fe-8988-4308-aa34-e682827989ad admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.402904 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa65fe-8988-4308-aa34-e682827989ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.403439 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa65fe-8988-4308-aa34-e682827989ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.404540 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa65fe-8988-4308-aa34-e682827989ad admin admin] RBAC: Adding query filter params (role.id=ee8894ccdace402484c35b0cb5292526, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=a6bb852fc4394f88800ec9616cb65416) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:23.405113 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa65fe-8988-4308-aa34-e682827989ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.405218 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 212/416] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:23.406645 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abda0a4-bd18-425d-ab80-3131d6928dc0 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.408037 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa65fe-8988-4308-aa34-e682827989ad admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.414307 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 205/417] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/role_assignments?user.id=a6bb852fc4394f88800ec9616cb65416&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=ee8894ccdace402484c35b0cb5292526 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:23.415295 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa65fe-8988-4308-aa34-e682827989ad admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.423853 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abda0a4-bd18-425d-ab80-3131d6928dc0 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.425962 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa65fe-8988-4308-aa34-e682827989ad admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.429618 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcfee9-f19b-4c02-9fd4-27a8a9407188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.430793 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcfee9-f19b-4c02-9fd4-27a8a9407188 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.431086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cca4e-616c-44ff-8c5e-b814f5c4bab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.431465 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcfee9-f19b-4c02-9fd4-27a8a9407188 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.431884 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcfee9-f19b-4c02-9fd4-27a8a9407188 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.432118 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cca4e-616c-44ff-8c5e-b814f5c4bab1 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.432500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cca4e-616c-44ff-8c5e-b814f5c4bab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.432885 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cca4e-616c-44ff-8c5e-b814f5c4bab1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.433992 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cca4e-616c-44ff-8c5e-b814f5c4bab1 admin admin] RBAC: Adding query filter params (role.id=ee8894ccdace402484c35b0cb5292526, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=0d763da11c58473c9c2cf981b02835f3) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:23.434419 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cca4e-616c-44ff-8c5e-b814f5c4bab1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.436482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cca4e-616c-44ff-8c5e-b814f5c4bab1 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.441856 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcfee9-f19b-4c02-9fd4-27a8a9407188 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.443932 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcfee9-f19b-4c02-9fd4-27a8a9407188 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.444478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 206/418] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/role_assignments?user.id=0d763da11c58473c9c2cf981b02835f3&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=ee8894ccdace402484c35b0cb5292526 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:23.445621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cca4e-616c-44ff-8c5e-b814f5c4bab1 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.456716 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cca4e-616c-44ff-8c5e-b814f5c4bab1 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.459008 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-a4bcfee9-f19b-4c02-9fd4-27a8a9407188 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:23.460587 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 213/419] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:23.464309 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874a7b0-34e8-490e-afd5-abe45708c1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.465475 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874a7b0-34e8-490e-afd5-abe45708c1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.466020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874a7b0-34e8-490e-afd5-abe45708c1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.466551 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874a7b0-34e8-490e-afd5-abe45708c1f4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.466987 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcfee9-f19b-4c02-9fd4-27a8a9407188 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.477110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcfee9-f19b-4c02-9fd4-27a8a9407188 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.481456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874a7b0-34e8-490e-afd5-abe45708c1f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:23.481929 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5401f-3233-40cd-a943-199a2a85aaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.482604 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5401f-3233-40cd-a943-199a2a85aaa2 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.482883 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5401f-3233-40cd-a943-199a2a85aaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.483204 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5401f-3233-40cd-a943-199a2a85aaa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.484774 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5401f-3233-40cd-a943-199a2a85aaa2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:23.485091 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5401f-3233-40cd-a943-199a2a85aaa2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.487133 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5401f-3233-40cd-a943-199a2a85aaa2 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.491917 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-6874a7b0-34e8-490e-afd5-abe45708c1f4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:52:23.493525 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 207/420] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:23.507425 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874a7b0-34e8-490e-afd5-abe45708c1f4 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.509757 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 214/421] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:23.516457 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5401f-3233-40cd-a943-199a2a85aaa2 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.526494 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5401f-3233-40cd-a943-199a2a85aaa2 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.526901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874a7b0-34e8-490e-afd5-abe45708c1f4 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.536939 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcce66-d4d9-4c7a-ad53-dedfd267a91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.538404 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcce66-d4d9-4c7a-ad53-dedfd267a91b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.538695 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcce66-d4d9-4c7a-ad53-dedfd267a91b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.538968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcce66-d4d9-4c7a-ad53-dedfd267a91b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.539858 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcce66-d4d9-4c7a-ad53-dedfd267a91b admin admin] RBAC: Adding query filter params (role.id=ee8894ccdace402484c35b0cb5292526, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=2e701dd89a844fe9aa21c3b5e1fc59cf) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:23.540175 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcce66-d4d9-4c7a-ad53-dedfd267a91b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.542113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcce66-d4d9-4c7a-ad53-dedfd267a91b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.544877 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d815fe4-c4fa-49d2-a5bf-9c3ea3c889ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.545565 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d815fe4-c4fa-49d2-a5bf-9c3ea3c889ab admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.545843 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d815fe4-c4fa-49d2-a5bf-9c3ea3c889ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.546821 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d815fe4-c4fa-49d2-a5bf-9c3ea3c889ab admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.547709 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d815fe4-c4fa-49d2-a5bf-9c3ea3c889ab admin admin] RBAC: Adding query filter params (name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:23.548012 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d815fe4-c4fa-49d2-a5bf-9c3ea3c889ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.549692 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d815fe4-c4fa-49d2-a5bf-9c3ea3c889ab admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.559658 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 215/422] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/role_assignments?user.id=2e701dd89a844fe9aa21c3b5e1fc59cf&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=ee8894ccdace402484c35b0cb5292526 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:23.570015 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 208/423] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:23.576969 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcce66-d4d9-4c7a-ad53-dedfd267a91b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.593776 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcce66-d4d9-4c7a-ad53-dedfd267a91b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.603225 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26456b-8b20-4a9e-9747-431d6ca47f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.604104 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26456b-8b20-4a9e-9747-431d6ca47f2d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.604389 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26456b-8b20-4a9e-9747-431d6ca47f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.604667 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26456b-8b20-4a9e-9747-431d6ca47f2d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.620189 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26456b-8b20-4a9e-9747-431d6ca47f2d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.622410 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26456b-8b20-4a9e-9747-431d6ca47f2d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.650070 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-5b26456b-8b20-4a9e-9747-431d6ca47f2d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:23.651690 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 216/424] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:23.658682 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d815fe4-c4fa-49d2-a5bf-9c3ea3c889ab admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.670227 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d815fe4-c4fa-49d2-a5bf-9c3ea3c889ab admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.675277 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda7217-53cd-46e8-ba12-be0d64d499ce None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.675736 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda7217-53cd-46e8-ba12-be0d64d499ce None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.675897 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda7217-53cd-46e8-ba12-be0d64d499ce None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.676147 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04236b0f-e3b6-479f-b7a5-8ce3f3f3bba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.676918 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04236b0f-e3b6-479f-b7a5-8ce3f3f3bba0 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.677198 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04236b0f-e3b6-479f-b7a5-8ce3f3f3bba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.677529 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04236b0f-e3b6-479f-b7a5-8ce3f3f3bba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.677676 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 217/425] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:52:23.678534 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04236b0f-e3b6-479f-b7a5-8ce3f3f3bba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:23.678884 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04236b0f-e3b6-479f-b7a5-8ce3f3f3bba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.681569 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04236b0f-e3b6-479f-b7a5-8ce3f3f3bba0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.685978 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3594d-84a0-40a8-aa9c-794394d8775e None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.686305 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3594d-84a0-40a8-aa9c-794394d8775e None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.686558 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3594d-84a0-40a8-aa9c-794394d8775e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.701967 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 209/426] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:23.703234 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04236b0f-e3b6-479f-b7a5-8ce3f3f3bba0 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.708969 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-2ae3594d-84a0-40a8-aa9c-794394d8775e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:23.711036 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-2ae3594d-84a0-40a8-aa9c-794394d8775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:23.713829 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04236b0f-e3b6-479f-b7a5-8ce3f3f3bba0 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.719199 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee00a9-7de0-428c-b79d-21f442123185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.719987 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee00a9-7de0-428c-b79d-21f442123185 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.720270 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee00a9-7de0-428c-b79d-21f442123185 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.720544 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee00a9-7de0-428c-b79d-21f442123185 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.723469 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 218/427] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:23.740712 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee00a9-7de0-428c-b79d-21f442123185 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.742864 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee00a9-7de0-428c-b79d-21f442123185 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.750818 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3594d-84a0-40a8-aa9c-794394d8775e None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.761323 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3594d-84a0-40a8-aa9c-794394d8775e None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.765809 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-12ee00a9-7de0-428c-b79d-21f442123185 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 02:52:23.767550 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 210/428] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/users/neutron => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:23.773999 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee00a9-7de0-428c-b79d-21f442123185 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.777109 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb0191-def3-4469-a1d3-9f6264f9b9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.777936 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb0191-def3-4469-a1d3-9f6264f9b9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.778272 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb0191-def3-4469-a1d3-9f6264f9b9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.778551 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb0191-def3-4469-a1d3-9f6264f9b9c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.792931 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee00a9-7de0-428c-b79d-21f442123185 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.802122 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb0191-def3-4469-a1d3-9f6264f9b9c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.804960 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae25a03-c561-4874-90da-606fdcff5ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.805838 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae25a03-c561-4874-90da-606fdcff5ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.806216 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae25a03-c561-4874-90da-606fdcff5ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.806626 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae25a03-c561-4874-90da-606fdcff5ca4 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.807593 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae25a03-c561-4874-90da-606fdcff5ca4 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:23.808629 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae25a03-c561-4874-90da-606fdcff5ca4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.809050 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb0191-def3-4469-a1d3-9f6264f9b9c2 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.811418 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae25a03-c561-4874-90da-606fdcff5ca4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.834570 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-b7fb0191-def3-4469-a1d3-9f6264f9b9c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:23.836898 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 219/429] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:23.845738 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 211/430] 10.222.0.39 () {56 vars in 1161 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:23.846816 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb0191-def3-4469-a1d3-9f6264f9b9c2 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.861051 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb0191-def3-4469-a1d3-9f6264f9b9c2 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.863221 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae25a03-c561-4874-90da-606fdcff5ca4 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.875164 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9013f9-9ef5-4821-afc0-a0aa7e6897fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.875933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9013f9-9ef5-4821-afc0-a0aa7e6897fb admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.876284 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9013f9-9ef5-4821-afc0-a0aa7e6897fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.876622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9013f9-9ef5-4821-afc0-a0aa7e6897fb admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.877416 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9013f9-9ef5-4821-afc0-a0aa7e6897fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:23.877788 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9013f9-9ef5-4821-afc0-a0aa7e6897fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.879468 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9013f9-9ef5-4821-afc0-a0aa7e6897fb admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.881621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae25a03-c561-4874-90da-606fdcff5ca4 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.895030 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901e74b-abde-4c97-b907-900762ef11bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.895788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901e74b-abde-4c97-b907-900762ef11bf admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.896140 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901e74b-abde-4c97-b907-900762ef11bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.896480 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901e74b-abde-4c97-b907-900762ef11bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.903526 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 220/431] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:23.907070 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901e74b-abde-4c97-b907-900762ef11bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.908984 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901e74b-abde-4c97-b907-900762ef11bf admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.911263 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9013f9-9ef5-4821-afc0-a0aa7e6897fb admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.923249 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9013f9-9ef5-4821-afc0-a0aa7e6897fb admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.932310 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 212/432] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:23.934783 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ddbb0-7143-4fb8-9326-74650bd48794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.935560 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ddbb0-7143-4fb8-9326-74650bd48794 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.935950 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ddbb0-7143-4fb8-9326-74650bd48794 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.936454 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ddbb0-7143-4fb8-9326-74650bd48794 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.938133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901e74b-abde-4c97-b907-900762ef11bf admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:23.940444 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ddbb0-7143-4fb8-9326-74650bd48794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.942730 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ddbb0-7143-4fb8-9326-74650bd48794 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:23.955812 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901e74b-abde-4c97-b907-900762ef11bf admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:23.964671 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27681390-b055-457d-ab7e-d841a276541e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:23.965947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27681390-b055-457d-ab7e-d841a276541e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:23.967227 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27681390-b055-457d-ab7e-d841a276541e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:23.968230 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27681390-b055-457d-ab7e-d841a276541e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:23.978231 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 221/433] 10.222.0.39 () {60 vars in 1154 bytes} [Tue Aug 31 02:52:23 2021] POST /identity/v3/users => generated 247 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 02:52:23.983990 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27681390-b055-457d-ab7e-d841a276541e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:23.985985 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27681390-b055-457d-ab7e-d841a276541e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:24.005470 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-27681390-b055-457d-ab7e-d841a276541e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:24.006999 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 213/434] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:24.013205 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ddbb0-7143-4fb8-9326-74650bd48794 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:24.025706 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ddbb0-7143-4fb8-9326-74650bd48794 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:24.031593 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f500ce6-7df8-4590-aa52-a37349bb9647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:24.032375 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f500ce6-7df8-4590-aa52-a37349bb9647 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:24.032746 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f500ce6-7df8-4590-aa52-a37349bb9647 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:24.033023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f500ce6-7df8-4590-aa52-a37349bb9647 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:24.033736 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f500ce6-7df8-4590-aa52-a37349bb9647 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:24.034117 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f500ce6-7df8-4590-aa52-a37349bb9647 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:24.035890 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f500ce6-7df8-4590-aa52-a37349bb9647 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:24.055857 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 222/435] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:24.062599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27681390-b055-457d-ab7e-d841a276541e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:24.074949 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27681390-b055-457d-ab7e-d841a276541e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:24.080720 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5355aa5-1a5e-447f-8912-f3c2e2ad7778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:24.081542 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5355aa5-1a5e-447f-8912-f3c2e2ad7778 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:24.081818 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5355aa5-1a5e-447f-8912-f3c2e2ad7778 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:24.082130 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5355aa5-1a5e-447f-8912-f3c2e2ad7778 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:24.091541 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5355aa5-1a5e-447f-8912-f3c2e2ad7778 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:24.093625 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5355aa5-1a5e-447f-8912-f3c2e2ad7778 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:24.107734 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-f5355aa5-1a5e-447f-8912-f3c2e2ad7778 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:24.110523 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 214/436] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:24.118506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f500ce6-7df8-4590-aa52-a37349bb9647 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:24.130055 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f500ce6-7df8-4590-aa52-a37349bb9647 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:24.137112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc9b50-4016-4e8e-a996-323ce68bf6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:24.137780 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc9b50-4016-4e8e-a996-323ce68bf6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:24.138115 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc9b50-4016-4e8e-a996-323ce68bf6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:24.138418 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc9b50-4016-4e8e-a996-323ce68bf6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:24.139207 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc9b50-4016-4e8e-a996-323ce68bf6d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:24.139577 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc9b50-4016-4e8e-a996-323ce68bf6d9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:24.141560 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc9b50-4016-4e8e-a996-323ce68bf6d9 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:24.159517 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 223/437] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:24.165695 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5355aa5-1a5e-447f-8912-f3c2e2ad7778 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:24.178047 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5355aa5-1a5e-447f-8912-f3c2e2ad7778 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:24.188595 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516dc8f-6c21-4a7c-a531-275f2127168a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:24.189228 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516dc8f-6c21-4a7c-a531-275f2127168a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:24.189506 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516dc8f-6c21-4a7c-a531-275f2127168a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:24.189788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516dc8f-6c21-4a7c-a531-275f2127168a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:24.190668 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516dc8f-6c21-4a7c-a531-275f2127168a admin admin] RBAC: Adding query filter params (role.id=ee8894ccdace402484c35b0cb5292526, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=18b73b8e7244410b8f701b2ab43c5979) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:24.191042 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516dc8f-6c21-4a7c-a531-275f2127168a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:24.193045 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516dc8f-6c21-4a7c-a531-275f2127168a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:24.203962 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 215/438] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:24 2021] GET /identity/v3/role_assignments?user.id=18b73b8e7244410b8f701b2ab43c5979&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=ee8894ccdace402484c35b0cb5292526 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:26.147007 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e285122-0f85-4bba-bf5e-4e7b5b37ce2c None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.147568 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e285122-0f85-4bba-bf5e-4e7b5b37ce2c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.147568 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e285122-0f85-4bba-bf5e-4e7b5b37ce2c None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.149521 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 224/439] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:26.155280 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487e82a-8ac8-4b17-a995-b1b153d3ebea None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.156125 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487e82a-8ac8-4b17-a995-b1b153d3ebea None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.156628 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487e82a-8ac8-4b17-a995-b1b153d3ebea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.179998 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-0487e82a-8ac8-4b17-a995-b1b153d3ebea None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:26.181620 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0487e82a-8ac8-4b17-a995-b1b153d3ebea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:26.194384 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 216/440] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:26.241770 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e285122-0f85-4bba-bf5e-4e7b5b37ce2c None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.257256 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e285122-0f85-4bba-bf5e-4e7b5b37ce2c None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.262344 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3f12e-0c06-4e23-b869-f8d7c47b90a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.263135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3f12e-0c06-4e23-b869-f8d7c47b90a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.263436 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3f12e-0c06-4e23-b869-f8d7c47b90a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.263709 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3f12e-0c06-4e23-b869-f8d7c47b90a7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.284112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3f12e-0c06-4e23-b869-f8d7c47b90a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:26.284975 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddd65f-e9b1-4567-bceb-4623eb750828 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.285494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddd65f-e9b1-4567-bceb-4623eb750828 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.285984 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddd65f-e9b1-4567-bceb-4623eb750828 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.288282 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 217/441] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:26.291188 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-3ff3f12e-0c06-4e23-b869-f8d7c47b90a7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:52:26.292682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 225/442] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:26.299870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddd65f-e9b1-4567-bceb-4623eb750828 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.305120 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a6e1f-74a0-40ba-981a-3a74e7201376 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.305409 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a6e1f-74a0-40ba-981a-3a74e7201376 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.305690 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a6e1f-74a0-40ba-981a-3a74e7201376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.321268 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddd65f-e9b1-4567-bceb-4623eb750828 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.324794 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-db5a6e1f-74a0-40ba-981a-3a74e7201376 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:26.326140 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-db5a6e1f-74a0-40ba-981a-3a74e7201376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:26.330227 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b5753-9e71-4d08-98e6-bd539f5a3b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.331302 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b5753-9e71-4d08-98e6-bd539f5a3b9a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.331844 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b5753-9e71-4d08-98e6-bd539f5a3b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.332330 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b5753-9e71-4d08-98e6-bd539f5a3b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.333303 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b5753-9e71-4d08-98e6-bd539f5a3b9a admin admin] RBAC: Adding query filter params (name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:26.333840 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b5753-9e71-4d08-98e6-bd539f5a3b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.335714 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b5753-9e71-4d08-98e6-bd539f5a3b9a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.346669 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 218/443] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:26.351388 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 226/444] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:26.353933 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b5753-9e71-4d08-98e6-bd539f5a3b9a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.363999 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b5753-9e71-4d08-98e6-bd539f5a3b9a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.371789 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a6e1f-74a0-40ba-981a-3a74e7201376 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.374512 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458bde7-6a13-4005-9ef3-33dda3c2fb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.375568 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458bde7-6a13-4005-9ef3-33dda3c2fb6b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.376089 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458bde7-6a13-4005-9ef3-33dda3c2fb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.376575 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458bde7-6a13-4005-9ef3-33dda3c2fb6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.388071 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458bde7-6a13-4005-9ef3-33dda3c2fb6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.391095 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458bde7-6a13-4005-9ef3-33dda3c2fb6b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.393909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a6e1f-74a0-40ba-981a-3a74e7201376 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.409408 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-7458bde7-6a13-4005-9ef3-33dda3c2fb6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:26.411222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 219/445] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:26.416329 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642a4d3-9c8f-41cd-b257-a6cc4f65f113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.417139 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642a4d3-9c8f-41cd-b257-a6cc4f65f113 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.417390 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458bde7-6a13-4005-9ef3-33dda3c2fb6b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.417501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642a4d3-9c8f-41cd-b257-a6cc4f65f113 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.417668 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642a4d3-9c8f-41cd-b257-a6cc4f65f113 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.428393 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458bde7-6a13-4005-9ef3-33dda3c2fb6b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.433394 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1406b-e205-435c-83ae-c961657a787d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.434347 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1406b-e205-435c-83ae-c961657a787d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.434853 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1406b-e205-435c-83ae-c961657a787d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.435412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1406b-e205-435c-83ae-c961657a787d admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.436376 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1406b-e205-435c-83ae-c961657a787d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:26.437557 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1406b-e205-435c-83ae-c961657a787d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.439458 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1406b-e205-435c-83ae-c961657a787d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.439589 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642a4d3-9c8f-41cd-b257-a6cc4f65f113 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:26.446428 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-b642a4d3-9c8f-41cd-b257-a6cc4f65f113 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:52:26.453398 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 227/447] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:26.453679 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 220/447] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:26.454761 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e315f1-5b52-4788-9370-dce873c756dd None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.455054 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e315f1-5b52-4788-9370-dce873c756dd None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.455308 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1406b-e205-435c-83ae-c961657a787d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.455446 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e315f1-5b52-4788-9370-dce873c756dd None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.457383 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 228/448] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:26.463187 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e315f1-5b52-4788-9370-dce873c756dd None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.467819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1406b-e205-435c-83ae-c961657a787d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.472515 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce096bbe-b70e-4108-aea2-fdab25046a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.473172 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce096bbe-b70e-4108-aea2-fdab25046a69 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.473449 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce096bbe-b70e-4108-aea2-fdab25046a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.473727 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce096bbe-b70e-4108-aea2-fdab25046a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.474468 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce096bbe-b70e-4108-aea2-fdab25046a69 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:26.474772 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce096bbe-b70e-4108-aea2-fdab25046a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.476432 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce096bbe-b70e-4108-aea2-fdab25046a69 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.481437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e315f1-5b52-4788-9370-dce873c756dd None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.485787 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 221/449] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:26.487126 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe4f64-b292-41ae-96ed-a97aafb0fbe0 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.487438 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe4f64-b292-41ae-96ed-a97aafb0fbe0 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.487717 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe4f64-b292-41ae-96ed-a97aafb0fbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.488831 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58673468-550a-4e00-9b19-360eda75c8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.490093 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58673468-550a-4e00-9b19-360eda75c8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.490797 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58673468-550a-4e00-9b19-360eda75c8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.491489 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58673468-550a-4e00-9b19-360eda75c8f9 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.502836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58673468-550a-4e00-9b19-360eda75c8f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.505439 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58673468-550a-4e00-9b19-360eda75c8f9 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.505837 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-0bfe4f64-b292-41ae-96ed-a97aafb0fbe0 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:26.507209 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0bfe4f64-b292-41ae-96ed-a97aafb0fbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:26.515781 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 222/450] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:26.516677 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe4f64-b292-41ae-96ed-a97aafb0fbe0 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.522392 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-58673468-550a-4e00-9b19-360eda75c8f9 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 02:52:26.524184 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 229/451] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/users/cinder => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:26.529784 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58673468-550a-4e00-9b19-360eda75c8f9 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.543432 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe4f64-b292-41ae-96ed-a97aafb0fbe0 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.544165 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58673468-550a-4e00-9b19-360eda75c8f9 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.553312 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3f382-ee46-4e3c-a8e9-4b6a80b1ed5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.553919 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76d393-1ca6-44fe-84a5-0f28727dc47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.554817 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76d393-1ca6-44fe-84a5-0f28727dc47d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.555939 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76d393-1ca6-44fe-84a5-0f28727dc47d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.556237 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76d393-1ca6-44fe-84a5-0f28727dc47d admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.556500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3f382-ee46-4e3c-a8e9-4b6a80b1ed5d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.556982 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3f382-ee46-4e3c-a8e9-4b6a80b1ed5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.557092 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76d393-1ca6-44fe-84a5-0f28727dc47d admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:26.557404 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76d393-1ca6-44fe-84a5-0f28727dc47d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.557773 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3f382-ee46-4e3c-a8e9-4b6a80b1ed5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.559271 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76d393-1ca6-44fe-84a5-0f28727dc47d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.569927 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3f382-ee46-4e3c-a8e9-4b6a80b1ed5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.572293 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3f382-ee46-4e3c-a8e9-4b6a80b1ed5d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.580078 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 230/452] 10.222.0.39 () {56 vars in 1159 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:26.580991 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76d393-1ca6-44fe-84a5-0f28727dc47d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.594541 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-a7d3f382-ee46-4e3c-a8e9-4b6a80b1ed5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:26.596541 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 223/453] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:26.597676 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3f382-ee46-4e3c-a8e9-4b6a80b1ed5d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.605216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76d393-1ca6-44fe-84a5-0f28727dc47d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.609740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3f382-ee46-4e3c-a8e9-4b6a80b1ed5d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.609919 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f107e3f-9e37-4e5c-9a4d-161a2a9de35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.610681 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f107e3f-9e37-4e5c-9a4d-161a2a9de35b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.610962 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f107e3f-9e37-4e5c-9a4d-161a2a9de35b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.611266 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f107e3f-9e37-4e5c-9a4d-161a2a9de35b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.615572 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d79abd-6596-4c60-8ef2-055a892fe4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.616689 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d79abd-6596-4c60-8ef2-055a892fe4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.617174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d79abd-6596-4c60-8ef2-055a892fe4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.617758 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d79abd-6596-4c60-8ef2-055a892fe4c4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.622421 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f107e3f-9e37-4e5c-9a4d-161a2a9de35b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:26.629516 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-2f107e3f-9e37-4e5c-9a4d-161a2a9de35b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:52:26.630553 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d79abd-6596-4c60-8ef2-055a892fe4c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.631043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 231/454] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:26.631934 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f107e3f-9e37-4e5c-9a4d-161a2a9de35b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.633589 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d79abd-6596-4c60-8ef2-055a892fe4c4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.642357 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f107e3f-9e37-4e5c-9a4d-161a2a9de35b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.646972 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863b12a-0748-4363-aba8-fbb7b767ab58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.647658 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863b12a-0748-4363-aba8-fbb7b767ab58 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.647928 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863b12a-0748-4363-aba8-fbb7b767ab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.648205 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863b12a-0748-4363-aba8-fbb7b767ab58 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.648919 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863b12a-0748-4363-aba8-fbb7b767ab58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:26.649227 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863b12a-0748-4363-aba8-fbb7b767ab58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.650829 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863b12a-0748-4363-aba8-fbb7b767ab58 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.655113 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-75d79abd-6596-4c60-8ef2-055a892fe4c4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:26.658121 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 224/455] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:26.659261 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d79abd-6596-4c60-8ef2-055a892fe4c4 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.669138 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 232/456] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:26.669904 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863b12a-0748-4363-aba8-fbb7b767ab58 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.670768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d79abd-6596-4c60-8ef2-055a892fe4c4 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.676346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e1813-3648-40c3-b18a-4cf4929c365b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.677307 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e1813-3648-40c3-b18a-4cf4929c365b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.677806 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e1813-3648-40c3-b18a-4cf4929c365b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.678285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e1813-3648-40c3-b18a-4cf4929c365b admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.679225 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e1813-3648-40c3-b18a-4cf4929c365b admin admin] RBAC: Adding query filter params (name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:26.679771 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e1813-3648-40c3-b18a-4cf4929c365b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.680215 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863b12a-0748-4363-aba8-fbb7b767ab58 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.682046 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e1813-3648-40c3-b18a-4cf4929c365b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.684911 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089552e-6206-47be-8169-6720cc89278e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.685285 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089552e-6206-47be-8169-6720cc89278e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.685570 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089552e-6206-47be-8169-6720cc89278e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.685845 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089552e-6206-47be-8169-6720cc89278e admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.686705 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089552e-6206-47be-8169-6720cc89278e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:26.687134 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089552e-6206-47be-8169-6720cc89278e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.689075 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089552e-6206-47be-8169-6720cc89278e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.693021 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 225/457] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:26.694669 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8432c-aa7b-4d4e-9751-f69c6c32a8c5 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.695168 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8432c-aa7b-4d4e-9751-f69c6c32a8c5 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.695696 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8432c-aa7b-4d4e-9751-f69c6c32a8c5 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.697571 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 226/458] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:26.698272 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8432c-aa7b-4d4e-9751-f69c6c32a8c5 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.706385 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 233/459] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:26.706385 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089552e-6206-47be-8169-6720cc89278e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.712339 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8432c-aa7b-4d4e-9751-f69c6c32a8c5 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.715223 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089552e-6206-47be-8169-6720cc89278e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.716950 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34070739-bb68-4417-81f8-f316afbeecf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.717850 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34070739-bb68-4417-81f8-f316afbeecf2 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.718234 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34070739-bb68-4417-81f8-f316afbeecf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.718619 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34070739-bb68-4417-81f8-f316afbeecf2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.720530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23309868-25a0-4bf1-8479-25988dc828f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.721317 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23309868-25a0-4bf1-8479-25988dc828f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.721993 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23309868-25a0-4bf1-8479-25988dc828f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.721993 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23309868-25a0-4bf1-8479-25988dc828f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.727042 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34070739-bb68-4417-81f8-f316afbeecf2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.729254 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34070739-bb68-4417-81f8-f316afbeecf2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.732973 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23309868-25a0-4bf1-8479-25988dc828f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.735098 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23309868-25a0-4bf1-8479-25988dc828f1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.744339 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-34070739-bb68-4417-81f8-f316afbeecf2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 02:52:26.745724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 227/460] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:26.749996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2aee58-74e4-4b86-b4c6-f3480cc03ce8 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.750327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2aee58-74e4-4b86-b4c6-f3480cc03ce8 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.750580 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2aee58-74e4-4b86-b4c6-f3480cc03ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.757195 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-23309868-25a0-4bf1-8479-25988dc828f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:26.758676 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 234/461] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:26.759513 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23309868-25a0-4bf1-8479-25988dc828f1 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.770808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23309868-25a0-4bf1-8479-25988dc828f1 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.773586 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-1c2aee58-74e4-4b86-b4c6-f3480cc03ce8 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:26.774780 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1c2aee58-74e4-4b86-b4c6-f3480cc03ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:26.775167 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcb079-a5eb-4689-b1f0-26d80b29d59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.775972 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcb079-a5eb-4689-b1f0-26d80b29d59d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.776254 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcb079-a5eb-4689-b1f0-26d80b29d59d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.776542 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcb079-a5eb-4689-b1f0-26d80b29d59d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.783058 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 228/462] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:26.784341 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcb079-a5eb-4689-b1f0-26d80b29d59d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.786471 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcb079-a5eb-4689-b1f0-26d80b29d59d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.787704 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2aee58-74e4-4b86-b4c6-f3480cc03ce8 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.798434 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2aee58-74e4-4b86-b4c6-f3480cc03ce8 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.802476 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-e0fcb079-a5eb-4689-b1f0-26d80b29d59d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:26.803509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3fd19-37a9-4d50-b938-321caee6d93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.804086 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 235/463] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:26.804985 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3fd19-37a9-4d50-b938-321caee6d93d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.805489 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3fd19-37a9-4d50-b938-321caee6d93d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.805967 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3fd19-37a9-4d50-b938-321caee6d93d admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.807018 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3fd19-37a9-4d50-b938-321caee6d93d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:26.807580 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3fd19-37a9-4d50-b938-321caee6d93d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.809963 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcb079-a5eb-4689-b1f0-26d80b29d59d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.810307 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3fd19-37a9-4d50-b938-321caee6d93d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.820968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcb079-a5eb-4689-b1f0-26d80b29d59d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.826913 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03432a-84dd-41ce-8428-27fe06f22a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.827732 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03432a-84dd-41ce-8428-27fe06f22a2f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.828014 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03432a-84dd-41ce-8428-27fe06f22a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.828285 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03432a-84dd-41ce-8428-27fe06f22a2f admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.829019 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03432a-84dd-41ce-8428-27fe06f22a2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:26.829334 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03432a-84dd-41ce-8428-27fe06f22a2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.830984 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03432a-84dd-41ce-8428-27fe06f22a2f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.835728 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 229/464] 10.222.0.39 () {56 vars in 1155 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:26.836988 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3fd19-37a9-4d50-b938-321caee6d93d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.845845 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 236/465] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:26.846525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03432a-84dd-41ce-8428-27fe06f22a2f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.855726 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3fd19-37a9-4d50-b938-321caee6d93d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.862735 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db82b55-4494-4bf4-b8f2-70571b3c6f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.863748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db82b55-4494-4bf4-b8f2-70571b3c6f85 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.863855 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03432a-84dd-41ce-8428-27fe06f22a2f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.864354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db82b55-4494-4bf4-b8f2-70571b3c6f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.864872 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db82b55-4494-4bf4-b8f2-70571b3c6f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.866057 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db82b55-4494-4bf4-b8f2-70571b3c6f85 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:26.866586 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db82b55-4494-4bf4-b8f2-70571b3c6f85 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.868593 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29439ba8-33d2-4170-941f-64eb040ef324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.869150 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db82b55-4494-4bf4-b8f2-70571b3c6f85 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.869375 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29439ba8-33d2-4170-941f-64eb040ef324 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.869666 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29439ba8-33d2-4170-941f-64eb040ef324 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.869943 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29439ba8-33d2-4170-941f-64eb040ef324 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.882585 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29439ba8-33d2-4170-941f-64eb040ef324 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:26.888581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 230/466] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:26.888581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db82b55-4494-4bf4-b8f2-70571b3c6f85 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.889348 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-29439ba8-33d2-4170-941f-64eb040ef324 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:52:26.890638 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 237/467] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:26.892234 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29439ba8-33d2-4170-941f-64eb040ef324 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.899060 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db82b55-4494-4bf4-b8f2-70571b3c6f85 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.903112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29439ba8-33d2-4170-941f-64eb040ef324 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.903842 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c38097-d86c-44eb-abcb-244baf538a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.904775 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c38097-d86c-44eb-abcb-244baf538a02 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.905060 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c38097-d86c-44eb-abcb-244baf538a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.906312 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c38097-d86c-44eb-abcb-244baf538a02 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.908407 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384a388-964f-4f63-9034-55bb9731ef52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.909174 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384a388-964f-4f63-9034-55bb9731ef52 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.909755 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384a388-964f-4f63-9034-55bb9731ef52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.909865 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384a388-964f-4f63-9034-55bb9731ef52 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.917227 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384a388-964f-4f63-9034-55bb9731ef52 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.917912 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c38097-d86c-44eb-abcb-244baf538a02 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.919278 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384a388-964f-4f63-9034-55bb9731ef52 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.919762 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c38097-d86c-44eb-abcb-244baf538a02 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.933867 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-d384a388-964f-4f63-9034-55bb9731ef52 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 02:52:26.935013 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 238/468] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/users/glance => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:26.935780 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384a388-964f-4f63-9034-55bb9731ef52 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.936526 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-32c38097-d86c-44eb-abcb-244baf538a02 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:26.941036 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 231/469] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:26.941036 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c38097-d86c-44eb-abcb-244baf538a02 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.947610 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384a388-964f-4f63-9034-55bb9731ef52 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.950196 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c38097-d86c-44eb-abcb-244baf538a02 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:26.951992 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c85ef7-307c-49f3-8676-cd1e75778847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.953109 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c85ef7-307c-49f3-8676-cd1e75778847 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.953395 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c85ef7-307c-49f3-8676-cd1e75778847 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.953670 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c85ef7-307c-49f3-8676-cd1e75778847 admin admin] PATH_INFO: `/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/2e701dd89a844fe9aa21c3b5e1fc59cf/roles/ee8894ccdace402484c35b0cb5292526` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.955324 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedfd4c-e3d0-4b35-bf4f-8d2bcdc817c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:26.956298 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedfd4c-e3d0-4b35-bf4f-8d2bcdc817c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.956791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedfd4c-e3d0-4b35-bf4f-8d2bcdc817c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.957270 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedfd4c-e3d0-4b35-bf4f-8d2bcdc817c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.958455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedfd4c-e3d0-4b35-bf4f-8d2bcdc817c8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:26.958768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedfd4c-e3d0-4b35-bf4f-8d2bcdc817c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.960998 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedfd4c-e3d0-4b35-bf4f-8d2bcdc817c8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.968621 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c85ef7-307c-49f3-8676-cd1e75778847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011ec8d2410644a3b7d51a90f803b441, user_id=2e701dd89a844fe9aa21c3b5e1fc59cf, role_id=ee8894ccdace402484c35b0cb5292526)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:26.970452 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 232/470] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:26.971228 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c85ef7-307c-49f3-8676-cd1e75778847 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:26.971726 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75e820-76fd-49c7-8306-e746a4d50cd4 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:26.972010 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75e820-76fd-49c7-8306-e746a4d50cd4 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:26.972286 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75e820-76fd-49c7-8306-e746a4d50cd4 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:26.974059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 233/471] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:26.974576 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75e820-76fd-49c7-8306-e746a4d50cd4 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:26.985966 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 239/472] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:52:26 2021] PUT /identity/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/2e701dd89a844fe9aa21c3b5e1fc59cf/roles/ee8894ccdace402484c35b0cb5292526 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:52:26.986558 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c85ef7-307c-49f3-8676-cd1e75778847 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.002733 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75e820-76fd-49c7-8306-e746a4d50cd4 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.052225 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c85ef7-307c-49f3-8676-cd1e75778847 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.057304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4be754-3e4a-45e6-85e7-9b93ed4ab2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.057982 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4be754-3e4a-45e6-85e7-9b93ed4ab2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.058261 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4be754-3e4a-45e6-85e7-9b93ed4ab2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.058528 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4be754-3e4a-45e6-85e7-9b93ed4ab2f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.059239 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4be754-3e4a-45e6-85e7-9b93ed4ab2f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:27.059577 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4be754-3e4a-45e6-85e7-9b93ed4ab2f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.061180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4be754-3e4a-45e6-85e7-9b93ed4ab2f4 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.061982 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8170ac-4d1f-42c9-8ff6-58481f5524ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.062721 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8170ac-4d1f-42c9-8ff6-58481f5524ae admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.063016 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8170ac-4d1f-42c9-8ff6-58481f5524ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.063292 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8170ac-4d1f-42c9-8ff6-58481f5524ae admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.064177 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8170ac-4d1f-42c9-8ff6-58481f5524ae admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:27.064486 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8170ac-4d1f-42c9-8ff6-58481f5524ae admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.066370 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8170ac-4d1f-42c9-8ff6-58481f5524ae admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.074801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 240/473] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:27.075650 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4be754-3e4a-45e6-85e7-9b93ed4ab2f4 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.088210 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 234/474] 10.222.0.39 () {56 vars in 1159 bytes} [Tue Aug 31 02:52:26 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:27.088436 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4be754-3e4a-45e6-85e7-9b93ed4ab2f4 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.090235 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b67fc-0c43-433e-96cd-cc2b8e995f3a None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.090593 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b67fc-0c43-433e-96cd-cc2b8e995f3a None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.090939 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b67fc-0c43-433e-96cd-cc2b8e995f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.097586 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8b64c-95a1-40e4-88f3-318f7a09f06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.098715 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8b64c-95a1-40e4-88f3-318f7a09f06b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.099003 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8b64c-95a1-40e4-88f3-318f7a09f06b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.099280 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8b64c-95a1-40e4-88f3-318f7a09f06b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.111334 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-167b67fc-0c43-433e-96cd-cc2b8e995f3a None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:27.112654 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-167b67fc-0c43-433e-96cd-cc2b8e995f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:27.113666 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8b64c-95a1-40e4-88f3-318f7a09f06b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.115821 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8b64c-95a1-40e4-88f3-318f7a09f06b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.125771 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 235/475] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:27.135658 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b67fc-0c43-433e-96cd-cc2b8e995f3a None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.140965 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-aaf8b64c-95a1-40e4-88f3-318f7a09f06b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:27.141563 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b67fc-0c43-433e-96cd-cc2b8e995f3a None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.144173 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 241/476] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:27.146731 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fdb60-0e40-4a24-a015-0fe17f6458e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.147606 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fdb60-0e40-4a24-a015-0fe17f6458e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.147889 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fdb60-0e40-4a24-a015-0fe17f6458e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.148162 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fdb60-0e40-4a24-a015-0fe17f6458e6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.150098 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8b64c-95a1-40e4-88f3-318f7a09f06b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.157831 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fdb60-0e40-4a24-a015-0fe17f6458e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.159947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fdb60-0e40-4a24-a015-0fe17f6458e6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.164005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8b64c-95a1-40e4-88f3-318f7a09f06b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.169925 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62420f24-bbbe-4e66-b039-37380ca10a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.172030 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62420f24-bbbe-4e66-b039-37380ca10a5b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.172030 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62420f24-bbbe-4e66-b039-37380ca10a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.172030 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62420f24-bbbe-4e66-b039-37380ca10a5b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.174839 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-372fdb60-0e40-4a24-a015-0fe17f6458e6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:27.176069 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 236/477] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:27.176834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fdb60-0e40-4a24-a015-0fe17f6458e6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.184504 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62420f24-bbbe-4e66-b039-37380ca10a5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.186664 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62420f24-bbbe-4e66-b039-37380ca10a5b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.187327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fdb60-0e40-4a24-a015-0fe17f6458e6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.191750 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abe0b8-051c-475a-b48b-d26968510b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.192388 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abe0b8-051c-475a-b48b-d26968510b5f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.192676 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abe0b8-051c-475a-b48b-d26968510b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.192928 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abe0b8-051c-475a-b48b-d26968510b5f admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.193635 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abe0b8-051c-475a-b48b-d26968510b5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:27.193934 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abe0b8-051c-475a-b48b-d26968510b5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.195587 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abe0b8-051c-475a-b48b-d26968510b5f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.204063 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-62420f24-bbbe-4e66-b039-37380ca10a5b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:27.207527 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 242/478] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:27.207527 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62420f24-bbbe-4e66-b039-37380ca10a5b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.210297 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 237/479] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:27.211250 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abe0b8-051c-475a-b48b-d26968510b5f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.220088 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62420f24-bbbe-4e66-b039-37380ca10a5b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.221780 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abe0b8-051c-475a-b48b-d26968510b5f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.224533 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0fa92-0618-4b15-b15a-5cd352f2322e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.225303 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0fa92-0618-4b15-b15a-5cd352f2322e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.225577 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0fa92-0618-4b15-b15a-5cd352f2322e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.225847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0fa92-0618-4b15-b15a-5cd352f2322e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.226135 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86fffe-df8c-43b6-8b9a-8e8218e11839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.226764 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86fffe-df8c-43b6-8b9a-8e8218e11839 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.227040 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86fffe-df8c-43b6-8b9a-8e8218e11839 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.227312 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86fffe-df8c-43b6-8b9a-8e8218e11839 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.228103 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86fffe-df8c-43b6-8b9a-8e8218e11839 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:27.228408 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86fffe-df8c-43b6-8b9a-8e8218e11839 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.230216 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86fffe-df8c-43b6-8b9a-8e8218e11839 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.237587 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0fa92-0618-4b15-b15a-5cd352f2322e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:27.242730 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 238/480] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:27.248477 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86fffe-df8c-43b6-8b9a-8e8218e11839 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.248615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-eda0fa92-0618-4b15-b15a-5cd352f2322e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:52:27.248615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 243/481] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:27.248615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0fa92-0618-4b15-b15a-5cd352f2322e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.257806 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0fa92-0618-4b15-b15a-5cd352f2322e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.262209 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4d510-a9db-49fb-a8e1-c77d60dc6e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.262701 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86fffe-df8c-43b6-8b9a-8e8218e11839 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.262954 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4d510-a9db-49fb-a8e1-c77d60dc6e14 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.263232 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4d510-a9db-49fb-a8e1-c77d60dc6e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.263536 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4d510-a9db-49fb-a8e1-c77d60dc6e14 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.268580 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487975d-c679-42d6-8cb1-331bed26b836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.269236 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487975d-c679-42d6-8cb1-331bed26b836 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.269525 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487975d-c679-42d6-8cb1-331bed26b836 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.269804 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487975d-c679-42d6-8cb1-331bed26b836 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.270683 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487975d-c679-42d6-8cb1-331bed26b836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:27.271119 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487975d-c679-42d6-8cb1-331bed26b836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.271496 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4d510-a9db-49fb-a8e1-c77d60dc6e14 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.272758 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487975d-c679-42d6-8cb1-331bed26b836 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.273498 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4d510-a9db-49fb-a8e1-c77d60dc6e14 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.290207 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 239/482] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:27.290207 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487975d-c679-42d6-8cb1-331bed26b836 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.290446 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-0bb4d510-a9db-49fb-a8e1-c77d60dc6e14 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 02:52:27.290446 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 244/483] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/users/neutron => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:27.290446 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4d510-a9db-49fb-a8e1-c77d60dc6e14 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.299944 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4d510-a9db-49fb-a8e1-c77d60dc6e14 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.303193 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487975d-c679-42d6-8cb1-331bed26b836 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.304602 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc965d-f08f-4a6c-bbc8-3c0292755094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.305224 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc965d-f08f-4a6c-bbc8-3c0292755094 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.305550 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc965d-f08f-4a6c-bbc8-3c0292755094 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.305822 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc965d-f08f-4a6c-bbc8-3c0292755094 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.306602 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc965d-f08f-4a6c-bbc8-3c0292755094 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:27.306905 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc965d-f08f-4a6c-bbc8-3c0292755094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.307843 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8b12e-2e27-4ac6-af25-f5790a59581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.308648 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc965d-f08f-4a6c-bbc8-3c0292755094 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.308751 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8b12e-2e27-4ac6-af25-f5790a59581d admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.308970 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8b12e-2e27-4ac6-af25-f5790a59581d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.309241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8b12e-2e27-4ac6-af25-f5790a59581d admin admin] PATH_INFO: `/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/a6bb852fc4394f88800ec9616cb65416/roles/ee8894ccdace402484c35b0cb5292526` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.322039 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 245/484] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:27.322039 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc965d-f08f-4a6c-bbc8-3c0292755094 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.329976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8b12e-2e27-4ac6-af25-f5790a59581d admin admin] RBAC: Authorizing `identity:create_grant(project_id=011ec8d2410644a3b7d51a90f803b441, user_id=a6bb852fc4394f88800ec9616cb65416, role_id=ee8894ccdace402484c35b0cb5292526)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.331671 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc965d-f08f-4a6c-bbc8-3c0292755094 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.332654 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8b12e-2e27-4ac6-af25-f5790a59581d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.335974 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740671e-176b-4a6c-a7c2-d43d3ef38a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.336785 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740671e-176b-4a6c-a7c2-d43d3ef38a4f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.337016 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740671e-176b-4a6c-a7c2-d43d3ef38a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.337322 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740671e-176b-4a6c-a7c2-d43d3ef38a4f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.345427 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740671e-176b-4a6c-a7c2-d43d3ef38a4f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.355606 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 240/485] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:52:27 2021] PUT /identity/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/a6bb852fc4394f88800ec9616cb65416/roles/ee8894ccdace402484c35b0cb5292526 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:52:27.355606 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8b12e-2e27-4ac6-af25-f5790a59581d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.355890 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740671e-176b-4a6c-a7c2-d43d3ef38a4f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.372101 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-9740671e-176b-4a6c-a7c2-d43d3ef38a4f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:27.373488 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 246/486] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:27.374421 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740671e-176b-4a6c-a7c2-d43d3ef38a4f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.385141 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740671e-176b-4a6c-a7c2-d43d3ef38a4f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.444356 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8b12e-2e27-4ac6-af25-f5790a59581d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.450726 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90dbaa-2752-4fd5-bb51-99c9708b9a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.451494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90dbaa-2752-4fd5-bb51-99c9708b9a59 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.451778 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90dbaa-2752-4fd5-bb51-99c9708b9a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.452581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90dbaa-2752-4fd5-bb51-99c9708b9a59 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.453519 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90dbaa-2752-4fd5-bb51-99c9708b9a59 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:27.453836 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90dbaa-2752-4fd5-bb51-99c9708b9a59 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.455858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90dbaa-2752-4fd5-bb51-99c9708b9a59 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.456719 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63273e-0cf3-4f70-8896-0fd094961d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.457613 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63273e-0cf3-4f70-8896-0fd094961d16 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.457964 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63273e-0cf3-4f70-8896-0fd094961d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.458298 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63273e-0cf3-4f70-8896-0fd094961d16 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.476175 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63273e-0cf3-4f70-8896-0fd094961d16 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.478499 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63273e-0cf3-4f70-8896-0fd094961d16 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.478612 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 241/487] 10.222.0.39 () {56 vars in 1161 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:27.479619 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90dbaa-2752-4fd5-bb51-99c9708b9a59 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.502711 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90dbaa-2752-4fd5-bb51-99c9708b9a59 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.507412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722e0bf-695e-4563-978b-23fe04e66a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.508131 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722e0bf-695e-4563-978b-23fe04e66a5d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.508414 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722e0bf-695e-4563-978b-23fe04e66a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.508743 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722e0bf-695e-4563-978b-23fe04e66a5d admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.509532 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722e0bf-695e-4563-978b-23fe04e66a5d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:27.509847 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722e0bf-695e-4563-978b-23fe04e66a5d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.510901 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-1e63273e-0cf3-4f70-8896-0fd094961d16 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:27.511882 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722e0bf-695e-4563-978b-23fe04e66a5d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.512703 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 247/488] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 139 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:27.520225 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63273e-0cf3-4f70-8896-0fd094961d16 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.526125 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 242/489] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:27.526960 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722e0bf-695e-4563-978b-23fe04e66a5d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.533904 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63273e-0cf3-4f70-8896-0fd094961d16 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.538816 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33681b17-d6a3-431d-bd0c-ab517eebb2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.539903 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33681b17-d6a3-431d-bd0c-ab517eebb2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.540412 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33681b17-d6a3-431d-bd0c-ab517eebb2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.540888 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33681b17-d6a3-431d-bd0c-ab517eebb2c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.544261 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722e0bf-695e-4563-978b-23fe04e66a5d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.551863 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59216f9-af50-49e8-b7eb-69c0ace44e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.552569 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59216f9-af50-49e8-b7eb-69c0ace44e1a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.552848 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59216f9-af50-49e8-b7eb-69c0ace44e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.553119 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59216f9-af50-49e8-b7eb-69c0ace44e1a admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.553834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59216f9-af50-49e8-b7eb-69c0ace44e1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:27.554136 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59216f9-af50-49e8-b7eb-69c0ace44e1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.555759 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59216f9-af50-49e8-b7eb-69c0ace44e1a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.556714 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33681b17-d6a3-431d-bd0c-ab517eebb2c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.558866 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33681b17-d6a3-431d-bd0c-ab517eebb2c3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.569035 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 243/490] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:27.569674 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59216f9-af50-49e8-b7eb-69c0ace44e1a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.579609 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59216f9-af50-49e8-b7eb-69c0ace44e1a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.583748 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-33681b17-d6a3-431d-bd0c-ab517eebb2c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:27.584024 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745e431-74a8-4ae8-a13a-48cff010662b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.584884 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745e431-74a8-4ae8-a13a-48cff010662b admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.584994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 248/491] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:27.585169 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745e431-74a8-4ae8-a13a-48cff010662b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.585435 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745e431-74a8-4ae8-a13a-48cff010662b admin admin] PATH_INFO: `/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/0d763da11c58473c9c2cf981b02835f3/roles/ee8894ccdace402484c35b0cb5292526` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.585813 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33681b17-d6a3-431d-bd0c-ab517eebb2c3 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.597977 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33681b17-d6a3-431d-bd0c-ab517eebb2c3 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.603431 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745e431-74a8-4ae8-a13a-48cff010662b admin admin] RBAC: Authorizing `identity:create_grant(project_id=011ec8d2410644a3b7d51a90f803b441, user_id=0d763da11c58473c9c2cf981b02835f3, role_id=ee8894ccdace402484c35b0cb5292526)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.603659 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050449b-c259-4dd5-b23f-3971ed48a2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.604488 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050449b-c259-4dd5-b23f-3971ed48a2fd admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.604773 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050449b-c259-4dd5-b23f-3971ed48a2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.605142 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050449b-c259-4dd5-b23f-3971ed48a2fd admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.606120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745e431-74a8-4ae8-a13a-48cff010662b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.614761 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050449b-c259-4dd5-b23f-3971ed48a2fd admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.616975 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050449b-c259-4dd5-b23f-3971ed48a2fd admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.621601 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 244/492] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:52:27 2021] PUT /identity/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/0d763da11c58473c9c2cf981b02835f3/roles/ee8894ccdace402484c35b0cb5292526 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:52:27.622441 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745e431-74a8-4ae8-a13a-48cff010662b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.637365 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-9050449b-c259-4dd5-b23f-3971ed48a2fd admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 02:52:27.638987 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 249/493] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:27.648526 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050449b-c259-4dd5-b23f-3971ed48a2fd admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.668882 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050449b-c259-4dd5-b23f-3971ed48a2fd admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.749358 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745e431-74a8-4ae8-a13a-48cff010662b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.756995 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12558bbd-c3e5-434a-829f-5ab856c79a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.757673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12558bbd-c3e5-434a-829f-5ab856c79a05 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.757958 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12558bbd-c3e5-434a-829f-5ab856c79a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.758236 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12558bbd-c3e5-434a-829f-5ab856c79a05 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.758969 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12558bbd-c3e5-434a-829f-5ab856c79a05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:27.759275 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12558bbd-c3e5-434a-829f-5ab856c79a05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.760951 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12558bbd-c3e5-434a-829f-5ab856c79a05 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.781019 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddbdd2-a9d9-473b-b203-328e489859d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.781703 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddbdd2-a9d9-473b-b203-328e489859d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.781984 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddbdd2-a9d9-473b-b203-328e489859d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.782255 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddbdd2-a9d9-473b-b203-328e489859d1 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.783104 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeddbdd2-a9d9-473b-b203-328e489859d1 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:27.783432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeddbdd2-a9d9-473b-b203-328e489859d1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.785320 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeddbdd2-a9d9-473b-b203-328e489859d1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.790415 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 245/494] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:27.800548 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12558bbd-c3e5-434a-829f-5ab856c79a05 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.818741 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12558bbd-c3e5-434a-829f-5ab856c79a05 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.823420 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abff70d-7d95-4189-8fc0-88641e89503e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.824265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abff70d-7d95-4189-8fc0-88641e89503e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.824521 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abff70d-7d95-4189-8fc0-88641e89503e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.824800 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abff70d-7d95-4189-8fc0-88641e89503e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.830885 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 250/495] 10.222.0.39 () {56 vars in 1157 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:27.836297 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abff70d-7d95-4189-8fc0-88641e89503e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.837597 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddbdd2-a9d9-473b-b203-328e489859d1 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.840077 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abff70d-7d95-4189-8fc0-88641e89503e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.850625 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddbdd2-a9d9-473b-b203-328e489859d1 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.855925 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731285db-b426-4c7c-a317-54658e973608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.856564 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731285db-b426-4c7c-a317-54658e973608 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.856846 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731285db-b426-4c7c-a317-54658e973608 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.857119 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731285db-b426-4c7c-a317-54658e973608 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.861705 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-0abff70d-7d95-4189-8fc0-88641e89503e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:27.863930 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 246/496] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:27.866972 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731285db-b426-4c7c-a317-54658e973608 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.868877 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731285db-b426-4c7c-a317-54658e973608 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.870277 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abff70d-7d95-4189-8fc0-88641e89503e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.883403 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 251/497] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 02:52:27.883986 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abff70d-7d95-4189-8fc0-88641e89503e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.886871 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731285db-b426-4c7c-a317-54658e973608 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.890575 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61839de5-420e-4e91-9f35-bfe359454f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.891572 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61839de5-420e-4e91-9f35-bfe359454f12 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.892134 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61839de5-420e-4e91-9f35-bfe359454f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.892612 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61839de5-420e-4e91-9f35-bfe359454f12 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.893814 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61839de5-420e-4e91-9f35-bfe359454f12 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:27.894399 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61839de5-420e-4e91-9f35-bfe359454f12 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.896809 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61839de5-420e-4e91-9f35-bfe359454f12 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.897484 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731285db-b426-4c7c-a317-54658e973608 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.902208 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb71a44-8c6e-49ee-b422-60231294e9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.903003 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb71a44-8c6e-49ee-b422-60231294e9cb admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.903408 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb71a44-8c6e-49ee-b422-60231294e9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.903683 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb71a44-8c6e-49ee-b422-60231294e9cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.912683 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 247/498] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:27.918122 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb71a44-8c6e-49ee-b422-60231294e9cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.918718 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb71a44-8c6e-49ee-b422-60231294e9cb admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.919625 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61839de5-420e-4e91-9f35-bfe359454f12 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.930942 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61839de5-420e-4e91-9f35-bfe359454f12 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.936132 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd17ba-e514-4395-b5a2-a9c8a367cc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.937874 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-ecb71a44-8c6e-49ee-b422-60231294e9cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:27.938197 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd17ba-e514-4395-b5a2-a9c8a367cc72 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.938683 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd17ba-e514-4395-b5a2-a9c8a367cc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.939071 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 252/499] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:27.939444 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd17ba-e514-4395-b5a2-a9c8a367cc72 admin admin] PATH_INFO: `/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/18b73b8e7244410b8f701b2ab43c5979/roles/ee8894ccdace402484c35b0cb5292526` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.945224 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb71a44-8c6e-49ee-b422-60231294e9cb admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:27.955408 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd17ba-e514-4395-b5a2-a9c8a367cc72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011ec8d2410644a3b7d51a90f803b441, user_id=18b73b8e7244410b8f701b2ab43c5979, role_id=ee8894ccdace402484c35b0cb5292526)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.956172 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb71a44-8c6e-49ee-b422-60231294e9cb admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:27.958976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd17ba-e514-4395-b5a2-a9c8a367cc72 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.961049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049c669-d3a3-40d1-a8e8-4f2d6d605f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:27.961844 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049c669-d3a3-40d1-a8e8-4f2d6d605f29 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:27.962286 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049c669-d3a3-40d1-a8e8-4f2d6d605f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:27.962665 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049c669-d3a3-40d1-a8e8-4f2d6d605f29 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:27.965323 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049c669-d3a3-40d1-a8e8-4f2d6d605f29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:27.966598 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049c669-d3a3-40d1-a8e8-4f2d6d605f29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:27.968076 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049c669-d3a3-40d1-a8e8-4f2d6d605f29 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:27.974930 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 248/500] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:52:27 2021] PUT /identity/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/18b73b8e7244410b8f701b2ab43c5979/roles/ee8894ccdace402484c35b0cb5292526 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:52:28.001986 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 253/501] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:28.008383 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd17ba-e514-4395-b5a2-a9c8a367cc72 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:28.099211 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd17ba-e514-4395-b5a2-a9c8a367cc72 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:28.107190 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8f3f9-bca2-490f-ad31-a8973ba38918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:28.108836 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8f3f9-bca2-490f-ad31-a8973ba38918 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:28.109528 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8f3f9-bca2-490f-ad31-a8973ba38918 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:28.109983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8f3f9-bca2-490f-ad31-a8973ba38918 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:28.118267 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8f3f9-bca2-490f-ad31-a8973ba38918 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:28.125880 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8f3f9-bca2-490f-ad31-a8973ba38918 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:28.145241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-78a8f3f9-bca2-490f-ad31-a8973ba38918 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:28.147116 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 249/502] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 139 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:28.153186 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049c669-d3a3-40d1-a8e8-4f2d6d605f29 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:28.167868 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049c669-d3a3-40d1-a8e8-4f2d6d605f29 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:28.173894 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99316dd0-9a54-4b9d-bc56-f25784462b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:28.174555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99316dd0-9a54-4b9d-bc56-f25784462b31 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:28.174836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99316dd0-9a54-4b9d-bc56-f25784462b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:28.175111 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99316dd0-9a54-4b9d-bc56-f25784462b31 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:28.175973 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99316dd0-9a54-4b9d-bc56-f25784462b31 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:28.176275 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99316dd0-9a54-4b9d-bc56-f25784462b31 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:28.178174 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99316dd0-9a54-4b9d-bc56-f25784462b31 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:28.192325 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 254/503] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:28.198472 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8f3f9-bca2-490f-ad31-a8973ba38918 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:28.209254 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8f3f9-bca2-490f-ad31-a8973ba38918 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:28.213976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465549be-64a8-4897-bbc7-2750f03d8c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:28.214611 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465549be-64a8-4897-bbc7-2750f03d8c0e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:28.214895 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465549be-64a8-4897-bbc7-2750f03d8c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:28.215209 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465549be-64a8-4897-bbc7-2750f03d8c0e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:28.216141 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465549be-64a8-4897-bbc7-2750f03d8c0e admin admin] RBAC: Adding query filter params (role.id=ee8894ccdace402484c35b0cb5292526, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=55ed84d2e3ce4c85b552732f3294aac6) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:28.216448 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465549be-64a8-4897-bbc7-2750f03d8c0e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:28.219043 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465549be-64a8-4897-bbc7-2750f03d8c0e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:28.225226 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 250/504] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:28 2021] GET /identity/v3/role_assignments?user.id=55ed84d2e3ce4c85b552732f3294aac6&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=ee8894ccdace402484c35b0cb5292526 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:29.710518 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77710d20-e209-451c-80b0-94bc42d20020 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:29.711064 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77710d20-e209-451c-80b0-94bc42d20020 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:29.711064 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77710d20-e209-451c-80b0-94bc42d20020 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:29.713086 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 255/505] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:29.719470 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7121d-4d5a-427d-a134-3d1ecbde5e38 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:29.720276 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7121d-4d5a-427d-a134-3d1ecbde5e38 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:29.720764 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7121d-4d5a-427d-a134-3d1ecbde5e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:29.744072 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-f6e7121d-4d5a-427d-a134-3d1ecbde5e38 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:29.745647 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f6e7121d-4d5a-427d-a134-3d1ecbde5e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:29.757557 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 251/506] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:29.784041 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77710d20-e209-451c-80b0-94bc42d20020 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:29.802837 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77710d20-e209-451c-80b0-94bc42d20020 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:29.811464 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cba3f-52b0-4189-afc2-895c764e7054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:29.812305 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cba3f-52b0-4189-afc2-895c764e7054 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:29.812587 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cba3f-52b0-4189-afc2-895c764e7054 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:29.812858 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cba3f-52b0-4189-afc2-895c764e7054 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:29.836746 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cba3f-52b0-4189-afc2-895c764e7054 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:29.847148 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-512cba3f-52b0-4189-afc2-895c764e7054 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:52:29.848763 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 256/507] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:29.855346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7121d-4d5a-427d-a134-3d1ecbde5e38 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:29.865338 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7121d-4d5a-427d-a134-3d1ecbde5e38 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:29.875904 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32870d-a177-4095-a920-7159d8476291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:29.876578 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32870d-a177-4095-a920-7159d8476291 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:29.876861 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32870d-a177-4095-a920-7159d8476291 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:29.877135 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32870d-a177-4095-a920-7159d8476291 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:29.877888 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32870d-a177-4095-a920-7159d8476291 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:29.878190 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32870d-a177-4095-a920-7159d8476291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:29.879820 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32870d-a177-4095-a920-7159d8476291 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:29.895227 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 252/508] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:52:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:29.901097 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cba3f-52b0-4189-afc2-895c764e7054 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:29.911548 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cba3f-52b0-4189-afc2-895c764e7054 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:29.917136 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83813c-5c0f-45a2-bc38-7c8d7eab38b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:29.917926 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83813c-5c0f-45a2-bc38-7c8d7eab38b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:29.918259 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83813c-5c0f-45a2-bc38-7c8d7eab38b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:29.918540 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83813c-5c0f-45a2-bc38-7c8d7eab38b0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:29.930736 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83813c-5c0f-45a2-bc38-7c8d7eab38b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:29.932653 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83813c-5c0f-45a2-bc38-7c8d7eab38b0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:29.959708 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-7c83813c-5c0f-45a2-bc38-7c8d7eab38b0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:29.961019 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 257/509] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:29.967097 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32870d-a177-4095-a920-7159d8476291 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:29.977746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32870d-a177-4095-a920-7159d8476291 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:29.986489 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf38df-0c18-432f-a914-606961c3d412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:29.987143 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf38df-0c18-432f-a914-606961c3d412 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:29.987461 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf38df-0c18-432f-a914-606961c3d412 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:29.987742 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf38df-0c18-432f-a914-606961c3d412 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:29.988515 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf38df-0c18-432f-a914-606961c3d412 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:29.988878 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf38df-0c18-432f-a914-606961c3d412 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:29.990467 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf38df-0c18-432f-a914-606961c3d412 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.005361 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 253/510] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:30.011243 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83813c-5c0f-45a2-bc38-7c8d7eab38b0 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.022063 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83813c-5c0f-45a2-bc38-7c8d7eab38b0 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.031106 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99563757-87e1-46a6-93fc-64bb6badb333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.032018 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99563757-87e1-46a6-93fc-64bb6badb333 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.032299 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99563757-87e1-46a6-93fc-64bb6badb333 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.032613 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99563757-87e1-46a6-93fc-64bb6badb333 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.042308 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99563757-87e1-46a6-93fc-64bb6badb333 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.044415 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99563757-87e1-46a6-93fc-64bb6badb333 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.068050 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-99563757-87e1-46a6-93fc-64bb6badb333 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 02:52:30.069325 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 258/511] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/users/cinder => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:30.075528 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf38df-0c18-432f-a914-606961c3d412 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.086230 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf38df-0c18-432f-a914-606961c3d412 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.096057 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29879e1-e40e-49e7-a8dc-ac0df08064bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.096741 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29879e1-e40e-49e7-a8dc-ac0df08064bf admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.097022 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29879e1-e40e-49e7-a8dc-ac0df08064bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.097281 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29879e1-e40e-49e7-a8dc-ac0df08064bf admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.098118 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29879e1-e40e-49e7-a8dc-ac0df08064bf admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:30.098474 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29879e1-e40e-49e7-a8dc-ac0df08064bf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.100408 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29879e1-e40e-49e7-a8dc-ac0df08064bf admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.138624 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 254/512] 10.222.0.39 () {56 vars in 1159 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:30.144968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99563757-87e1-46a6-93fc-64bb6badb333 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.155201 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99563757-87e1-46a6-93fc-64bb6badb333 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.163683 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f912f8-bdb5-486c-9ce1-fe1b2baef44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.164643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f912f8-bdb5-486c-9ce1-fe1b2baef44f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.165150 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f912f8-bdb5-486c-9ce1-fe1b2baef44f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.165625 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f912f8-bdb5-486c-9ce1-fe1b2baef44f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.179172 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f912f8-bdb5-486c-9ce1-fe1b2baef44f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.181231 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f912f8-bdb5-486c-9ce1-fe1b2baef44f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.198789 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 259/513] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:30.206073 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29879e1-e40e-49e7-a8dc-ac0df08064bf admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.215730 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d779dba-d2ac-4dc3-a2bd-5fabd822373b None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.216028 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d779dba-d2ac-4dc3-a2bd-5fabd822373b None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.216196 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d779dba-d2ac-4dc3-a2bd-5fabd822373b None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.218957 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 260/514] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:30.219613 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29879e1-e40e-49e7-a8dc-ac0df08064bf admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.225358 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583845f-fd52-478c-9e1a-a64e0dee53a5 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.225641 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583845f-fd52-478c-9e1a-a64e0dee53a5 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.225914 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583845f-fd52-478c-9e1a-a64e0dee53a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.240082 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4cd3f-dc1e-4ef1-8109-991fbbb9450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.241180 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4cd3f-dc1e-4ef1-8109-991fbbb9450f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.241466 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4cd3f-dc1e-4ef1-8109-991fbbb9450f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.241746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4cd3f-dc1e-4ef1-8109-991fbbb9450f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.244645 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-6583845f-fd52-478c-9e1a-a64e0dee53a5 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:30.245902 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-6583845f-fd52-478c-9e1a-a64e0dee53a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:30.254723 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 261/515] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:30.261312 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4cd3f-dc1e-4ef1-8109-991fbbb9450f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.263169 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4cd3f-dc1e-4ef1-8109-991fbbb9450f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.281561 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa63fa-e485-4a69-ae5a-dceaddf78e85 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.281858 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa63fa-e485-4a69-ae5a-dceaddf78e85 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.282179 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa63fa-e485-4a69-ae5a-dceaddf78e85 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.283047 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-2af4cd3f-dc1e-4ef1-8109-991fbbb9450f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:30.284488 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 262/517] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:30.284599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 255/517] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:30.285191 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa63fa-e485-4a69-ae5a-dceaddf78e85 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.290432 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4cd3f-dc1e-4ef1-8109-991fbbb9450f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.298556 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa63fa-e485-4a69-ae5a-dceaddf78e85 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.301209 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4cd3f-dc1e-4ef1-8109-991fbbb9450f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.303252 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da47e8-f7cb-4df0-8237-45b3bb47595e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.304116 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da47e8-f7cb-4df0-8237-45b3bb47595e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.304398 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da47e8-f7cb-4df0-8237-45b3bb47595e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.304721 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da47e8-f7cb-4df0-8237-45b3bb47595e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.305716 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a26cb-c71d-4d3b-a39d-f675bc37e201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.306366 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a26cb-c71d-4d3b-a39d-f675bc37e201 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.306648 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a26cb-c71d-4d3b-a39d-f675bc37e201 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.307118 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a26cb-c71d-4d3b-a39d-f675bc37e201 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.308196 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a26cb-c71d-4d3b-a39d-f675bc37e201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:30.308506 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a26cb-c71d-4d3b-a39d-f675bc37e201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.310261 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a26cb-c71d-4d3b-a39d-f675bc37e201 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.316365 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da47e8-f7cb-4df0-8237-45b3bb47595e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:30.323464 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 256/518] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:30.323601 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-17da47e8-f7cb-4df0-8237-45b3bb47595e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:52:30.324751 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a5f72-ed41-4ed2-8803-3b1a537390f8 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.325009 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 263/519] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:30.325124 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a5f72-ed41-4ed2-8803-3b1a537390f8 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.325302 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a5f72-ed41-4ed2-8803-3b1a537390f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.332388 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da47e8-f7cb-4df0-8237-45b3bb47595e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.343899 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da47e8-f7cb-4df0-8237-45b3bb47595e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.349016 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889daccd-3ef5-4486-b109-18c0f39e141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.349937 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889daccd-3ef5-4486-b109-18c0f39e141d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.350305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-9a2a5f72-ed41-4ed2-8803-3b1a537390f8 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:30.350675 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889daccd-3ef5-4486-b109-18c0f39e141d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.351123 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889daccd-3ef5-4486-b109-18c0f39e141d admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.351709 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-9a2a5f72-ed41-4ed2-8803-3b1a537390f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:30.352334 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889daccd-3ef5-4486-b109-18c0f39e141d admin admin] RBAC: Adding query filter params (name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:30.352834 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889daccd-3ef5-4486-b109-18c0f39e141d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.354860 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889daccd-3ef5-4486-b109-18c0f39e141d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.360521 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 257/520] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:30.361403 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a5f72-ed41-4ed2-8803-3b1a537390f8 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.365978 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 264/521] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:30.371729 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a5f72-ed41-4ed2-8803-3b1a537390f8 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.372715 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889daccd-3ef5-4486-b109-18c0f39e141d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.381034 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4800f77-6c07-416d-baea-f4aa05c672b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.381953 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4800f77-6c07-416d-baea-f4aa05c672b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.382339 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4800f77-6c07-416d-baea-f4aa05c672b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.382715 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4800f77-6c07-416d-baea-f4aa05c672b5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.390651 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889daccd-3ef5-4486-b109-18c0f39e141d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.393013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4800f77-6c07-416d-baea-f4aa05c672b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.395098 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4800f77-6c07-416d-baea-f4aa05c672b5 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.396008 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74602bbf-d99a-4148-bf2c-0baa2b1a4ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.396972 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74602bbf-d99a-4148-bf2c-0baa2b1a4ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.397447 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74602bbf-d99a-4148-bf2c-0baa2b1a4ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.397914 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74602bbf-d99a-4148-bf2c-0baa2b1a4ec4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.409837 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74602bbf-d99a-4148-bf2c-0baa2b1a4ec4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.410793 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-d4800f77-6c07-416d-baea-f4aa05c672b5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:30.412193 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 258/522] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:30.412717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74602bbf-d99a-4148-bf2c-0baa2b1a4ec4 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.412824 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4800f77-6c07-416d-baea-f4aa05c672b5 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.425462 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4800f77-6c07-416d-baea-f4aa05c672b5 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.430508 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab90263-b7f8-4f6f-8bd5-ccc6ae32c15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.431691 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab90263-b7f8-4f6f-8bd5-ccc6ae32c15f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.432178 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab90263-b7f8-4f6f-8bd5-ccc6ae32c15f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.432653 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab90263-b7f8-4f6f-8bd5-ccc6ae32c15f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.437341 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-74602bbf-d99a-4148-bf2c-0baa2b1a4ec4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:30.438708 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 265/523] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:30.439708 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74602bbf-d99a-4148-bf2c-0baa2b1a4ec4 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.445035 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab90263-b7f8-4f6f-8bd5-ccc6ae32c15f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:30.450206 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74602bbf-d99a-4148-bf2c-0baa2b1a4ec4 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.454037 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-8ab90263-b7f8-4f6f-8bd5-ccc6ae32c15f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:52:30.455606 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 259/524] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:30.455735 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62390112-b193-4ba4-9fb6-7c4897222c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.456379 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62390112-b193-4ba4-9fb6-7c4897222c50 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.456763 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62390112-b193-4ba4-9fb6-7c4897222c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.457091 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62390112-b193-4ba4-9fb6-7c4897222c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.457389 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab90263-b7f8-4f6f-8bd5-ccc6ae32c15f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.457961 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62390112-b193-4ba4-9fb6-7c4897222c50 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:30.458274 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62390112-b193-4ba4-9fb6-7c4897222c50 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.460288 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62390112-b193-4ba4-9fb6-7c4897222c50 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.468011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab90263-b7f8-4f6f-8bd5-ccc6ae32c15f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.472859 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f432d3-57d1-44b2-9d58-861728b05a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.473760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f432d3-57d1-44b2-9d58-861728b05a51 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.474242 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f432d3-57d1-44b2-9d58-861728b05a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.474750 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f432d3-57d1-44b2-9d58-861728b05a51 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.474922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 266/525] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:30.475880 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f432d3-57d1-44b2-9d58-861728b05a51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:30.476386 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f432d3-57d1-44b2-9d58-861728b05a51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.478231 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f432d3-57d1-44b2-9d58-861728b05a51 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.480811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62390112-b193-4ba4-9fb6-7c4897222c50 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.492379 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 260/526] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:30.493518 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f432d3-57d1-44b2-9d58-861728b05a51 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.493650 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62390112-b193-4ba4-9fb6-7c4897222c50 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.498554 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8e53e-7a0c-48b0-bac6-5d1bd8718ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.499981 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8e53e-7a0c-48b0-bac6-5d1bd8718ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.500436 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8e53e-7a0c-48b0-bac6-5d1bd8718ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.500713 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8e53e-7a0c-48b0-bac6-5d1bd8718ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.501671 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8e53e-7a0c-48b0-bac6-5d1bd8718ff1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:30.501975 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8e53e-7a0c-48b0-bac6-5d1bd8718ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.504182 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8e53e-7a0c-48b0-bac6-5d1bd8718ff1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.506650 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f432d3-57d1-44b2-9d58-861728b05a51 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.511568 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d598ce-fdba-42e0-b899-e5d1243c4d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.512496 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d598ce-fdba-42e0-b899-e5d1243c4d28 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.513030 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d598ce-fdba-42e0-b899-e5d1243c4d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.513349 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 267/527] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:30.513757 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d598ce-fdba-42e0-b899-e5d1243c4d28 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.514165 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8e53e-7a0c-48b0-bac6-5d1bd8718ff1 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.515718 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d598ce-fdba-42e0-b899-e5d1243c4d28 admin admin] RBAC: Adding query filter params (role.id=ee8894ccdace402484c35b0cb5292526, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=2e701dd89a844fe9aa21c3b5e1fc59cf) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:30.516229 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d598ce-fdba-42e0-b899-e5d1243c4d28 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.518402 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d598ce-fdba-42e0-b899-e5d1243c4d28 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.525477 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 261/528] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/role_assignments?user.id=2e701dd89a844fe9aa21c3b5e1fc59cf&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=ee8894ccdace402484c35b0cb5292526 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:30.526584 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d598ce-fdba-42e0-b899-e5d1243c4d28 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.531771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8e53e-7a0c-48b0-bac6-5d1bd8718ff1 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.538089 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d598ce-fdba-42e0-b899-e5d1243c4d28 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.540489 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869b777-8321-46bb-b7e2-19b2b90f6530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.541375 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869b777-8321-46bb-b7e2-19b2b90f6530 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.541708 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869b777-8321-46bb-b7e2-19b2b90f6530 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.542053 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869b777-8321-46bb-b7e2-19b2b90f6530 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.544217 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac36354-ece8-4a52-879f-b2a8c1beec09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.545343 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac36354-ece8-4a52-879f-b2a8c1beec09 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.545991 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac36354-ece8-4a52-879f-b2a8c1beec09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.546778 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac36354-ece8-4a52-879f-b2a8c1beec09 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.559446 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869b777-8321-46bb-b7e2-19b2b90f6530 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.562814 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869b777-8321-46bb-b7e2-19b2b90f6530 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.564470 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac36354-ece8-4a52-879f-b2a8c1beec09 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.568361 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac36354-ece8-4a52-879f-b2a8c1beec09 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.601795 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-4869b777-8321-46bb-b7e2-19b2b90f6530 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 02:52:30.603859 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 268/529] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/users/nova => generated 82 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:30.606443 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-6ac36354-ece8-4a52-879f-b2a8c1beec09 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:30.608339 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 262/530] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:30.610238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869b777-8321-46bb-b7e2-19b2b90f6530 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.616647 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac36354-ece8-4a52-879f-b2a8c1beec09 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.630786 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869b777-8321-46bb-b7e2-19b2b90f6530 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.635668 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac36354-ece8-4a52-879f-b2a8c1beec09 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.641529 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aae296-1cf2-4950-88ac-d242cd3da018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.643685 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aae296-1cf2-4950-88ac-d242cd3da018 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.644874 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aae296-1cf2-4950-88ac-d242cd3da018 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.645867 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aae296-1cf2-4950-88ac-d242cd3da018 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.647734 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aae296-1cf2-4950-88ac-d242cd3da018 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:30.649026 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aae296-1cf2-4950-88ac-d242cd3da018 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.649967 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84507b-e659-4f42-b03d-fc1037eb7f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.651780 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84507b-e659-4f42-b03d-fc1037eb7f42 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.652969 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84507b-e659-4f42-b03d-fc1037eb7f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.654016 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84507b-e659-4f42-b03d-fc1037eb7f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.655023 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84507b-e659-4f42-b03d-fc1037eb7f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:30.656253 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aae296-1cf2-4950-88ac-d242cd3da018 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.657725 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84507b-e659-4f42-b03d-fc1037eb7f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.660972 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84507b-e659-4f42-b03d-fc1037eb7f42 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.675295 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 263/531] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:30.682208 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84507b-e659-4f42-b03d-fc1037eb7f42 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.702752 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84507b-e659-4f42-b03d-fc1037eb7f42 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.704475 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 269/532] 10.222.0.39 () {56 vars in 1155 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:30.710563 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aae296-1cf2-4950-88ac-d242cd3da018 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.716396 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee98e26-6f13-42c0-9156-7c71600c58be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.720515 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee98e26-6f13-42c0-9156-7c71600c58be admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.721533 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee98e26-6f13-42c0-9156-7c71600c58be admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.722033 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee98e26-6f13-42c0-9156-7c71600c58be admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.728267 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aae296-1cf2-4950-88ac-d242cd3da018 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.736080 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b14d02-2cf5-4cc9-aa86-5cb7ee234078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.736374 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee98e26-6f13-42c0-9156-7c71600c58be admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.736740 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b14d02-2cf5-4cc9-aa86-5cb7ee234078 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.737016 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b14d02-2cf5-4cc9-aa86-5cb7ee234078 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.737287 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b14d02-2cf5-4cc9-aa86-5cb7ee234078 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.738381 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee98e26-6f13-42c0-9156-7c71600c58be admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.746622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b14d02-2cf5-4cc9-aa86-5cb7ee234078 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.748545 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b14d02-2cf5-4cc9-aa86-5cb7ee234078 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.754709 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-eee98e26-6f13-42c0-9156-7c71600c58be admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 02:52:30.756276 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 264/533] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/users/glance => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:30.757519 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb8066-f7d7-4d34-99c2-dd106808ecbc None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.757807 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb8066-f7d7-4d34-99c2-dd106808ecbc None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.758083 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb8066-f7d7-4d34-99c2-dd106808ecbc None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.759989 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 265/534] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:30.762098 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb8066-f7d7-4d34-99c2-dd106808ecbc None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.762979 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 270/535] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 02:52:30.768885 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b14d02-2cf5-4cc9-aa86-5cb7ee234078 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.778354 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b14d02-2cf5-4cc9-aa86-5cb7ee234078 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.781873 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb8066-f7d7-4d34-99c2-dd106808ecbc None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.784175 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910977a3-6f92-46a6-90cc-c33658924e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.785152 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910977a3-6f92-46a6-90cc-c33658924e78 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.785402 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910977a3-6f92-46a6-90cc-c33658924e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.785586 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910977a3-6f92-46a6-90cc-c33658924e78 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.789002 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b51bea-5546-40b4-ac41-1748453993d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.789595 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b51bea-5546-40b4-ac41-1748453993d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.789874 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b51bea-5546-40b4-ac41-1748453993d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.790148 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b51bea-5546-40b4-ac41-1748453993d8 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.790978 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b51bea-5546-40b4-ac41-1748453993d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:30.791283 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b51bea-5546-40b4-ac41-1748453993d8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.793240 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b51bea-5546-40b4-ac41-1748453993d8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.797695 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910977a3-6f92-46a6-90cc-c33658924e78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.799572 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910977a3-6f92-46a6-90cc-c33658924e78 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.818831 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-910977a3-6f92-46a6-90cc-c33658924e78 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:30.822775 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 271/536] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:30.822775 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fc057-3096-44ac-8de9-eae538263d96 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.822775 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fc057-3096-44ac-8de9-eae538263d96 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.822775 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fc057-3096-44ac-8de9-eae538263d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.828994 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 266/537] 10.222.0.39 () {56 vars in 1159 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:30.830524 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b51bea-5546-40b4-ac41-1748453993d8 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.841296 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-a06fc057-3096-44ac-8de9-eae538263d96 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:30.843514 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a06fc057-3096-44ac-8de9-eae538263d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:30.850006 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b51bea-5546-40b4-ac41-1748453993d8 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.853364 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 272/538] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:30.854582 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fc057-3096-44ac-8de9-eae538263d96 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.856962 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ad4b4-0e8a-49f9-a87d-908065b04bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.858003 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ad4b4-0e8a-49f9-a87d-908065b04bce admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.859183 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ad4b4-0e8a-49f9-a87d-908065b04bce admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.859896 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ad4b4-0e8a-49f9-a87d-908065b04bce admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.861184 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ad4b4-0e8a-49f9-a87d-908065b04bce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:30.861715 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ad4b4-0e8a-49f9-a87d-908065b04bce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.864588 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ad4b4-0e8a-49f9-a87d-908065b04bce admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.866395 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fc057-3096-44ac-8de9-eae538263d96 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.870920 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07742337-e685-4281-a449-0e8cdad9b984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.871861 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07742337-e685-4281-a449-0e8cdad9b984 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.872139 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07742337-e685-4281-a449-0e8cdad9b984 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.872409 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07742337-e685-4281-a449-0e8cdad9b984 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.879592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 267/539] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:30.886507 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ad4b4-0e8a-49f9-a87d-908065b04bce admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.888472 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07742337-e685-4281-a449-0e8cdad9b984 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.893863 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07742337-e685-4281-a449-0e8cdad9b984 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.905829 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 273/540] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:30.907012 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07742337-e685-4281-a449-0e8cdad9b984 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.911154 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ad4b4-0e8a-49f9-a87d-908065b04bce admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.917355 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad3486-4f99-4c9b-918d-36e0de6f9fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.918227 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad3486-4f99-4c9b-918d-36e0de6f9fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.918513 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad3486-4f99-4c9b-918d-36e0de6f9fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.918788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad3486-4f99-4c9b-918d-36e0de6f9fc6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.922185 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07742337-e685-4281-a449-0e8cdad9b984 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.927615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b28959-cf19-4910-b327-515d0da5d447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.927747 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad3486-4f99-4c9b-918d-36e0de6f9fc6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.928733 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b28959-cf19-4910-b327-515d0da5d447 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.929208 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b28959-cf19-4910-b327-515d0da5d447 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.929728 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad3486-4f99-4c9b-918d-36e0de6f9fc6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.929937 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b28959-cf19-4910-b327-515d0da5d447 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.941994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b28959-cf19-4910-b327-515d0da5d447 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:30.946051 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-f1ad3486-4f99-4c9b-918d-36e0de6f9fc6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:30.949389 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-e0b28959-cf19-4910-b327-515d0da5d447 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:52:30.951001 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 274/542] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:30.951106 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 268/542] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:30.957733 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad3486-4f99-4c9b-918d-36e0de6f9fc6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.959500 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b28959-cf19-4910-b327-515d0da5d447 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:30.963136 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad3486-4f99-4c9b-918d-36e0de6f9fc6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.970021 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8fe29-7b69-4d18-84f7-75fcb42792d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.970872 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8fe29-7b69-4d18-84f7-75fcb42792d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.970976 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b28959-cf19-4910-b327-515d0da5d447 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:30.971153 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8fe29-7b69-4d18-84f7-75fcb42792d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.971401 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8fe29-7b69-4d18-84f7-75fcb42792d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.975694 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf34ff7-1045-4561-8dbe-b836efe06a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:30.976388 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf34ff7-1045-4561-8dbe-b836efe06a3f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:30.976689 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf34ff7-1045-4561-8dbe-b836efe06a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:30.976962 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf34ff7-1045-4561-8dbe-b836efe06a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:30.977737 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf34ff7-1045-4561-8dbe-b836efe06a3f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:30.978036 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf34ff7-1045-4561-8dbe-b836efe06a3f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.979897 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf34ff7-1045-4561-8dbe-b836efe06a3f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.982332 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8fe29-7b69-4d18-84f7-75fcb42792d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:30.985021 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8fe29-7b69-4d18-84f7-75fcb42792d7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:30.992861 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 275/543] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:30.995413 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf34ff7-1045-4561-8dbe-b836efe06a3f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.004360 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf34ff7-1045-4561-8dbe-b836efe06a3f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.007878 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-5ea8fe29-7b69-4d18-84f7-75fcb42792d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:31.008860 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21503363-7991-4c2e-8bda-f1adfcff4ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.009466 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 269/544] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:31.014552 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21503363-7991-4c2e-8bda-f1adfcff4ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.014552 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21503363-7991-4c2e-8bda-f1adfcff4ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.014552 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21503363-7991-4c2e-8bda-f1adfcff4ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.014552 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21503363-7991-4c2e-8bda-f1adfcff4ef4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:31.014552 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21503363-7991-4c2e-8bda-f1adfcff4ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.014552 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21503363-7991-4c2e-8bda-f1adfcff4ef4 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.016544 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2900e-0f04-4b1c-a64e-88cf1e8d0ab9 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.016979 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2900e-0f04-4b1c-a64e-88cf1e8d0ab9 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.017412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2900e-0f04-4b1c-a64e-88cf1e8d0ab9 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.019279 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 270/545] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:31.020453 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2900e-0f04-4b1c-a64e-88cf1e8d0ab9 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.025759 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 276/546] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:52:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:31.028374 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21503363-7991-4c2e-8bda-f1adfcff4ef4 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.036888 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2900e-0f04-4b1c-a64e-88cf1e8d0ab9 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.038041 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21503363-7991-4c2e-8bda-f1adfcff4ef4 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.042197 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa51686-4948-467f-8154-8b8b73c88daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.042522 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9302e8-b171-48ce-9c6e-1aaf7f4e4cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.043222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa51686-4948-467f-8154-8b8b73c88daf admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.043337 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9302e8-b171-48ce-9c6e-1aaf7f4e4cea admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.043644 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9302e8-b171-48ce-9c6e-1aaf7f4e4cea admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.043943 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa51686-4948-467f-8154-8b8b73c88daf admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.044049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9302e8-b171-48ce-9c6e-1aaf7f4e4cea admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.044521 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa51686-4948-467f-8154-8b8b73c88daf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.044842 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9302e8-b171-48ce-9c6e-1aaf7f4e4cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:31.045201 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9302e8-b171-48ce-9c6e-1aaf7f4e4cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.046670 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa51686-4948-467f-8154-8b8b73c88daf admin admin] RBAC: Adding query filter params (role.id=ee8894ccdace402484c35b0cb5292526, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=a6bb852fc4394f88800ec9616cb65416) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:31.047129 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa51686-4948-467f-8154-8b8b73c88daf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.047526 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9302e8-b171-48ce-9c6e-1aaf7f4e4cea admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.049357 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa51686-4948-467f-8154-8b8b73c88daf admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.055693 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 271/547] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/role_assignments?user.id=a6bb852fc4394f88800ec9616cb65416&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=ee8894ccdace402484c35b0cb5292526 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:31.057410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0725bba-43d8-4676-a857-8d4423f4d989 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.057728 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0725bba-43d8-4676-a857-8d4423f4d989 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.058053 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0725bba-43d8-4676-a857-8d4423f4d989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.069392 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 277/548] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:31.070571 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9302e8-b171-48ce-9c6e-1aaf7f4e4cea admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.083624 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9302e8-b171-48ce-9c6e-1aaf7f4e4cea admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.083850 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-d0725bba-43d8-4676-a857-8d4423f4d989 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:31.084874 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d0725bba-43d8-4676-a857-8d4423f4d989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:31.089537 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046dfda-e47d-4360-8507-8f7c007b1e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.090787 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046dfda-e47d-4360-8507-8f7c007b1e9c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.091357 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046dfda-e47d-4360-8507-8f7c007b1e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.091883 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046dfda-e47d-4360-8507-8f7c007b1e9c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.098969 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 272/549] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:31.098969 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0725bba-43d8-4676-a857-8d4423f4d989 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.110557 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0725bba-43d8-4676-a857-8d4423f4d989 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.117361 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046dfda-e47d-4360-8507-8f7c007b1e9c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.120736 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046dfda-e47d-4360-8507-8f7c007b1e9c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.121937 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db799ed5-bab6-4b3f-8184-095c043d1635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.122825 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db799ed5-bab6-4b3f-8184-095c043d1635 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.123182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db799ed5-bab6-4b3f-8184-095c043d1635 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.123555 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db799ed5-bab6-4b3f-8184-095c043d1635 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.132349 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db799ed5-bab6-4b3f-8184-095c043d1635 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.134447 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db799ed5-bab6-4b3f-8184-095c043d1635 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.149509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-db799ed5-bab6-4b3f-8184-095c043d1635 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:31.153555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-1046dfda-e47d-4360-8507-8f7c007b1e9c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:31.156056 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 278/551] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:31.156214 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 273/551] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:31.157523 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db799ed5-bab6-4b3f-8184-095c043d1635 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.167472 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046dfda-e47d-4360-8507-8f7c007b1e9c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.172107 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db799ed5-bab6-4b3f-8184-095c043d1635 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.176760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915d2a7-28ba-469d-b7e4-8013590b1acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.177672 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915d2a7-28ba-469d-b7e4-8013590b1acc admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.178022 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915d2a7-28ba-469d-b7e4-8013590b1acc admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.178368 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915d2a7-28ba-469d-b7e4-8013590b1acc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.179006 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046dfda-e47d-4360-8507-8f7c007b1e9c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.189338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be28dd7-dee9-43f1-b190-c76d8c48b526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.191276 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be28dd7-dee9-43f1-b190-c76d8c48b526 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.191653 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be28dd7-dee9-43f1-b190-c76d8c48b526 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.192004 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be28dd7-dee9-43f1-b190-c76d8c48b526 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.193633 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be28dd7-dee9-43f1-b190-c76d8c48b526 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:31.195626 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be28dd7-dee9-43f1-b190-c76d8c48b526 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.196945 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915d2a7-28ba-469d-b7e4-8013590b1acc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:31.198336 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be28dd7-dee9-43f1-b190-c76d8c48b526 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.204922 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-e915d2a7-28ba-469d-b7e4-8013590b1acc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:52:31.206610 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 274/552] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:31.207759 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915d2a7-28ba-469d-b7e4-8013590b1acc admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.214746 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 279/553] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:31.216008 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be28dd7-dee9-43f1-b190-c76d8c48b526 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.222983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915d2a7-28ba-469d-b7e4-8013590b1acc admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.227652 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d9755-b666-4742-96c2-eb3967557fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.228339 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d9755-b666-4742-96c2-eb3967557fea admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.228865 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d9755-b666-4742-96c2-eb3967557fea admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.229154 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d9755-b666-4742-96c2-eb3967557fea admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.229890 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d9755-b666-4742-96c2-eb3967557fea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:31.230200 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d9755-b666-4742-96c2-eb3967557fea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.232826 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d9755-b666-4742-96c2-eb3967557fea admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.235284 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be28dd7-dee9-43f1-b190-c76d8c48b526 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.240393 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d6141-71b2-45b8-96b9-4033d7bd83bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.241438 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d6141-71b2-45b8-96b9-4033d7bd83bc admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.242006 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d6141-71b2-45b8-96b9-4033d7bd83bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.242537 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d6141-71b2-45b8-96b9-4033d7bd83bc admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.243591 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d6141-71b2-45b8-96b9-4033d7bd83bc admin admin] RBAC: Adding query filter params (name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:31.244188 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d6141-71b2-45b8-96b9-4033d7bd83bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.246131 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d6141-71b2-45b8-96b9-4033d7bd83bc admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.247395 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 275/554] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:31.252394 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d9755-b666-4742-96c2-eb3967557fea admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.261410 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 280/555] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:31.262590 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d6141-71b2-45b8-96b9-4033d7bd83bc admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.265621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d9755-b666-4742-96c2-eb3967557fea admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.271705 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5001e51-ce89-4f2d-9586-df388eefe9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.272360 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5001e51-ce89-4f2d-9586-df388eefe9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.272646 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5001e51-ce89-4f2d-9586-df388eefe9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.272925 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5001e51-ce89-4f2d-9586-df388eefe9f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.273751 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5001e51-ce89-4f2d-9586-df388eefe9f0 admin admin] RBAC: Adding query filter params (role.id=ee8894ccdace402484c35b0cb5292526, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=0d763da11c58473c9c2cf981b02835f3) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:31.274071 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5001e51-ce89-4f2d-9586-df388eefe9f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.274353 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d6141-71b2-45b8-96b9-4033d7bd83bc admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.276065 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5001e51-ce89-4f2d-9586-df388eefe9f0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.281110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886b413-0f16-4f81-b403-7408e242c8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.282157 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886b413-0f16-4f81-b403-7408e242c8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.282517 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886b413-0f16-4f81-b403-7408e242c8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.282868 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886b413-0f16-4f81-b403-7408e242c8c6 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.283258 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 276/556] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/role_assignments?user.id=0d763da11c58473c9c2cf981b02835f3&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=ee8894ccdace402484c35b0cb5292526 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:31.284014 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5001e51-ce89-4f2d-9586-df388eefe9f0 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.293854 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5001e51-ce89-4f2d-9586-df388eefe9f0 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.301497 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a5bf3-a698-4d80-b081-d663527c880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.302346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a5bf3-a698-4d80-b081-d663527c880c admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.302636 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a5bf3-a698-4d80-b081-d663527c880c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.302908 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a5bf3-a698-4d80-b081-d663527c880c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.312807 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886b413-0f16-4f81-b403-7408e242c8c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.314910 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886b413-0f16-4f81-b403-7408e242c8c6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.315583 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a5bf3-a698-4d80-b081-d663527c880c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.317456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a5bf3-a698-4d80-b081-d663527c880c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.336706 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-c886b413-0f16-4f81-b403-7408e242c8c6 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 02:52:31.338243 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-e90a5bf3-a698-4d80-b081-d663527c880c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:31.338353 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 281/557] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/users/neutron => generated 85 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:31.340035 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 277/558] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:31.345413 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886b413-0f16-4f81-b403-7408e242c8c6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.348955 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a5bf3-a698-4d80-b081-d663527c880c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.356243 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886b413-0f16-4f81-b403-7408e242c8c6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.363022 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d07669-20d4-42a7-bc35-f26d19946214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.363742 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d07669-20d4-42a7-bc35-f26d19946214 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.364029 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d07669-20d4-42a7-bc35-f26d19946214 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.364306 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d07669-20d4-42a7-bc35-f26d19946214 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.365151 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d07669-20d4-42a7-bc35-f26d19946214 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:31.365461 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d07669-20d4-42a7-bc35-f26d19946214 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.366543 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a5bf3-a698-4d80-b081-d663527c880c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.367338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d07669-20d4-42a7-bc35-f26d19946214 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.374306 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43aa14-15d4-4cf7-917f-cb1eed067e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.375459 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43aa14-15d4-4cf7-917f-cb1eed067e34 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.376310 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43aa14-15d4-4cf7-917f-cb1eed067e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.376829 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43aa14-15d4-4cf7-917f-cb1eed067e34 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.378032 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43aa14-15d4-4cf7-917f-cb1eed067e34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:31.379532 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43aa14-15d4-4cf7-917f-cb1eed067e34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.381193 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43aa14-15d4-4cf7-917f-cb1eed067e34 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.390143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 282/559] 10.222.0.39 () {56 vars in 1161 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:31.395212 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 278/560] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:31.400601 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d07669-20d4-42a7-bc35-f26d19946214 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.403168 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43aa14-15d4-4cf7-917f-cb1eed067e34 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.413497 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d07669-20d4-42a7-bc35-f26d19946214 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.414731 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43aa14-15d4-4cf7-917f-cb1eed067e34 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.418466 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e40de-a31a-4605-8865-8405639e46c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.419288 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e40de-a31a-4605-8865-8405639e46c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.419599 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e40de-a31a-4605-8865-8405639e46c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.419873 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e40de-a31a-4605-8865-8405639e46c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.421695 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb19f95-c30a-471e-8966-e3bf3774d852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.422874 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb19f95-c30a-471e-8966-e3bf3774d852 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.424063 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb19f95-c30a-471e-8966-e3bf3774d852 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.424566 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb19f95-c30a-471e-8966-e3bf3774d852 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.430958 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e40de-a31a-4605-8865-8405639e46c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.432767 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e40de-a31a-4605-8865-8405639e46c6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.434580 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb19f95-c30a-471e-8966-e3bf3774d852 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.437552 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb19f95-c30a-471e-8966-e3bf3774d852 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.446564 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 283/561] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:31.454017 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e40de-a31a-4605-8865-8405639e46c6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.456823 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-6cb19f95-c30a-471e-8966-e3bf3774d852 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 02:52:31.458679 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 279/562] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/users/swift => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:31.466930 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb19f95-c30a-471e-8966-e3bf3774d852 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.470456 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e40de-a31a-4605-8865-8405639e46c6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.475301 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567d708-4000-42c0-84eb-712cfce9685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.477185 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567d708-4000-42c0-84eb-712cfce9685d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.477298 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567d708-4000-42c0-84eb-712cfce9685d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.477614 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567d708-4000-42c0-84eb-712cfce9685d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.481974 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb19f95-c30a-471e-8966-e3bf3774d852 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.486190 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ec9d1-8892-4261-a8dc-9e3a7eb6a5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.486858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ec9d1-8892-4261-a8dc-9e3a7eb6a5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.487143 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ec9d1-8892-4261-a8dc-9e3a7eb6a5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.487482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ec9d1-8892-4261-a8dc-9e3a7eb6a5d2 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.488481 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ec9d1-8892-4261-a8dc-9e3a7eb6a5d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:31.488810 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ec9d1-8892-4261-a8dc-9e3a7eb6a5d2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.490646 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ec9d1-8892-4261-a8dc-9e3a7eb6a5d2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.495793 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567d708-4000-42c0-84eb-712cfce9685d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.498097 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567d708-4000-42c0-84eb-712cfce9685d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.512627 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 280/563] 10.222.0.39 () {56 vars in 1157 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:31.519094 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-8567d708-4000-42c0-84eb-712cfce9685d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:31.519707 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ec9d1-8892-4261-a8dc-9e3a7eb6a5d2 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.520820 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 284/564] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:31.527581 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567d708-4000-42c0-84eb-712cfce9685d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.532972 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ec9d1-8892-4261-a8dc-9e3a7eb6a5d2 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.538283 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b23c97-b438-4685-b8e8-dd4ea7f2cba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.539045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567d708-4000-42c0-84eb-712cfce9685d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.539158 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b23c97-b438-4685-b8e8-dd4ea7f2cba8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.539354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b23c97-b438-4685-b8e8-dd4ea7f2cba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.539666 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b23c97-b438-4685-b8e8-dd4ea7f2cba8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.544650 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b756b8-2bcf-4c20-8e71-587b430c1f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.545542 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b756b8-2bcf-4c20-8e71-587b430c1f0d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.546229 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b756b8-2bcf-4c20-8e71-587b430c1f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.547009 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b756b8-2bcf-4c20-8e71-587b430c1f0d admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.548024 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b756b8-2bcf-4c20-8e71-587b430c1f0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:31.548516 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b756b8-2bcf-4c20-8e71-587b430c1f0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.550257 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b756b8-2bcf-4c20-8e71-587b430c1f0d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.554050 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b23c97-b438-4685-b8e8-dd4ea7f2cba8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.556070 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b23c97-b438-4685-b8e8-dd4ea7f2cba8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.563259 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 285/565] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:31.572046 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b756b8-2bcf-4c20-8e71-587b430c1f0d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.578232 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-c2b23c97-b438-4685-b8e8-dd4ea7f2cba8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:31.579560 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 281/566] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:31.583715 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b756b8-2bcf-4c20-8e71-587b430c1f0d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.586516 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b23c97-b438-4685-b8e8-dd4ea7f2cba8 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.591691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627d2dd-eaa1-4cde-be76-dd7d2e1f2bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.592765 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627d2dd-eaa1-4cde-be76-dd7d2e1f2bab admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.593109 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627d2dd-eaa1-4cde-be76-dd7d2e1f2bab admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.593521 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627d2dd-eaa1-4cde-be76-dd7d2e1f2bab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.598241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b23c97-b438-4685-b8e8-dd4ea7f2cba8 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.601758 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627d2dd-eaa1-4cde-be76-dd7d2e1f2bab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.603587 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274d087-c813-4b3d-b094-c30a69dd74f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.603790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627d2dd-eaa1-4cde-be76-dd7d2e1f2bab admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.604554 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274d087-c813-4b3d-b094-c30a69dd74f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.605031 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274d087-c813-4b3d-b094-c30a69dd74f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.605483 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274d087-c813-4b3d-b094-c30a69dd74f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.606321 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274d087-c813-4b3d-b094-c30a69dd74f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:31.606789 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274d087-c813-4b3d-b094-c30a69dd74f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.608959 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274d087-c813-4b3d-b094-c30a69dd74f9 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.620811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-2627d2dd-eaa1-4cde-be76-dd7d2e1f2bab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:31.622176 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 282/567] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:31.622968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 286/568] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:31.630593 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274d087-c813-4b3d-b094-c30a69dd74f9 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.638619 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627d2dd-eaa1-4cde-be76-dd7d2e1f2bab admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.646941 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274d087-c813-4b3d-b094-c30a69dd74f9 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.648601 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627d2dd-eaa1-4cde-be76-dd7d2e1f2bab admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.652506 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3c1e3-8dad-45cc-a942-30edc571455c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.653211 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980817d-012a-4be9-828c-387439271676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.653547 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3c1e3-8dad-45cc-a942-30edc571455c admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.654001 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3c1e3-8dad-45cc-a942-30edc571455c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.654289 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980817d-012a-4be9-828c-387439271676 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.654622 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3c1e3-8dad-45cc-a942-30edc571455c admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.654727 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980817d-012a-4be9-828c-387439271676 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.655143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980817d-012a-4be9-828c-387439271676 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.655813 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3c1e3-8dad-45cc-a942-30edc571455c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:31.656302 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3c1e3-8dad-45cc-a942-30edc571455c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.658625 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3c1e3-8dad-45cc-a942-30edc571455c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.663453 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980817d-012a-4be9-828c-387439271676 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.665523 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980817d-012a-4be9-828c-387439271676 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.672465 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 283/569] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:31.678961 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3c1e3-8dad-45cc-a942-30edc571455c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.681939 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-7980817d-012a-4be9-828c-387439271676 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:31.683546 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 287/570] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:31.692249 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3c1e3-8dad-45cc-a942-30edc571455c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.696135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980817d-012a-4be9-828c-387439271676 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.699571 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea994ab2-307a-40bb-96cc-7ec2c36ebbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.700294 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea994ab2-307a-40bb-96cc-7ec2c36ebbed admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.700693 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea994ab2-307a-40bb-96cc-7ec2c36ebbed admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.701040 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea994ab2-307a-40bb-96cc-7ec2c36ebbed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.702020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea994ab2-307a-40bb-96cc-7ec2c36ebbed admin admin] RBAC: Adding query filter params (role.id=ee8894ccdace402484c35b0cb5292526, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=18b73b8e7244410b8f701b2ab43c5979) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:31.702536 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea994ab2-307a-40bb-96cc-7ec2c36ebbed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.704543 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea994ab2-307a-40bb-96cc-7ec2c36ebbed admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.709365 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980817d-012a-4be9-828c-387439271676 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.715396 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 284/571] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/role_assignments?user.id=18b73b8e7244410b8f701b2ab43c5979&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=ee8894ccdace402484c35b0cb5292526 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:31.718163 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39d329-7b04-460b-befe-2edc6fc7fbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.718836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39d329-7b04-460b-befe-2edc6fc7fbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.719119 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39d329-7b04-460b-befe-2edc6fc7fbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.719416 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39d329-7b04-460b-befe-2edc6fc7fbe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.720283 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39d329-7b04-460b-befe-2edc6fc7fbe6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:31.720595 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39d329-7b04-460b-befe-2edc6fc7fbe6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.722602 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39d329-7b04-460b-befe-2edc6fc7fbe6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.738626 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 288/572] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:31.745784 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea994ab2-307a-40bb-96cc-7ec2c36ebbed admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:31.758060 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea994ab2-307a-40bb-96cc-7ec2c36ebbed admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:31.763073 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8735a4-e34b-437d-bfec-92b2da998587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:31.764053 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8735a4-e34b-437d-bfec-92b2da998587 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:31.764391 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8735a4-e34b-437d-bfec-92b2da998587 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:31.764713 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8735a4-e34b-437d-bfec-92b2da998587 admin admin] PATH_INFO: `/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/55ed84d2e3ce4c85b552732f3294aac6/roles/ee8894ccdace402484c35b0cb5292526` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:31.784235 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8735a4-e34b-437d-bfec-92b2da998587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011ec8d2410644a3b7d51a90f803b441, user_id=55ed84d2e3ce4c85b552732f3294aac6, role_id=ee8894ccdace402484c35b0cb5292526)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:31.787066 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8735a4-e34b-437d-bfec-92b2da998587 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:31.805416 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 285/573] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:52:31 2021] PUT /identity/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/55ed84d2e3ce4c85b552732f3294aac6/roles/ee8894ccdace402484c35b0cb5292526 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 02:52:33.062255 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0429-e2c9-4184-b195-03b1745c2492 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:33.062811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0429-e2c9-4184-b195-03b1745c2492 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:33.062811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0429-e2c9-4184-b195-03b1745c2492 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:33.064925 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 289/574] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:33.078205 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bed389-4424-4a16-bdf1-5721f6d3fcd9 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:33.078205 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bed389-4424-4a16-bdf1-5721f6d3fcd9 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:33.078205 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bed389-4424-4a16-bdf1-5721f6d3fcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:33.095964 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-30bed389-4424-4a16-bdf1-5721f6d3fcd9 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:33.097476 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-30bed389-4424-4a16-bdf1-5721f6d3fcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:33.203677 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 286/575] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:33.243324 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef0429-e2c9-4184-b195-03b1745c2492 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:33.264048 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef0429-e2c9-4184-b195-03b1745c2492 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:33.269043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba835b7-7449-42f2-84ae-5ca31f57e1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:33.270084 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba835b7-7449-42f2-84ae-5ca31f57e1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:33.270820 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba835b7-7449-42f2-84ae-5ca31f57e1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:33.271305 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba835b7-7449-42f2-84ae-5ca31f57e1b2 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:33.280210 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba835b7-7449-42f2-84ae-5ca31f57e1b2 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:33.281477 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-dba835b7-7449-42f2-84ae-5ca31f57e1b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:33.281477 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 02:52:33.281477 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 02:52:33.282709 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba835b7-7449-42f2-84ae-5ca31f57e1b2 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:33.302010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-dba835b7-7449-42f2-84ae-5ca31f57e1b2 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 02:52:33.303233 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 290/576] 10.222.0.39 () {56 vars in 1151 bytes} [Tue Aug 31 02:52:33 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:33.310825 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bed389-4424-4a16-bdf1-5721f6d3fcd9 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:33.327200 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bed389-4424-4a16-bdf1-5721f6d3fcd9 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:33.340976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee249d5-c002-4960-9aaa-1e62a0116339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:33.341960 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee249d5-c002-4960-9aaa-1e62a0116339 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:33.342462 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee249d5-c002-4960-9aaa-1e62a0116339 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:33.342988 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee249d5-c002-4960-9aaa-1e62a0116339 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:33.344107 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee249d5-c002-4960-9aaa-1e62a0116339 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:33.344625 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee249d5-c002-4960-9aaa-1e62a0116339 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:33.345834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-dee249d5-c002-4960-9aaa-1e62a0116339 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:33.345834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 02:52:33.345834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 02:52:33.347067 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee249d5-c002-4960-9aaa-1e62a0116339 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:33.362339 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 287/577] 10.222.0.39 () {56 vars in 1146 bytes} [Tue Aug 31 02:52:33 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:33.368177 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba835b7-7449-42f2-84ae-5ca31f57e1b2 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:33.389175 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba835b7-7449-42f2-84ae-5ca31f57e1b2 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:33.397414 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f8cd7-e5dd-4f31-a4a6-81222658516b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:33.398369 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f8cd7-e5dd-4f31-a4a6-81222658516b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:33.398866 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f8cd7-e5dd-4f31-a4a6-81222658516b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:33.399333 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f8cd7-e5dd-4f31-a4a6-81222658516b admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:33.400291 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f8cd7-e5dd-4f31-a4a6-81222658516b admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:33.400827 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f8cd7-e5dd-4f31-a4a6-81222658516b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:33.402019 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-6c0f8cd7-e5dd-4f31-a4a6-81222658516b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:33.402019 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 02:52:33.402019 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 02:52:33.404280 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f8cd7-e5dd-4f31-a4a6-81222658516b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:33.421819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 291/578] 10.222.0.39 () {56 vars in 1146 bytes} [Tue Aug 31 02:52:33 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:34.111410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db010ccc-5fc2-4ec7-aa92-ad56db2ee707 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.111410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db010ccc-5fc2-4ec7-aa92-ad56db2ee707 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.111410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db010ccc-5fc2-4ec7-aa92-ad56db2ee707 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.112882 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 288/579] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:34.119545 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fcd02-e083-40ba-ab8a-9dfe1a5db455 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.119996 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fcd02-e083-40ba-ab8a-9dfe1a5db455 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.120079 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fcd02-e083-40ba-ab8a-9dfe1a5db455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.147337 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-c30fcd02-e083-40ba-ab8a-9dfe1a5db455 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:34.148606 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c30fcd02-e083-40ba-ab8a-9dfe1a5db455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:34.164415 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 292/580] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:34.204645 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31bd50-f6bf-4702-accf-7c6041b6920d None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.205255 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31bd50-f6bf-4702-accf-7c6041b6920d None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.205724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31bd50-f6bf-4702-accf-7c6041b6920d None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.207741 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 289/581] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:34.211402 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fcd02-e083-40ba-ab8a-9dfe1a5db455 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:34.221123 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fcd02-e083-40ba-ab8a-9dfe1a5db455 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:34.226136 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59017122-7b10-4d9d-8dc6-409e4f660868 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.226428 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc9c51-74fe-43fd-8f6e-3cad9e500d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:34.226968 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59017122-7b10-4d9d-8dc6-409e4f660868 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.227343 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc9c51-74fe-43fd-8f6e-3cad9e500d51 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.227677 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc9c51-74fe-43fd-8f6e-3cad9e500d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.227866 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59017122-7b10-4d9d-8dc6-409e4f660868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.227972 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc9c51-74fe-43fd-8f6e-3cad9e500d51 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.239251 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc9c51-74fe-43fd-8f6e-3cad9e500d51 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:34.247712 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-03fc9c51-74fe-43fd-8f6e-3cad9e500d51 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:52:34.249315 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 293/582] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:52:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:34.255671 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc9c51-74fe-43fd-8f6e-3cad9e500d51 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:34.256581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-59017122-7b10-4d9d-8dc6-409e4f660868 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:34.257970 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-59017122-7b10-4d9d-8dc6-409e4f660868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:34.271975 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 290/583] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:34.274223 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc9c51-74fe-43fd-8f6e-3cad9e500d51 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:34.286312 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5146db-abf4-43f2-ace2-1954b17a1732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:34.287255 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5146db-abf4-43f2-ace2-1954b17a1732 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.287754 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5146db-abf4-43f2-ace2-1954b17a1732 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.288235 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5146db-abf4-43f2-ace2-1954b17a1732 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.289168 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5146db-abf4-43f2-ace2-1954b17a1732 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:34.289666 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5146db-abf4-43f2-ace2-1954b17a1732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:34.291459 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5146db-abf4-43f2-ace2-1954b17a1732 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:34.298986 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59017122-7b10-4d9d-8dc6-409e4f660868 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:34.310291 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59017122-7b10-4d9d-8dc6-409e4f660868 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:34.316983 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 294/584] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:34.323204 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5146db-abf4-43f2-ace2-1954b17a1732 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:34.323655 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a16d6c-012e-45e1-9e97-9b766a742bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:34.324780 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a16d6c-012e-45e1-9e97-9b766a742bbc admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.325273 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a16d6c-012e-45e1-9e97-9b766a742bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.325737 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a16d6c-012e-45e1-9e97-9b766a742bbc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.338050 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5146db-abf4-43f2-ace2-1954b17a1732 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:34.343341 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a16d6c-012e-45e1-9e97-9b766a742bbc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:34.346427 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a16d6c-012e-45e1-9e97-9b766a742bbc admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:34.348840 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3895ee-fc97-484a-84b0-342897e882f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:34.349690 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3895ee-fc97-484a-84b0-342897e882f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.349971 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3895ee-fc97-484a-84b0-342897e882f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.350329 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3895ee-fc97-484a-84b0-342897e882f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.370484 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3895ee-fc97-484a-84b0-342897e882f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:34.372574 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3895ee-fc97-484a-84b0-342897e882f6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:34.378047 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-11a16d6c-012e-45e1-9e97-9b766a742bbc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:34.379586 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 291/585] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:34.387730 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a16d6c-012e-45e1-9e97-9b766a742bbc admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:34.404186 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-0c3895ee-fc97-484a-84b0-342897e882f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:34.407689 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a16d6c-012e-45e1-9e97-9b766a742bbc admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:34.410010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 295/586] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:34.416696 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3895ee-fc97-484a-84b0-342897e882f6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:34.420586 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c3c25-bf11-47ef-9e97-2a7628c10ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:34.421318 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c3c25-bf11-47ef-9e97-2a7628c10ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.421646 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c3c25-bf11-47ef-9e97-2a7628c10ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.423598 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c3c25-bf11-47ef-9e97-2a7628c10ec3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.424334 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c3c25-bf11-47ef-9e97-2a7628c10ec3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:34.424642 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c3c25-bf11-47ef-9e97-2a7628c10ec3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:34.427868 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c3c25-bf11-47ef-9e97-2a7628c10ec3 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:34.435192 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3895ee-fc97-484a-84b0-342897e882f6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:34.447005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd44de0-e24a-44d1-935b-07a0232c7fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:34.447740 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd44de0-e24a-44d1-935b-07a0232c7fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.448126 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd44de0-e24a-44d1-935b-07a0232c7fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.448397 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd44de0-e24a-44d1-935b-07a0232c7fd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.449345 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd44de0-e24a-44d1-935b-07a0232c7fd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:34.449660 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd44de0-e24a-44d1-935b-07a0232c7fd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:34.453302 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 292/587] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:34.454483 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd44de0-e24a-44d1-935b-07a0232c7fd9 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:34.459243 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c3c25-bf11-47ef-9e97-2a7628c10ec3 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:34.470366 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c3c25-bf11-47ef-9e97-2a7628c10ec3 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:34.473797 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 296/588] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:34.480823 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd44de0-e24a-44d1-935b-07a0232c7fd9 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:34.487639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab662b-b5c4-445e-84cf-09d47795d79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:34.488322 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab662b-b5c4-445e-84cf-09d47795d79c admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.488689 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab662b-b5c4-445e-84cf-09d47795d79c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.489019 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab662b-b5c4-445e-84cf-09d47795d79c admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.489738 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab662b-b5c4-445e-84cf-09d47795d79c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:34.493500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab662b-b5c4-445e-84cf-09d47795d79c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:34.507624 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd44de0-e24a-44d1-935b-07a0232c7fd9 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:34.517724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef309331-0088-4337-a734-86a483719048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:34.518944 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef309331-0088-4337-a734-86a483719048 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.519566 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef309331-0088-4337-a734-86a483719048 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.519847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef309331-0088-4337-a734-86a483719048 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.524692 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 293/589] 10.222.0.39 () {60 vars in 1154 bytes} [Tue Aug 31 02:52:34 2021] POST /identity/v3/users => generated 254 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 02:52:34.540240 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef309331-0088-4337-a734-86a483719048 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:34.542623 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef309331-0088-4337-a734-86a483719048 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:34.561045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-ef309331-0088-4337-a734-86a483719048 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 02:52:34.563677 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 297/590] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Aug 31 02:52:34 2021] GET /identity/v3/users/nova => generated 82 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:34.570169 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab662b-b5c4-445e-84cf-09d47795d79c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:34.582048 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab662b-b5c4-445e-84cf-09d47795d79c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:34.593551 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec8032-345a-4906-8ec2-3c179d662862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:34.594249 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec8032-345a-4906-8ec2-3c179d662862 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.594534 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec8032-345a-4906-8ec2-3c179d662862 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.594813 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec8032-345a-4906-8ec2-3c179d662862 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.595778 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec8032-345a-4906-8ec2-3c179d662862 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:34.596147 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec8032-345a-4906-8ec2-3c179d662862 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:34.598027 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec8032-345a-4906-8ec2-3c179d662862 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:34.623910 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 294/591] 10.222.0.39 () {56 vars in 1155 bytes} [Tue Aug 31 02:52:34 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:34.630625 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef309331-0088-4337-a734-86a483719048 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:34.641524 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef309331-0088-4337-a734-86a483719048 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:34.648258 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22301bc2-a8ef-4f7c-8975-a657bba43cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:34.648928 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22301bc2-a8ef-4f7c-8975-a657bba43cbd admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.649210 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22301bc2-a8ef-4f7c-8975-a657bba43cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.649483 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22301bc2-a8ef-4f7c-8975-a657bba43cbd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.663465 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22301bc2-a8ef-4f7c-8975-a657bba43cbd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:34.665321 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22301bc2-a8ef-4f7c-8975-a657bba43cbd admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:34.681815 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 298/592] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:34.688925 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec8032-345a-4906-8ec2-3c179d662862 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:34.699208 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec8032-345a-4906-8ec2-3c179d662862 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:34.716139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265cba9-a7e0-481f-bf81-3fc169e6aa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:34.717005 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265cba9-a7e0-481f-bf81-3fc169e6aa71 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.717283 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265cba9-a7e0-481f-bf81-3fc169e6aa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.717600 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265cba9-a7e0-481f-bf81-3fc169e6aa71 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.728852 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265cba9-a7e0-481f-bf81-3fc169e6aa71 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:34.730748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265cba9-a7e0-481f-bf81-3fc169e6aa71 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:34.750740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-f265cba9-a7e0-481f-bf81-3fc169e6aa71 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:34.752366 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 295/593] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:34.758455 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22301bc2-a8ef-4f7c-8975-a657bba43cbd admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:34.772086 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22301bc2-a8ef-4f7c-8975-a657bba43cbd admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:34.779219 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05819b6d-e9c2-4388-98de-e544fab01a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:34.780485 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05819b6d-e9c2-4388-98de-e544fab01a38 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.781035 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05819b6d-e9c2-4388-98de-e544fab01a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.781580 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05819b6d-e9c2-4388-98de-e544fab01a38 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.782596 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05819b6d-e9c2-4388-98de-e544fab01a38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:34.783101 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05819b6d-e9c2-4388-98de-e544fab01a38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:34.784985 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05819b6d-e9c2-4388-98de-e544fab01a38 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:34.801745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 299/594] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:34.807505 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265cba9-a7e0-481f-bf81-3fc169e6aa71 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:34.818896 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265cba9-a7e0-481f-bf81-3fc169e6aa71 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:34.823883 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1a0f8-79ff-4237-8b8e-590e907ae171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:34.824901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1a0f8-79ff-4237-8b8e-590e907ae171 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.825400 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1a0f8-79ff-4237-8b8e-590e907ae171 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.825844 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1a0f8-79ff-4237-8b8e-590e907ae171 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.834502 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1a0f8-79ff-4237-8b8e-590e907ae171 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:34.836763 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1a0f8-79ff-4237-8b8e-590e907ae171 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:34.852234 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-37d1a0f8-79ff-4237-8b8e-590e907ae171 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:34.854134 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 296/595] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:34.860151 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd62b-fb49-4154-a198-927800de79e4 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.860441 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd62b-fb49-4154-a198-927800de79e4 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.860716 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbd62b-fb49-4154-a198-927800de79e4 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.862455 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 300/596] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:52:34.863352 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1a0f8-79ff-4237-8b8e-590e907ae171 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:34.868962 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7030d02-e038-4d14-8491-1f02c28d8cea None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.869251 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7030d02-e038-4d14-8491-1f02c28d8cea None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.869526 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7030d02-e038-4d14-8491-1f02c28d8cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.875187 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1a0f8-79ff-4237-8b8e-590e907ae171 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:34.879615 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56eb1bb-f707-4df2-a287-25996da0e688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:34.880264 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eb1bb-f707-4df2-a287-25996da0e688 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.880758 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eb1bb-f707-4df2-a287-25996da0e688 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.881043 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eb1bb-f707-4df2-a287-25996da0e688 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.881824 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56eb1bb-f707-4df2-a287-25996da0e688 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:34.882133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56eb1bb-f707-4df2-a287-25996da0e688 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:34.884929 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56eb1bb-f707-4df2-a287-25996da0e688 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:34.898414 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-b7030d02-e038-4d14-8491-1f02c28d8cea None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:34.899639 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b7030d02-e038-4d14-8491-1f02c28d8cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:34.901314 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 297/597] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:34.902887 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d08c43-6cb6-4e35-b194-563af5a01d16 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.903342 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d08c43-6cb6-4e35-b194-563af5a01d16 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.903664 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d08c43-6cb6-4e35-b194-563af5a01d16 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.905894 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 298/598] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:34.908581 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 301/599] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:34.912201 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8580813-fd7b-4586-a1df-1c8aa2c9d775 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.912636 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8580813-fd7b-4586-a1df-1c8aa2c9d775 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.913054 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8580813-fd7b-4586-a1df-1c8aa2c9d775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.914769 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7030d02-e038-4d14-8491-1f02c28d8cea None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:34.926097 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7030d02-e038-4d14-8491-1f02c28d8cea None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:34.930605 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60764742-168a-4821-bf9c-30044661e86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:34.931252 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60764742-168a-4821-bf9c-30044661e86a admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.931592 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60764742-168a-4821-bf9c-30044661e86a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.931906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60764742-168a-4821-bf9c-30044661e86a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.933926 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60764742-168a-4821-bf9c-30044661e86a admin admin] RBAC: Adding query filter params (role.id=99835eeda2f64af5bc9173a8370d4568, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=a6bb852fc4394f88800ec9616cb65416) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:34.934239 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60764742-168a-4821-bf9c-30044661e86a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:34.934633 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-a8580813-fd7b-4586-a1df-1c8aa2c9d775 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:34.936084 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a8580813-fd7b-4586-a1df-1c8aa2c9d775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:34.936206 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60764742-168a-4821-bf9c-30044661e86a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:34.943837 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 302/600] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:34 2021] GET /identity/v3/role_assignments?user.id=a6bb852fc4394f88800ec9616cb65416&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:34.944750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60764742-168a-4821-bf9c-30044661e86a admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:34.945858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 299/601] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 31 02:52:34.962240 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60764742-168a-4821-bf9c-30044661e86a admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:34.967474 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbee34b-346b-4e8a-b90c-1b8acf7cfe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:34.968908 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbee34b-346b-4e8a-b90c-1b8acf7cfe56 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:34.969346 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbee34b-346b-4e8a-b90c-1b8acf7cfe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:34.969845 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbee34b-346b-4e8a-b90c-1b8acf7cfe56 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:34.982225 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbee34b-346b-4e8a-b90c-1b8acf7cfe56 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:34.986693 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8580813-fd7b-4586-a1df-1c8aa2c9d775 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:34.990063 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-bcbee34b-346b-4e8a-b90c-1b8acf7cfe56 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:52:34.991886 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 303/602] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:35.000457 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbee34b-346b-4e8a-b90c-1b8acf7cfe56 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:35.002247 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8580813-fd7b-4586-a1df-1c8aa2c9d775 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:35.013682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbee34b-346b-4e8a-b90c-1b8acf7cfe56 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:35.016087 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12168ef-61fd-4e68-b339-71041657684b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:35.017181 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12168ef-61fd-4e68-b339-71041657684b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:35.018470 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12168ef-61fd-4e68-b339-71041657684b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:35.018996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12168ef-61fd-4e68-b339-71041657684b admin admin] PATH_INFO: `/v3/services/network` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:35.020114 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12168ef-61fd-4e68-b339-71041657684b admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:35.021645 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-d12168ef-61fd-4e68-b339-71041657684b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:35.021645 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 02:52:35.021645 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 02:52:35.023828 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12168ef-61fd-4e68-b339-71041657684b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:35.028149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0183e9-0526-4738-a0c0-a5d332b8728e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:35.030894 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0183e9-0526-4738-a0c0-a5d332b8728e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:35.031508 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0183e9-0526-4738-a0c0-a5d332b8728e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:35.034251 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0183e9-0526-4738-a0c0-a5d332b8728e admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:35.035303 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0183e9-0526-4738-a0c0-a5d332b8728e admin admin] RBAC: Adding query filter params (name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:35.035971 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0183e9-0526-4738-a0c0-a5d332b8728e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:35.038890 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0183e9-0526-4738-a0c0-a5d332b8728e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:35.047803 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-d12168ef-61fd-4e68-b339-71041657684b admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 02:52:35.055460 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 300/603] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:34 2021] GET /identity/v3/services/network => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:35.063471 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 304/604] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:52:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:35.064805 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12168ef-61fd-4e68-b339-71041657684b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:35.075331 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12168ef-61fd-4e68-b339-71041657684b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:35.080538 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0183e9-0526-4738-a0c0-a5d332b8728e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:35.092215 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0183e9-0526-4738-a0c0-a5d332b8728e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:35.097613 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db2d9c-f58a-49e8-8f86-283c335b86ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:35.099841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db2d9c-f58a-49e8-8f86-283c335b86ce admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:35.101361 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db2d9c-f58a-49e8-8f86-283c335b86ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:35.102433 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db2d9c-f58a-49e8-8f86-283c335b86ce admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:35.103445 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db2d9c-f58a-49e8-8f86-283c335b86ce admin admin] RBAC: Adding query filter params (name=network) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:35.104358 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8390b0-8ee7-4dd3-8a5c-3ee84dfb168f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:35.104952 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db2d9c-f58a-49e8-8f86-283c335b86ce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:35.105981 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8390b0-8ee7-4dd3-8a5c-3ee84dfb168f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:35.107904 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db2d9c-f58a-49e8-8f86-283c335b86ce admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:35.108509 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8390b0-8ee7-4dd3-8a5c-3ee84dfb168f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:35.109286 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8390b0-8ee7-4dd3-8a5c-3ee84dfb168f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:35.117745 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 301/605] 10.222.0.39 () {56 vars in 1134 bytes} [Tue Aug 31 02:52:35 2021] GET /identity/v3/services?name=network => generated 124 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:35.125389 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db2d9c-f58a-49e8-8f86-283c335b86ce admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:35.136125 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8390b0-8ee7-4dd3-8a5c-3ee84dfb168f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:35.138157 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8390b0-8ee7-4dd3-8a5c-3ee84dfb168f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:35.143390 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db2d9c-f58a-49e8-8f86-283c335b86ce admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:35.149279 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff9b70-90c3-4aca-b2c2-46fa6b1e777c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:35.150094 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff9b70-90c3-4aca-b2c2-46fa6b1e777c admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:35.150536 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff9b70-90c3-4aca-b2c2-46fa6b1e777c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:35.150909 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff9b70-90c3-4aca-b2c2-46fa6b1e777c admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:35.151817 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff9b70-90c3-4aca-b2c2-46fa6b1e777c admin admin] RBAC: Adding query filter params (type=network) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:35.152275 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff9b70-90c3-4aca-b2c2-46fa6b1e777c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:35.154141 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff9b70-90c3-4aca-b2c2-46fa6b1e777c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:35.161020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 302/606] 10.222.0.39 () {56 vars in 1134 bytes} [Tue Aug 31 02:52:35 2021] GET /identity/v3/services?type=network => generated 124 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:35.165340 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-cd8390b0-8ee7-4dd3-8a5c-3ee84dfb168f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:35.172040 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 305/607] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:35.174903 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff9b70-90c3-4aca-b2c2-46fa6b1e777c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:35.185718 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff9b70-90c3-4aca-b2c2-46fa6b1e777c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:35.193338 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f812ec4-8d4c-40b6-aff8-b8dc00742fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:35.194435 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f812ec4-8d4c-40b6-aff8-b8dc00742fea admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:35.194926 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f812ec4-8d4c-40b6-aff8-b8dc00742fea admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:35.195567 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f812ec4-8d4c-40b6-aff8-b8dc00742fea admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:35.196731 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f812ec4-8d4c-40b6-aff8-b8dc00742fea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:35.197051 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f812ec4-8d4c-40b6-aff8-b8dc00742fea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:35.198697 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f812ec4-8d4c-40b6-aff8-b8dc00742fea admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:35.212749 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 303/608] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:35.219353 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8390b0-8ee7-4dd3-8a5c-3ee84dfb168f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:35.231631 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8390b0-8ee7-4dd3-8a5c-3ee84dfb168f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:35.236704 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7df25f-2742-4f65-ab99-d0f507306b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:35.237610 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df25f-2742-4f65-ab99-d0f507306b33 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:35.237891 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df25f-2742-4f65-ab99-d0f507306b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:35.238166 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df25f-2742-4f65-ab99-d0f507306b33 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:35.247161 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7df25f-2742-4f65-ab99-d0f507306b33 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:35.250165 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7df25f-2742-4f65-ab99-d0f507306b33 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:35.266692 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-9a7df25f-2742-4f65-ab99-d0f507306b33 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 02:52:35.268341 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 306/609] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:52:35 2021] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:35.274848 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f812ec4-8d4c-40b6-aff8-b8dc00742fea admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:35.285033 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f812ec4-8d4c-40b6-aff8-b8dc00742fea admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:35.289831 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82aaab-5855-4d88-920c-36d1c8e4b0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:35.290613 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82aaab-5855-4d88-920c-36d1c8e4b0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:35.290904 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82aaab-5855-4d88-920c-36d1c8e4b0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:35.291338 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82aaab-5855-4d88-920c-36d1c8e4b0e7 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:35.292266 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82aaab-5855-4d88-920c-36d1c8e4b0e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:35.292579 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82aaab-5855-4d88-920c-36d1c8e4b0e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:35.294628 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82aaab-5855-4d88-920c-36d1c8e4b0e7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:35.317223 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 304/610] 10.222.0.39 () {56 vars in 1157 bytes} [Tue Aug 31 02:52:35 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:35.323812 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7df25f-2742-4f65-ab99-d0f507306b33 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:35.337608 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7df25f-2742-4f65-ab99-d0f507306b33 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:35.343867 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0fe38-6107-4b52-9adc-86a99533b553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:35.344537 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0fe38-6107-4b52-9adc-86a99533b553 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:35.344831 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0fe38-6107-4b52-9adc-86a99533b553 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:35.345122 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0fe38-6107-4b52-9adc-86a99533b553 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:35.360166 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0fe38-6107-4b52-9adc-86a99533b553 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:35.361938 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0fe38-6107-4b52-9adc-86a99533b553 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:35.371591 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 307/611] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:35.378285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82aaab-5855-4d88-920c-36d1c8e4b0e7 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:35.388189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82aaab-5855-4d88-920c-36d1c8e4b0e7 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:35.395639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e907b3e-b012-4de1-b3c7-eb7164898129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:35.396494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e907b3e-b012-4de1-b3c7-eb7164898129 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:35.396779 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e907b3e-b012-4de1-b3c7-eb7164898129 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:35.397109 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e907b3e-b012-4de1-b3c7-eb7164898129 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:35.408366 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e907b3e-b012-4de1-b3c7-eb7164898129 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:35.410328 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e907b3e-b012-4de1-b3c7-eb7164898129 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:35.428191 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-8e907b3e-b012-4de1-b3c7-eb7164898129 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:35.429686 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 305/612] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:35.435930 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0fe38-6107-4b52-9adc-86a99533b553 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:35.445622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0fe38-6107-4b52-9adc-86a99533b553 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:35.450274 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ff41d-416a-4dc3-92b5-9c99d1d149f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:35.450929 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ff41d-416a-4dc3-92b5-9c99d1d149f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:35.451211 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ff41d-416a-4dc3-92b5-9c99d1d149f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:35.451582 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ff41d-416a-4dc3-92b5-9c99d1d149f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:35.452621 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ff41d-416a-4dc3-92b5-9c99d1d149f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:35.452935 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ff41d-416a-4dc3-92b5-9c99d1d149f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:35.454574 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ff41d-416a-4dc3-92b5-9c99d1d149f3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:35.467060 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 308/613] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:35.473331 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e907b3e-b012-4de1-b3c7-eb7164898129 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:35.484047 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e907b3e-b012-4de1-b3c7-eb7164898129 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:35.488785 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060759-0ca6-4311-b40e-4b12d983de11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:35.489625 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060759-0ca6-4311-b40e-4b12d983de11 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:35.489908 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060759-0ca6-4311-b40e-4b12d983de11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:35.490182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060759-0ca6-4311-b40e-4b12d983de11 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:35.497891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1060759-0ca6-4311-b40e-4b12d983de11 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:35.500571 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1060759-0ca6-4311-b40e-4b12d983de11 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:35.514288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-f1060759-0ca6-4311-b40e-4b12d983de11 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:35.515926 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 306/614] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:35.522355 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ff41d-416a-4dc3-92b5-9c99d1d149f3 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:35.536577 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ff41d-416a-4dc3-92b5-9c99d1d149f3 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:35.541912 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6b14e-bb13-42a0-a124-ce05fa578af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:35.542630 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6b14e-bb13-42a0-a124-ce05fa578af0 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:35.542916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6b14e-bb13-42a0-a124-ce05fa578af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:35.543252 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6b14e-bb13-42a0-a124-ce05fa578af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:35.544171 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6b14e-bb13-42a0-a124-ce05fa578af0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:35.544481 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6b14e-bb13-42a0-a124-ce05fa578af0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:35.546968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6b14e-bb13-42a0-a124-ce05fa578af0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:35.563487 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 309/615] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:35.570237 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060759-0ca6-4311-b40e-4b12d983de11 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:35.582467 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060759-0ca6-4311-b40e-4b12d983de11 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:35.589278 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47057fab-c3f4-4759-90fa-f7f63904772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:35.589990 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47057fab-c3f4-4759-90fa-f7f63904772a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:35.591509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47057fab-c3f4-4759-90fa-f7f63904772a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:35.591509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47057fab-c3f4-4759-90fa-f7f63904772a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:35.591509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47057fab-c3f4-4759-90fa-f7f63904772a admin admin] RBAC: Adding query filter params (role.id=ee8894ccdace402484c35b0cb5292526, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=55ed84d2e3ce4c85b552732f3294aac6) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:35.591753 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47057fab-c3f4-4759-90fa-f7f63904772a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:35.594533 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47057fab-c3f4-4759-90fa-f7f63904772a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:35.603938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 307/616] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:35 2021] GET /identity/v3/role_assignments?user.id=55ed84d2e3ce4c85b552732f3294aac6&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=ee8894ccdace402484c35b0cb5292526 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:36.392290 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b042c98-0ea0-4876-8399-333ee2447f04 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:36.392968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b042c98-0ea0-4876-8399-333ee2447f04 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:36.392968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b042c98-0ea0-4876-8399-333ee2447f04 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:36.394680 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 310/617] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:36.402643 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1fd0-2cf5-4c9b-a661-7f48262fa280 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:36.402643 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1fd0-2cf5-4c9b-a661-7f48262fa280 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:36.402643 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1fd0-2cf5-4c9b-a661-7f48262fa280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:36.420073 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-45ab1fd0-2cf5-4c9b-a661-7f48262fa280 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:36.422160 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-45ab1fd0-2cf5-4c9b-a661-7f48262fa280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:36.430274 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 308/618] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:36.455262 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b042c98-0ea0-4876-8399-333ee2447f04 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:36.472527 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b042c98-0ea0-4876-8399-333ee2447f04 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:36.477239 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3c827-54c6-4a7f-a032-8f62bbbf680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:36.478161 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3c827-54c6-4a7f-a032-8f62bbbf680a admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:36.478624 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3c827-54c6-4a7f-a032-8f62bbbf680a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:36.479088 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3c827-54c6-4a7f-a032-8f62bbbf680a admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:36.480034 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3c827-54c6-4a7f-a032-8f62bbbf680a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:36.481224 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-84a3c827-54c6-4a7f-a032-8f62bbbf680a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:36.481224 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 02:52:36.481224 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 02:52:36.482452 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3c827-54c6-4a7f-a032-8f62bbbf680a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:36.507748 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 311/619] 10.222.0.39 () {60 vars in 1163 bytes} [Tue Aug 31 02:52:36 2021] POST /identity/v3/services => generated 251 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:52:37.292701 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a80c0f-4d8e-48fe-add5-8e6ad5e6e77a None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.293389 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a80c0f-4d8e-48fe-add5-8e6ad5e6e77a None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.293896 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a80c0f-4d8e-48fe-add5-8e6ad5e6e77a None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.295950 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 309/620] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:37.303073 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3be8ae-7913-46c5-9b56-8a8291ce5986 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.303884 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3be8ae-7913-46c5-9b56-8a8291ce5986 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.304586 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3be8ae-7913-46c5-9b56-8a8291ce5986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.328900 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-8f3be8ae-7913-46c5-9b56-8a8291ce5986 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:37.330404 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-8f3be8ae-7913-46c5-9b56-8a8291ce5986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:37.350993 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 312/621] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:37 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:37.387472 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a80c0f-4d8e-48fe-add5-8e6ad5e6e77a None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:37.406643 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a80c0f-4d8e-48fe-add5-8e6ad5e6e77a None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:37.418638 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d824e-a17e-4041-9564-51cf9a4f6b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:37.419846 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d824e-a17e-4041-9564-51cf9a4f6b2f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.420328 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d824e-a17e-4041-9564-51cf9a4f6b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.421397 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d824e-a17e-4041-9564-51cf9a4f6b2f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.440287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d824e-a17e-4041-9564-51cf9a4f6b2f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:37.447493 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-840d824e-a17e-4041-9564-51cf9a4f6b2f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:52:37.448994 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 310/622] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:37.456169 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3be8ae-7913-46c5-9b56-8a8291ce5986 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:37.465741 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3be8ae-7913-46c5-9b56-8a8291ce5986 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:37.471991 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79f78c-9437-48c3-b0ef-c410f0388504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:37.472661 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79f78c-9437-48c3-b0ef-c410f0388504 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.472943 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79f78c-9437-48c3-b0ef-c410f0388504 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.473221 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79f78c-9437-48c3-b0ef-c410f0388504 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.473974 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79f78c-9437-48c3-b0ef-c410f0388504 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:37.474277 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79f78c-9437-48c3-b0ef-c410f0388504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:37.475904 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79f78c-9437-48c3-b0ef-c410f0388504 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:37.488709 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 313/623] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:52:37 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:37.494384 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d824e-a17e-4041-9564-51cf9a4f6b2f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:37.506136 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55108652-9bae-4642-bdd6-851e13295dc3 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.506430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55108652-9bae-4642-bdd6-851e13295dc3 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.506711 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55108652-9bae-4642-bdd6-851e13295dc3 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.509053 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 314/624] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:37.511283 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d824e-a17e-4041-9564-51cf9a4f6b2f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:37.515473 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eb775-f578-4a31-ab13-4221339dbe17 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.515764 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eb775-f578-4a31-ab13-4221339dbe17 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.516043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eb775-f578-4a31-ab13-4221339dbe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.519105 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27acd3-c25d-4480-ad6c-ff7b18a495ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:37.520244 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27acd3-c25d-4480-ad6c-ff7b18a495ca admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.520736 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27acd3-c25d-4480-ad6c-ff7b18a495ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.521251 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27acd3-c25d-4480-ad6c-ff7b18a495ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.535454 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-578eb775-f578-4a31-ab13-4221339dbe17 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:37.537161 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-578eb775-f578-4a31-ab13-4221339dbe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:37.539406 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27acd3-c25d-4480-ad6c-ff7b18a495ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:37.541706 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27acd3-c25d-4480-ad6c-ff7b18a495ca admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:37.551807 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 315/625] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:37 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:37.569963 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-0f27acd3-c25d-4480-ad6c-ff7b18a495ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:37.571482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 311/626] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:37.576549 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578eb775-f578-4a31-ab13-4221339dbe17 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:37.578496 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27acd3-c25d-4480-ad6c-ff7b18a495ca admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:37.583048 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578eb775-f578-4a31-ab13-4221339dbe17 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:37.596311 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27acd3-c25d-4480-ad6c-ff7b18a495ca admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:37.597822 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8e8a7-f919-44e0-8216-bcb2b31fee10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:37.598743 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8e8a7-f919-44e0-8216-bcb2b31fee10 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.599035 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8e8a7-f919-44e0-8216-bcb2b31fee10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.599314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8e8a7-f919-44e0-8216-bcb2b31fee10 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.609656 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78798a3-69b1-46bf-9328-b21377b04fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:37.610330 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78798a3-69b1-46bf-9328-b21377b04fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.610610 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78798a3-69b1-46bf-9328-b21377b04fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.610883 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78798a3-69b1-46bf-9328-b21377b04fd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.611642 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78798a3-69b1-46bf-9328-b21377b04fd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:37.611950 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78798a3-69b1-46bf-9328-b21377b04fd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:37.613583 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78798a3-69b1-46bf-9328-b21377b04fd2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:37.628151 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8e8a7-f919-44e0-8216-bcb2b31fee10 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:37.635062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-6dc8e8a7-f919-44e0-8216-bcb2b31fee10 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:52:37.636324 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 316/627] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:52:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:37.643653 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 312/628] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:37.644406 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8e8a7-f919-44e0-8216-bcb2b31fee10 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:37.649377 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78798a3-69b1-46bf-9328-b21377b04fd2 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:37.658301 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8e8a7-f919-44e0-8216-bcb2b31fee10 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:37.668014 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd28854-46e4-4433-ba5f-80dd71213063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:37.670068 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd28854-46e4-4433-ba5f-80dd71213063 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.670352 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd28854-46e4-4433-ba5f-80dd71213063 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.670664 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd28854-46e4-4433-ba5f-80dd71213063 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.671756 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78798a3-69b1-46bf-9328-b21377b04fd2 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:37.673318 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd28854-46e4-4433-ba5f-80dd71213063 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:37.673629 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd28854-46e4-4433-ba5f-80dd71213063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:37.677397 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd28854-46e4-4433-ba5f-80dd71213063 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:37.679108 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8785c8-eb89-41a4-a4dc-ace2cbd3ee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:37.679993 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8785c8-eb89-41a4-a4dc-ace2cbd3ee26 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.680277 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8785c8-eb89-41a4-a4dc-ace2cbd3ee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.680594 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8785c8-eb89-41a4-a4dc-ace2cbd3ee26 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.688631 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8785c8-eb89-41a4-a4dc-ace2cbd3ee26 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:37.688885 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 317/629] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:37.690363 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257169d-3ba6-40a9-a389-ac5cb2e63099 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.690829 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257169d-3ba6-40a9-a389-ac5cb2e63099 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.691287 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257169d-3ba6-40a9-a389-ac5cb2e63099 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.693112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 318/630] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:37.698039 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8785c8-eb89-41a4-a4dc-ace2cbd3ee26 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:37.699496 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc8533-34cd-4de2-9d47-7284e0e70b27 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.699966 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc8533-34cd-4de2-9d47-7284e0e70b27 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.700422 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc8533-34cd-4de2-9d47-7284e0e70b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.711904 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-6a8785c8-eb89-41a4-a4dc-ace2cbd3ee26 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 02:52:37.713393 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 313/631] 10.222.0.39 () {56 vars in 1139 bytes} [Tue Aug 31 02:52:37 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:37.719285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8785c8-eb89-41a4-a4dc-ace2cbd3ee26 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:37.724758 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8785c8-eb89-41a4-a4dc-ace2cbd3ee26 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:37.725439 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-15dc8533-34cd-4de2-9d47-7284e0e70b27 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:37.726810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-15dc8533-34cd-4de2-9d47-7284e0e70b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:37.729478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495cb2d-76d6-42c3-8e3e-94f8941ef863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:37.730295 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495cb2d-76d6-42c3-8e3e-94f8941ef863 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.730577 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495cb2d-76d6-42c3-8e3e-94f8941ef863 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.730898 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495cb2d-76d6-42c3-8e3e-94f8941ef863 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.736194 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 319/632] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:37 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:37.742589 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495cb2d-76d6-42c3-8e3e-94f8941ef863 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:37.743701 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc8533-34cd-4de2-9d47-7284e0e70b27 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:37.744396 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495cb2d-76d6-42c3-8e3e-94f8941ef863 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:37.756283 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc8533-34cd-4de2-9d47-7284e0e70b27 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:37.762718 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-a495cb2d-76d6-42c3-8e3e-94f8941ef863 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:37.770095 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 314/633] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:37.771754 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495cb2d-76d6-42c3-8e3e-94f8941ef863 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:37.776072 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be3045-e3f7-4e50-ad1a-185131af31d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:37.776992 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be3045-e3f7-4e50-ad1a-185131af31d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.777477 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be3045-e3f7-4e50-ad1a-185131af31d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.777925 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be3045-e3f7-4e50-ad1a-185131af31d1 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.778941 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be3045-e3f7-4e50-ad1a-185131af31d1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:37.779444 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be3045-e3f7-4e50-ad1a-185131af31d1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:37.781641 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495cb2d-76d6-42c3-8e3e-94f8941ef863 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:37.781912 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be3045-e3f7-4e50-ad1a-185131af31d1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:37.787502 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc8baa-788e-46ff-b1a5-c5baf4358eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:37.788163 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc8baa-788e-46ff-b1a5-c5baf4358eeb admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.788452 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc8baa-788e-46ff-b1a5-c5baf4358eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.788722 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc8baa-788e-46ff-b1a5-c5baf4358eeb admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.789440 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc8baa-788e-46ff-b1a5-c5baf4358eeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:37.789745 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc8baa-788e-46ff-b1a5-c5baf4358eeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:37.791313 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc8baa-788e-46ff-b1a5-c5baf4358eeb admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:37.802495 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 320/634] 10.222.0.39 () {56 vars in 1171 bytes} [Tue Aug 31 02:52:37 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:37.803445 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be3045-e3f7-4e50-ad1a-185131af31d1 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:37.806170 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 315/635] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:37.808814 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc8baa-788e-46ff-b1a5-c5baf4358eeb admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:37.819916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be3045-e3f7-4e50-ad1a-185131af31d1 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:37.820947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc8baa-788e-46ff-b1a5-c5baf4358eeb admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:37.824644 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bc49f-cec6-4948-8ba3-e4a75714ccef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:37.825364 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bc49f-cec6-4948-8ba3-e4a75714ccef admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.825656 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bc49f-cec6-4948-8ba3-e4a75714ccef admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.825920 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bc49f-cec6-4948-8ba3-e4a75714ccef admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.826587 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847effe-7bb5-42e2-b206-7e7e2c6941e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:37.826704 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bc49f-cec6-4948-8ba3-e4a75714ccef admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:37.827557 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847effe-7bb5-42e2-b206-7e7e2c6941e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.828073 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847effe-7bb5-42e2-b206-7e7e2c6941e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.828453 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bc49f-cec6-4948-8ba3-e4a75714ccef admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:37.828702 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847effe-7bb5-42e2-b206-7e7e2c6941e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.837434 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847effe-7bb5-42e2-b206-7e7e2c6941e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:37.839485 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847effe-7bb5-42e2-b206-7e7e2c6941e6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:37.847453 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 321/636] 10.222.0.39 () {60 vars in 1163 bytes} [Tue Aug 31 02:52:37 2021] POST /identity/v3/services => generated 240 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:52:37.848663 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bc49f-cec6-4948-8ba3-e4a75714ccef admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:37.856885 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 316/637] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:37 2021] GET /identity/v3/auth/tokens => generated 1171 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 02:52:37.867033 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847effe-7bb5-42e2-b206-7e7e2c6941e6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:37.883291 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847effe-7bb5-42e2-b206-7e7e2c6941e6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:37.895536 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bc49f-cec6-4948-8ba3-e4a75714ccef admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:37.915717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14febcd6-d55c-48ad-a24b-445ac185fe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:37.916638 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14febcd6-d55c-48ad-a24b-445ac185fe44 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.918415 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14febcd6-d55c-48ad-a24b-445ac185fe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.918719 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14febcd6-d55c-48ad-a24b-445ac185fe44 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.932895 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14febcd6-d55c-48ad-a24b-445ac185fe44 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:37.935567 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14febcd6-d55c-48ad-a24b-445ac185fe44 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:37.937389 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b84b6-4890-473c-827f-77b33265f608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:37.938273 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b84b6-4890-473c-827f-77b33265f608 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:37.938558 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b84b6-4890-473c-827f-77b33265f608 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:37.938885 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b84b6-4890-473c-827f-77b33265f608 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:37.960041 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b84b6-4890-473c-827f-77b33265f608 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:37.961944 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b84b6-4890-473c-827f-77b33265f608 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:37.966836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-14febcd6-d55c-48ad-a24b-445ac185fe44 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 02:52:37.971084 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 322/638] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Aug 31 02:52:37 2021] GET /identity/v3/users/nova => generated 82 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:37.978081 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14febcd6-d55c-48ad-a24b-445ac185fe44 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:37.993397 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-bc6b84b6-4890-473c-827f-77b33265f608 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:37.995066 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 317/639] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:37.997033 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14febcd6-d55c-48ad-a24b-445ac185fe44 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:38.001780 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b84b6-4890-473c-827f-77b33265f608 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:38.008389 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac167b-cd59-4a30-aa4d-167a20763f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:38.009081 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac167b-cd59-4a30-aa4d-167a20763f97 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:38.009362 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac167b-cd59-4a30-aa4d-167a20763f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:38.009634 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac167b-cd59-4a30-aa4d-167a20763f97 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:38.010477 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac167b-cd59-4a30-aa4d-167a20763f97 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:38.010792 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac167b-cd59-4a30-aa4d-167a20763f97 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:38.012820 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac167b-cd59-4a30-aa4d-167a20763f97 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:38.013576 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b84b6-4890-473c-827f-77b33265f608 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:38.023225 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc194c7-69f8-48c6-aa11-5a8cdfb37c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:38.024322 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc194c7-69f8-48c6-aa11-5a8cdfb37c3f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:38.026159 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc194c7-69f8-48c6-aa11-5a8cdfb37c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:38.026661 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc194c7-69f8-48c6-aa11-5a8cdfb37c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:38.027784 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc194c7-69f8-48c6-aa11-5a8cdfb37c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:38.028974 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc194c7-69f8-48c6-aa11-5a8cdfb37c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:38.031634 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc194c7-69f8-48c6-aa11-5a8cdfb37c3f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:38.052130 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 323/640] 10.222.0.39 () {56 vars in 1155 bytes} [Tue Aug 31 02:52:37 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:38.055725 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 318/641] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:38.058719 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac167b-cd59-4a30-aa4d-167a20763f97 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:38.062120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc194c7-69f8-48c6-aa11-5a8cdfb37c3f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:38.070472 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac167b-cd59-4a30-aa4d-167a20763f97 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:38.074708 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc194c7-69f8-48c6-aa11-5a8cdfb37c3f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:38.076718 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd708981-9299-42ee-9e62-b597f0e694b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:38.077816 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd708981-9299-42ee-9e62-b597f0e694b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:38.078304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd708981-9299-42ee-9e62-b597f0e694b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:38.078777 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd708981-9299-42ee-9e62-b597f0e694b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:38.081017 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f49c98-209d-462f-be67-355c6f113d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:38.081795 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f49c98-209d-462f-be67-355c6f113d5f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:38.082135 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f49c98-209d-462f-be67-355c6f113d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:38.082694 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f49c98-209d-462f-be67-355c6f113d5f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:38.090385 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f49c98-209d-462f-be67-355c6f113d5f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:38.091686 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd708981-9299-42ee-9e62-b597f0e694b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:38.092411 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f49c98-209d-462f-be67-355c6f113d5f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:38.094493 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd708981-9299-42ee-9e62-b597f0e694b7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:38.107036 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-c1f49c98-209d-462f-be67-355c6f113d5f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:38.109181 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 319/642] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:38.114329 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-bd708981-9299-42ee-9e62-b597f0e694b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:38.115721 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f49c98-209d-462f-be67-355c6f113d5f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:38.121554 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 324/643] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:38.124364 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd708981-9299-42ee-9e62-b597f0e694b7 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:38.131784 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f49c98-209d-462f-be67-355c6f113d5f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:38.137087 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29f8b7-4d69-4ef1-8dee-812b5d91b880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:38.137739 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29f8b7-4d69-4ef1-8dee-812b5d91b880 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:38.138025 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29f8b7-4d69-4ef1-8dee-812b5d91b880 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:38.138307 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29f8b7-4d69-4ef1-8dee-812b5d91b880 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:38.138744 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd708981-9299-42ee-9e62-b597f0e694b7 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:38.139098 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29f8b7-4d69-4ef1-8dee-812b5d91b880 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:38.139527 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29f8b7-4d69-4ef1-8dee-812b5d91b880 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:38.141555 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29f8b7-4d69-4ef1-8dee-812b5d91b880 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:38.145188 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa320ba4-daaf-455a-a4ff-7ac80d4dbd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:38.146286 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa320ba4-daaf-455a-a4ff-7ac80d4dbd72 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:38.146774 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa320ba4-daaf-455a-a4ff-7ac80d4dbd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:38.147282 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa320ba4-daaf-455a-a4ff-7ac80d4dbd72 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:38.148221 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa320ba4-daaf-455a-a4ff-7ac80d4dbd72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:38.149262 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa320ba4-daaf-455a-a4ff-7ac80d4dbd72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:38.151636 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa320ba4-daaf-455a-a4ff-7ac80d4dbd72 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:38.154279 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 320/644] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:38.161544 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29f8b7-4d69-4ef1-8dee-812b5d91b880 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:38.168557 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 325/645] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:38.173987 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa320ba4-daaf-455a-a4ff-7ac80d4dbd72 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:38.174142 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29f8b7-4d69-4ef1-8dee-812b5d91b880 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:38.179811 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763165ec-b6ba-408b-886b-f0ced37856be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:38.180537 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763165ec-b6ba-408b-886b-f0ced37856be admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:38.180828 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763165ec-b6ba-408b-886b-f0ced37856be admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:38.181165 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763165ec-b6ba-408b-886b-f0ced37856be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:38.182096 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763165ec-b6ba-408b-886b-f0ced37856be admin admin] RBAC: Adding query filter params (role.id=ee8894ccdace402484c35b0cb5292526, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=b1918e2aa8f24655875480ef52df324d) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:38.182412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763165ec-b6ba-408b-886b-f0ced37856be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:38.184499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763165ec-b6ba-408b-886b-f0ced37856be admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:38.186717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa320ba4-daaf-455a-a4ff-7ac80d4dbd72 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:38.191938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 321/646] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:38 2021] GET /identity/v3/role_assignments?user.id=b1918e2aa8f24655875480ef52df324d&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=ee8894ccdace402484c35b0cb5292526 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:38.197189 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed6295-b03d-44ab-9cec-e79d1a97afbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:38.198012 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed6295-b03d-44ab-9cec-e79d1a97afbe admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:38.198295 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed6295-b03d-44ab-9cec-e79d1a97afbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:38.198568 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed6295-b03d-44ab-9cec-e79d1a97afbe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:38.206454 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed6295-b03d-44ab-9cec-e79d1a97afbe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:38.208519 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed6295-b03d-44ab-9cec-e79d1a97afbe admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:38.224834 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-4aed6295-b03d-44ab-9cec-e79d1a97afbe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:38.226437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 326/647] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:38.232951 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763165ec-b6ba-408b-886b-f0ced37856be admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:38.249566 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763165ec-b6ba-408b-886b-f0ced37856be admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:38.254899 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b5369-183f-4481-945a-da7e2409ea54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:38.255869 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b5369-183f-4481-945a-da7e2409ea54 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:38.256267 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b5369-183f-4481-945a-da7e2409ea54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:38.256634 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b5369-183f-4481-945a-da7e2409ea54 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:38.257545 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b5369-183f-4481-945a-da7e2409ea54 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:38.257963 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b5369-183f-4481-945a-da7e2409ea54 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:38.260028 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b5369-183f-4481-945a-da7e2409ea54 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:38.276999 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 322/648] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:38.284415 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed6295-b03d-44ab-9cec-e79d1a97afbe admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:38.299778 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed6295-b03d-44ab-9cec-e79d1a97afbe admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:38.307803 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba2a1b-d6fc-41b7-b2a1-163bca14e8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:38.308710 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba2a1b-d6fc-41b7-b2a1-163bca14e8c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:38.309033 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba2a1b-d6fc-41b7-b2a1-163bca14e8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:38.309365 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba2a1b-d6fc-41b7-b2a1-163bca14e8c3 admin admin] PATH_INFO: `/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/a6bb852fc4394f88800ec9616cb65416/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:38.312010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba2a1b-d6fc-41b7-b2a1-163bca14e8c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011ec8d2410644a3b7d51a90f803b441, user_id=a6bb852fc4394f88800ec9616cb65416, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:38.314775 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba2a1b-d6fc-41b7-b2a1-163bca14e8c3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:38.342157 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 327/649] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:52:38 2021] PUT /identity/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/a6bb852fc4394f88800ec9616cb65416/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:52:38.893139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c26f64-95ef-4d66-8453-0347430c4ade None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:38.893657 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c26f64-95ef-4d66-8453-0347430c4ade None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:38.893767 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c26f64-95ef-4d66-8453-0347430c4ade None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:38.895642 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 323/650] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:38.901702 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ff474-98c3-45d3-a993-4a1d572c3f9a None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:38.902109 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ff474-98c3-45d3-a993-4a1d572c3f9a None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:38.902282 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ff474-98c3-45d3-a993-4a1d572c3f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:38.928257 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-fd4ff474-98c3-45d3-a993-4a1d572c3f9a None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:38.929461 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-fd4ff474-98c3-45d3-a993-4a1d572c3f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:38.998225 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 328/651] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:38 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:39.024062 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c26f64-95ef-4d66-8453-0347430c4ade None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:39.041584 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c26f64-95ef-4d66-8453-0347430c4ade None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:39.048859 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431f631-3a16-4a5a-b6dc-ae955907580a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:39.049648 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431f631-3a16-4a5a-b6dc-ae955907580a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.049928 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431f631-3a16-4a5a-b6dc-ae955907580a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.050202 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431f631-3a16-4a5a-b6dc-ae955907580a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.066404 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431f631-3a16-4a5a-b6dc-ae955907580a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:39.073213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-1431f631-3a16-4a5a-b6dc-ae955907580a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:52:39.074408 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 324/652] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:52:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:39.081832 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ff474-98c3-45d3-a993-4a1d572c3f9a None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:39.090948 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ff474-98c3-45d3-a993-4a1d572c3f9a None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:39.098545 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3aa91-40f1-4422-8e6b-b21a96648e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:39.099212 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3aa91-40f1-4422-8e6b-b21a96648e20 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.099521 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3aa91-40f1-4422-8e6b-b21a96648e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.099796 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3aa91-40f1-4422-8e6b-b21a96648e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.100544 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3aa91-40f1-4422-8e6b-b21a96648e20 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:39.100849 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3aa91-40f1-4422-8e6b-b21a96648e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:39.102446 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3aa91-40f1-4422-8e6b-b21a96648e20 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:39.118313 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 329/653] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:39.125510 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431f631-3a16-4a5a-b6dc-ae955907580a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:39.144625 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431f631-3a16-4a5a-b6dc-ae955907580a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:39.155683 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93d4be-3b11-4e06-8d40-937a56f710f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:39.156422 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93d4be-3b11-4e06-8d40-937a56f710f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.156701 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93d4be-3b11-4e06-8d40-937a56f710f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.156980 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93d4be-3b11-4e06-8d40-937a56f710f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.179098 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93d4be-3b11-4e06-8d40-937a56f710f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:39.180991 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93d4be-3b11-4e06-8d40-937a56f710f1 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:39.203532 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-1e93d4be-3b11-4e06-8d40-937a56f710f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:39.205033 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 325/654] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:39.210968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3aa91-40f1-4422-8e6b-b21a96648e20 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:39.224465 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3aa91-40f1-4422-8e6b-b21a96648e20 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:39.238674 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f351d1b-dacd-4506-b359-f75882cd2c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:39.239400 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f351d1b-dacd-4506-b359-f75882cd2c4b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.239696 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f351d1b-dacd-4506-b359-f75882cd2c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.239974 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f351d1b-dacd-4506-b359-f75882cd2c4b admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.240751 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f351d1b-dacd-4506-b359-f75882cd2c4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:39.241055 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f351d1b-dacd-4506-b359-f75882cd2c4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:39.242701 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f351d1b-dacd-4506-b359-f75882cd2c4b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:39.264410 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 330/655] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:39.273886 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93d4be-3b11-4e06-8d40-937a56f710f1 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:39.288595 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93d4be-3b11-4e06-8d40-937a56f710f1 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:39.293981 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb53c25-396b-47b7-819e-06c5d384d031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:39.294822 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb53c25-396b-47b7-819e-06c5d384d031 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.295159 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb53c25-396b-47b7-819e-06c5d384d031 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.295505 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb53c25-396b-47b7-819e-06c5d384d031 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.310870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb53c25-396b-47b7-819e-06c5d384d031 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:39.313656 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb53c25-396b-47b7-819e-06c5d384d031 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:39.330730 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-8cb53c25-396b-47b7-819e-06c5d384d031 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 02:52:39.332020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 326/656] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:52:39 2021] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:39.338407 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f351d1b-dacd-4506-b359-f75882cd2c4b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:39.349106 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f351d1b-dacd-4506-b359-f75882cd2c4b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:39.360765 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6ef99-6452-485f-9ea5-c726f8396b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:39.361436 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6ef99-6452-485f-9ea5-c726f8396b16 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.361718 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6ef99-6452-485f-9ea5-c726f8396b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.362046 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6ef99-6452-485f-9ea5-c726f8396b16 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.362879 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6ef99-6452-485f-9ea5-c726f8396b16 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:39.363201 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6ef99-6452-485f-9ea5-c726f8396b16 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:39.365201 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6ef99-6452-485f-9ea5-c726f8396b16 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:39.396657 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 331/657] 10.222.0.39 () {56 vars in 1157 bytes} [Tue Aug 31 02:52:39 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:39.402867 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb53c25-396b-47b7-819e-06c5d384d031 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:39.413324 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb53c25-396b-47b7-819e-06c5d384d031 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:39.424679 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62d240-df73-4996-a53a-f890f93ff0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:39.425455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62d240-df73-4996-a53a-f890f93ff0ff admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.425736 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62d240-df73-4996-a53a-f890f93ff0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.426009 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62d240-df73-4996-a53a-f890f93ff0ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.440608 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62d240-df73-4996-a53a-f890f93ff0ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:39.442465 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62d240-df73-4996-a53a-f890f93ff0ff admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:39.456104 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 327/658] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:39 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:39.462362 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6ef99-6452-485f-9ea5-c726f8396b16 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:39.472928 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6ef99-6452-485f-9ea5-c726f8396b16 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:39.481922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777392d7-6890-4f19-83be-c2bc18605a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:39.482767 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777392d7-6890-4f19-83be-c2bc18605a15 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.483848 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777392d7-6890-4f19-83be-c2bc18605a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.484150 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777392d7-6890-4f19-83be-c2bc18605a15 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.495864 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777392d7-6890-4f19-83be-c2bc18605a15 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:39.498034 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777392d7-6890-4f19-83be-c2bc18605a15 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:39.509672 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3c914-0a7a-43b4-abfe-97dce82f74e1 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.509954 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3c914-0a7a-43b4-abfe-97dce82f74e1 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.510218 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3c914-0a7a-43b4-abfe-97dce82f74e1 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.512274 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 328/659] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:52:39.518160 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284adf9-c157-489c-b2d7-b643d84cbc68 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.518442 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284adf9-c157-489c-b2d7-b643d84cbc68 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.518714 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284adf9-c157-489c-b2d7-b643d84cbc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.525436 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-777392d7-6890-4f19-83be-c2bc18605a15 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:39.526685 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 332/660] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:39.534009 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777392d7-6890-4f19-83be-c2bc18605a15 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:39.538492 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-a284adf9-c157-489c-b2d7-b643d84cbc68 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:39.539708 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a284adf9-c157-489c-b2d7-b643d84cbc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:39.548603 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 329/661] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:39 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:39.553719 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777392d7-6890-4f19-83be-c2bc18605a15 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:39.561541 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1572f-c37c-4af1-a0eb-78cb96d98ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:39.562394 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1572f-c37c-4af1-a0eb-78cb96d98ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.562679 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1572f-c37c-4af1-a0eb-78cb96d98ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.562955 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1572f-c37c-4af1-a0eb-78cb96d98ac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.563710 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1572f-c37c-4af1-a0eb-78cb96d98ac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:39.564017 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1572f-c37c-4af1-a0eb-78cb96d98ac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:39.565611 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1572f-c37c-4af1-a0eb-78cb96d98ac1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:39.574835 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284adf9-c157-489c-b2d7-b643d84cbc68 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:39.584058 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284adf9-c157-489c-b2d7-b643d84cbc68 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:39.584463 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 333/662] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:39.588938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d6142-d182-4986-ad4d-d2ecc5d5e17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:39.589932 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d6142-d182-4986-ad4d-d2ecc5d5e17e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.590187 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d6142-d182-4986-ad4d-d2ecc5d5e17e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.590771 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d6142-d182-4986-ad4d-d2ecc5d5e17e admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.591457 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1572f-c37c-4af1-a0eb-78cb96d98ac1 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:39.591697 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d6142-d182-4986-ad4d-d2ecc5d5e17e admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:39.594375 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d6142-d182-4986-ad4d-d2ecc5d5e17e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:39.605823 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-3f2d6142-d182-4986-ad4d-d2ecc5d5e17e admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 02:52:39.607306 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 330/663] 10.222.0.39 () {56 vars in 1151 bytes} [Tue Aug 31 02:52:39 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:39.610398 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1572f-c37c-4af1-a0eb-78cb96d98ac1 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:39.614639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d6142-d182-4986-ad4d-d2ecc5d5e17e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:39.624064 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fae2a1-7ad6-400e-854e-434cf2f64fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:39.624889 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d6142-d182-4986-ad4d-d2ecc5d5e17e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:39.625064 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fae2a1-7ad6-400e-854e-434cf2f64fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.625243 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fae2a1-7ad6-400e-854e-434cf2f64fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.625531 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fae2a1-7ad6-400e-854e-434cf2f64fb4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.629583 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2445b97-314c-49d2-8a03-926fab31d86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:39.630261 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2445b97-314c-49d2-8a03-926fab31d86c admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.630538 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2445b97-314c-49d2-8a03-926fab31d86c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.630808 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2445b97-314c-49d2-8a03-926fab31d86c admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.631565 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2445b97-314c-49d2-8a03-926fab31d86c admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:39.631869 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2445b97-314c-49d2-8a03-926fab31d86c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:39.633500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2445b97-314c-49d2-8a03-926fab31d86c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:39.637268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fae2a1-7ad6-400e-854e-434cf2f64fb4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:39.639338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fae2a1-7ad6-400e-854e-434cf2f64fb4 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:39.646631 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 331/664] 10.222.0.39 () {56 vars in 1146 bytes} [Tue Aug 31 02:52:39 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:39.652548 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2445b97-314c-49d2-8a03-926fab31d86c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:39.663286 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-f6fae2a1-7ad6-400e-854e-434cf2f64fb4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:39.664827 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 334/665] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:39.671608 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2445b97-314c-49d2-8a03-926fab31d86c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:39.673106 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fae2a1-7ad6-400e-854e-434cf2f64fb4 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:39.686284 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d749d-64fa-418d-a32f-412fc103803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:39.687030 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d749d-64fa-418d-a32f-412fc103803e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.687316 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d749d-64fa-418d-a32f-412fc103803e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.687611 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d749d-64fa-418d-a32f-412fc103803e admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.688371 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fae2a1-7ad6-400e-854e-434cf2f64fb4 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:39.689455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d749d-64fa-418d-a32f-412fc103803e admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:39.689767 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d749d-64fa-418d-a32f-412fc103803e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:39.692228 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d749d-64fa-418d-a32f-412fc103803e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:39.698874 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c94b93-0d6d-4906-9787-84a8ce747fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:39.699638 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c94b93-0d6d-4906-9787-84a8ce747fef admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.699921 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c94b93-0d6d-4906-9787-84a8ce747fef admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.700191 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c94b93-0d6d-4906-9787-84a8ce747fef admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.702256 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c94b93-0d6d-4906-9787-84a8ce747fef admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:39.702570 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c94b93-0d6d-4906-9787-84a8ce747fef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:39.704771 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 332/666] 10.222.0.39 () {56 vars in 1146 bytes} [Tue Aug 31 02:52:39 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:39.705045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c94b93-0d6d-4906-9787-84a8ce747fef admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:39.711039 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d749d-64fa-418d-a32f-412fc103803e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:39.724015 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d749d-64fa-418d-a32f-412fc103803e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:39.730023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 335/667] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:39.732554 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2c02b-838b-48e4-b4de-b9ec48409cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:39.733323 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2c02b-838b-48e4-b4de-b9ec48409cba admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.733603 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2c02b-838b-48e4-b4de-b9ec48409cba admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.733878 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2c02b-838b-48e4-b4de-b9ec48409cba admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.734814 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2c02b-838b-48e4-b4de-b9ec48409cba admin admin] RBAC: Adding query filter params (interface=public, service_id=e96efe404b6040fdb398309f1a4deb17, region_id=RegionOne) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:39.735125 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2c02b-838b-48e4-b4de-b9ec48409cba admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:39.736073 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c94b93-0d6d-4906-9787-84a8ce747fef admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:39.741220 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-69a2c02b-838b-48e4-b4de-b9ec48409cba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:39.741220 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 02:52:39.741220 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 02:52:39.742950 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2c02b-838b-48e4-b4de-b9ec48409cba admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:39.751589 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c94b93-0d6d-4906-9787-84a8ce747fef admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:39.759650 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 333/668] 10.222.0.39 () {56 vars in 1273 bytes} [Tue Aug 31 02:52:39 2021] GET /identity/v3/endpoints?service_id=e96efe404b6040fdb398309f1a4deb17&interface=public®ion_id=RegionOne => generated 194 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:39.760355 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8784d6-088f-4e26-874e-2e5f4f9692ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:39.761077 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8784d6-088f-4e26-874e-2e5f4f9692ea admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.761414 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8784d6-088f-4e26-874e-2e5f4f9692ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.761692 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8784d6-088f-4e26-874e-2e5f4f9692ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.762578 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8784d6-088f-4e26-874e-2e5f4f9692ea admin admin] RBAC: Adding query filter params (role.id=99835eeda2f64af5bc9173a8370d4568, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=55ed84d2e3ce4c85b552732f3294aac6) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:39.762957 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8784d6-088f-4e26-874e-2e5f4f9692ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:39.766276 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2c02b-838b-48e4-b4de-b9ec48409cba admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:39.771149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8784d6-088f-4e26-874e-2e5f4f9692ea admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:39.781026 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 336/669] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:39 2021] GET /identity/v3/role_assignments?user.id=55ed84d2e3ce4c85b552732f3294aac6&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:39.781276 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2c02b-838b-48e4-b4de-b9ec48409cba admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:39.789114 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d4c2c-7b52-4e8c-9b21-b3cff32d7e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:39.789793 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d4c2c-7b52-4e8c-9b21-b3cff32d7e03 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:39.790077 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d4c2c-7b52-4e8c-9b21-b3cff32d7e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:39.790349 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d4c2c-7b52-4e8c-9b21-b3cff32d7e03 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:39.791033 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d4c2c-7b52-4e8c-9b21-b3cff32d7e03 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:39.792695 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d4c2c-7b52-4e8c-9b21-b3cff32d7e03 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:39.804683 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 334/670] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Aug 31 02:52:39 2021] GET /identity/v3/services => generated 772 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:40.743530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dab962-eec9-4d43-adab-2d9908d540c2 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:40.744562 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dab962-eec9-4d43-adab-2d9908d540c2 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:40.745045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dab962-eec9-4d43-adab-2d9908d540c2 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:40.747272 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 337/671] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:40.753928 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05ea35-30a1-4296-99cc-1c4ecbf9b6f6 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:40.754760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05ea35-30a1-4296-99cc-1c4ecbf9b6f6 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:40.755236 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05ea35-30a1-4296-99cc-1c4ecbf9b6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:40.780475 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-4e05ea35-30a1-4296-99cc-1c4ecbf9b6f6 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:40.781998 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-4e05ea35-30a1-4296-99cc-1c4ecbf9b6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:40.789976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 335/672] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:40 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:40.815790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33e5c7-b648-4d26-bdf6-f6c581aef971 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:40.816379 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33e5c7-b648-4d26-bdf6-f6c581aef971 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:40.816861 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33e5c7-b648-4d26-bdf6-f6c581aef971 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:40.818855 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 338/673] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:40.825233 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee138d-72c2-428c-9370-21da08c905eb None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:40.825766 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee138d-72c2-428c-9370-21da08c905eb None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:40.826278 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee138d-72c2-428c-9370-21da08c905eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:40.829294 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33e5c7-b648-4d26-bdf6-f6c581aef971 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:40.848516 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-fbee138d-72c2-428c-9370-21da08c905eb None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:40.850500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-fbee138d-72c2-428c-9370-21da08c905eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:40.851253 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33e5c7-b648-4d26-bdf6-f6c581aef971 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:40.859635 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5400d8c-bc83-4ea1-8b2b-0c761341917e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:40.860676 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5400d8c-bc83-4ea1-8b2b-0c761341917e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:40.861176 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5400d8c-bc83-4ea1-8b2b-0c761341917e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:40.861661 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5400d8c-bc83-4ea1-8b2b-0c761341917e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:40.865157 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 336/674] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:40 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:40.888217 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5400d8c-bc83-4ea1-8b2b-0c761341917e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:40.896385 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-a5400d8c-bc83-4ea1-8b2b-0c761341917e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:52:40.898210 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 339/675] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:40 2021] GET /identity/v3/roles/service => generated 85 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:40.904639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee138d-72c2-428c-9370-21da08c905eb None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:40.909087 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5400d8c-bc83-4ea1-8b2b-0c761341917e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:40.922964 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee138d-72c2-428c-9370-21da08c905eb None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:40.928817 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5400d8c-bc83-4ea1-8b2b-0c761341917e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:40.932490 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b246331-8618-4daf-a9ac-0302f3807213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:40.933172 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b246331-8618-4daf-a9ac-0302f3807213 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:40.933457 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b246331-8618-4daf-a9ac-0302f3807213 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:40.933734 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b246331-8618-4daf-a9ac-0302f3807213 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:40.934597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b246331-8618-4daf-a9ac-0302f3807213 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:40.934906 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b246331-8618-4daf-a9ac-0302f3807213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:40.935016 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f42884-a28c-4bae-b12d-84b87a464f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:40.936045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f42884-a28c-4bae-b12d-84b87a464f5c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:40.936622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f42884-a28c-4bae-b12d-84b87a464f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:40.936725 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b246331-8618-4daf-a9ac-0302f3807213 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:40.937360 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f42884-a28c-4bae-b12d-84b87a464f5c admin admin] PATH_INFO: `/v3/services/network` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:40.938577 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f42884-a28c-4bae-b12d-84b87a464f5c admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:40.940456 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f42884-a28c-4bae-b12d-84b87a464f5c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:40.946597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 337/676] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:52:40 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:40.952859 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b246331-8618-4daf-a9ac-0302f3807213 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:40.954024 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-43f42884-a28c-4bae-b12d-84b87a464f5c admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 02:52:40.955744 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 340/677] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:40 2021] GET /identity/v3/services/network => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:40.962304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f42884-a28c-4bae-b12d-84b87a464f5c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:40.971603 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b246331-8618-4daf-a9ac-0302f3807213 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:40.975973 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f42884-a28c-4bae-b12d-84b87a464f5c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:40.982302 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412eb1f3-1332-40c6-ac0a-12536552c009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:40.983708 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412eb1f3-1332-40c6-ac0a-12536552c009 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:40.984718 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412eb1f3-1332-40c6-ac0a-12536552c009 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:40.985448 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db06173-1380-4617-99a8-c8641157ab39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:40.986306 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db06173-1380-4617-99a8-c8641157ab39 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:40.986797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412eb1f3-1332-40c6-ac0a-12536552c009 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:40.987799 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db06173-1380-4617-99a8-c8641157ab39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:40.988290 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db06173-1380-4617-99a8-c8641157ab39 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:40.989358 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db06173-1380-4617-99a8-c8641157ab39 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:40.991153 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db06173-1380-4617-99a8-c8641157ab39 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:40.992965 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db06173-1380-4617-99a8-c8641157ab39 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.005945 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 341/678] 10.222.0.39 () {56 vars in 1134 bytes} [Tue Aug 31 02:52:40 2021] GET /identity/v3/services?name=network => generated 124 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:41.007253 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412eb1f3-1332-40c6-ac0a-12536552c009 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.009308 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412eb1f3-1332-40c6-ac0a-12536552c009 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.016146 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db06173-1380-4617-99a8-c8641157ab39 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.026499 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db06173-1380-4617-99a8-c8641157ab39 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.030942 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-412eb1f3-1332-40c6-ac0a-12536552c009 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:41.032279 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56e1e0-b3af-4e3b-97b9-29f895615637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.032758 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 338/679] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:41.033377 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56e1e0-b3af-4e3b-97b9-29f895615637 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.033859 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56e1e0-b3af-4e3b-97b9-29f895615637 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.034137 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60961c6-6794-4bd0-97b3-1db2439aaee2 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.034426 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60961c6-6794-4bd0-97b3-1db2439aaee2 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.034704 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60961c6-6794-4bd0-97b3-1db2439aaee2 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.035001 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56e1e0-b3af-4e3b-97b9-29f895615637 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.035962 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56e1e0-b3af-4e3b-97b9-29f895615637 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:41.036462 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56e1e0-b3af-4e3b-97b9-29f895615637 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.038308 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56e1e0-b3af-4e3b-97b9-29f895615637 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.041134 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 339/680] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:41.041964 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60961c6-6794-4bd0-97b3-1db2439aaee2 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.044613 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 342/681] 10.222.0.39 () {56 vars in 1134 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/services?type=network => generated 350 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:41.046896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796df26a-9dc9-4dec-8fad-b68f85db402c None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.047414 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796df26a-9dc9-4dec-8fad-b68f85db402c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.047905 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796df26a-9dc9-4dec-8fad-b68f85db402c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.055830 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60961c6-6794-4bd0-97b3-1db2439aaee2 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.060431 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4191ae7-f79d-400a-854b-23361667b93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.061084 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4191ae7-f79d-400a-854b-23361667b93f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.061511 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4191ae7-f79d-400a-854b-23361667b93f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.061788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4191ae7-f79d-400a-854b-23361667b93f admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.062514 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4191ae7-f79d-400a-854b-23361667b93f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:41.062825 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4191ae7-f79d-400a-854b-23361667b93f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.064444 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4191ae7-f79d-400a-854b-23361667b93f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.070277 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-796df26a-9dc9-4dec-8fad-b68f85db402c None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:41.072207 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-796df26a-9dc9-4dec-8fad-b68f85db402c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:41.076774 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 340/682] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:41.077702 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4191ae7-f79d-400a-854b-23361667b93f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.081440 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 343/683] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:41 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:41.082858 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796df26a-9dc9-4dec-8fad-b68f85db402c None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.095913 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796df26a-9dc9-4dec-8fad-b68f85db402c None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.098127 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4191ae7-f79d-400a-854b-23361667b93f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.110679 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0282aa5-5065-47c9-b578-55e8d6c44245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.111653 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec0c13-8077-4c86-a9c0-ce843b4beeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.112110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0282aa5-5065-47c9-b578-55e8d6c44245 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.112373 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec0c13-8077-4c86-a9c0-ce843b4beeff admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.112658 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec0c13-8077-4c86-a9c0-ce843b4beeff admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.112989 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec0c13-8077-4c86-a9c0-ce843b4beeff admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.113183 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0282aa5-5065-47c9-b578-55e8d6c44245 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.113656 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0282aa5-5065-47c9-b578-55e8d6c44245 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.113819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec0c13-8077-4c86-a9c0-ce843b4beeff admin admin] RBAC: Adding query filter params (interface=public, service_id=731fc1990e5948b685115709aced6c2d, region_id=RegionOne) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:41.114147 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec0c13-8077-4c86-a9c0-ce843b4beeff admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.118328 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec0c13-8077-4c86-a9c0-ce843b4beeff admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.123394 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 341/684] 10.222.0.39 () {56 vars in 1273 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/endpoints?service_id=731fc1990e5948b685115709aced6c2d&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:41.125155 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec0c13-8077-4c86-a9c0-ce843b4beeff admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.129995 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0282aa5-5065-47c9-b578-55e8d6c44245 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.133236 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0282aa5-5065-47c9-b578-55e8d6c44245 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.135187 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec0c13-8077-4c86-a9c0-ce843b4beeff admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.140741 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22249f51-4d41-4b54-973c-8d7674bcd214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.141709 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22249f51-4d41-4b54-973c-8d7674bcd214 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.142094 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22249f51-4d41-4b54-973c-8d7674bcd214 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.142513 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22249f51-4d41-4b54-973c-8d7674bcd214 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.151155 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-e0282aa5-5065-47c9-b578-55e8d6c44245 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 02:52:41.152909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 344/685] 10.222.0.39 () {56 vars in 1139 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:41.154075 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22249f51-4d41-4b54-973c-8d7674bcd214 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:41.154260 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0282aa5-5065-47c9-b578-55e8d6c44245 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.161627 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-22249f51-4d41-4b54-973c-8d7674bcd214 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:52:41.163082 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 342/686] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:41.164985 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0282aa5-5065-47c9-b578-55e8d6c44245 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.168154 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22249f51-4d41-4b54-973c-8d7674bcd214 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.173996 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a239c-cf98-4fda-a21c-815098dab367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.174829 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a239c-cf98-4fda-a21c-815098dab367 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.175214 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a239c-cf98-4fda-a21c-815098dab367 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.175641 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a239c-cf98-4fda-a21c-815098dab367 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.176716 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a239c-cf98-4fda-a21c-815098dab367 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.178237 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a239c-cf98-4fda-a21c-815098dab367 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.180380 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22249f51-4d41-4b54-973c-8d7674bcd214 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.185334 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 345/687] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/services => generated 772 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:41.185481 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a239c-cf98-4fda-a21c-815098dab367 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.187917 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a216f61-465e-42ad-9100-abccba0bb0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.188765 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a216f61-465e-42ad-9100-abccba0bb0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.189189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a216f61-465e-42ad-9100-abccba0bb0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.189599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a216f61-465e-42ad-9100-abccba0bb0c5 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.190756 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a216f61-465e-42ad-9100-abccba0bb0c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:41.191213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a216f61-465e-42ad-9100-abccba0bb0c5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.193251 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a216f61-465e-42ad-9100-abccba0bb0c5 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.201089 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a239c-cf98-4fda-a21c-815098dab367 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.207596 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cb34b-d8bc-432e-a29c-430a2d1306db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.208278 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cb34b-d8bc-432e-a29c-430a2d1306db admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.208562 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cb34b-d8bc-432e-a29c-430a2d1306db admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.208838 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cb34b-d8bc-432e-a29c-430a2d1306db admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.209588 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cb34b-d8bc-432e-a29c-430a2d1306db admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:41.209894 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cb34b-d8bc-432e-a29c-430a2d1306db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.211529 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cb34b-d8bc-432e-a29c-430a2d1306db admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.215849 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 343/688] 10.222.0.39 () {56 vars in 1171 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:41.227437 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a216f61-465e-42ad-9100-abccba0bb0c5 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.230361 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 346/689] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:41.240611 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a216f61-465e-42ad-9100-abccba0bb0c5 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.243744 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cb34b-d8bc-432e-a29c-430a2d1306db admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.255723 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cb34b-d8bc-432e-a29c-430a2d1306db admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.259932 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794fe41-a799-48a1-a392-0340fba8b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.260700 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794fe41-a799-48a1-a392-0340fba8b342 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.260987 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794fe41-a799-48a1-a392-0340fba8b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.261262 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794fe41-a799-48a1-a392-0340fba8b342 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.264518 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a222655-44de-43b5-a656-0e8807e64c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.265363 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a222655-44de-43b5-a656-0e8807e64c0b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.265624 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a222655-44de-43b5-a656-0e8807e64c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.265902 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a222655-44de-43b5-a656-0e8807e64c0b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.285649 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794fe41-a799-48a1-a392-0340fba8b342 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.289806 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794fe41-a799-48a1-a392-0340fba8b342 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.296206 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a222655-44de-43b5-a656-0e8807e64c0b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.298222 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a222655-44de-43b5-a656-0e8807e64c0b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.320993 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-9794fe41-a799-48a1-a392-0340fba8b342 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:41.322603 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 344/690] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:41.329153 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794fe41-a799-48a1-a392-0340fba8b342 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.344873 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-6a222655-44de-43b5-a656-0e8807e64c0b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:41.346140 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 347/691] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:41.347346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794fe41-a799-48a1-a392-0340fba8b342 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.352275 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256f938-2a29-4e74-a3e2-1bf1497ecbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.353002 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256f938-2a29-4e74-a3e2-1bf1497ecbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.353288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256f938-2a29-4e74-a3e2-1bf1497ecbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.353627 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256f938-2a29-4e74-a3e2-1bf1497ecbe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.354362 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256f938-2a29-4e74-a3e2-1bf1497ecbe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:41.354671 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256f938-2a29-4e74-a3e2-1bf1497ecbe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.356456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256f938-2a29-4e74-a3e2-1bf1497ecbe6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.361346 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a222655-44de-43b5-a656-0e8807e64c0b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.374112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a222655-44de-43b5-a656-0e8807e64c0b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.383553 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082a5c3-afa5-4a1b-9d3b-40d73d9bed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.384282 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082a5c3-afa5-4a1b-9d3b-40d73d9bed87 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.384567 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082a5c3-afa5-4a1b-9d3b-40d73d9bed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.384843 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082a5c3-afa5-4a1b-9d3b-40d73d9bed87 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.385270 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 345/692] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:41.385697 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082a5c3-afa5-4a1b-9d3b-40d73d9bed87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:41.386010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082a5c3-afa5-4a1b-9d3b-40d73d9bed87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.387800 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082a5c3-afa5-4a1b-9d3b-40d73d9bed87 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.392140 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256f938-2a29-4e74-a3e2-1bf1497ecbe6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.404249 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 348/693] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:41.406295 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256f938-2a29-4e74-a3e2-1bf1497ecbe6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.410952 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082a5c3-afa5-4a1b-9d3b-40d73d9bed87 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.417703 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac4560-05bf-4982-a128-434501610955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.419177 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac4560-05bf-4982-a128-434501610955 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.419574 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac4560-05bf-4982-a128-434501610955 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.419924 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac4560-05bf-4982-a128-434501610955 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.423335 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082a5c3-afa5-4a1b-9d3b-40d73d9bed87 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.429411 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac4560-05bf-4982-a128-434501610955 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.430454 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ca664-d577-499c-85f1-3174b4ee137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.431514 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ca664-d577-499c-85f1-3174b4ee137c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.431645 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac4560-05bf-4982-a128-434501610955 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.432176 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ca664-d577-499c-85f1-3174b4ee137c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.432625 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ca664-d577-499c-85f1-3174b4ee137c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.441451 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ca664-d577-499c-85f1-3174b4ee137c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.444110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ca664-d577-499c-85f1-3174b4ee137c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.447927 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-71ac4560-05bf-4982-a128-434501610955 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:41.449325 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 346/694] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:41.456590 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac4560-05bf-4982-a128-434501610955 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.461235 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-d58ca664-d577-499c-85f1-3174b4ee137c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 02:52:41.462637 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 349/695] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/users/nova => generated 82 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:41.469731 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ca664-d577-499c-85f1-3174b4ee137c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.471705 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac4560-05bf-4982-a128-434501610955 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.476762 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25f727-75dc-499d-930b-e75cc11e168a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.478150 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25f727-75dc-499d-930b-e75cc11e168a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.478602 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25f727-75dc-499d-930b-e75cc11e168a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.479297 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25f727-75dc-499d-930b-e75cc11e168a admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.480252 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25f727-75dc-499d-930b-e75cc11e168a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:41.480709 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25f727-75dc-499d-930b-e75cc11e168a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.482061 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ca664-d577-499c-85f1-3174b4ee137c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.483608 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25f727-75dc-499d-930b-e75cc11e168a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.489314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68db970-8884-478f-9f94-1108cb7cfba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.490101 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68db970-8884-478f-9f94-1108cb7cfba9 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.490482 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68db970-8884-478f-9f94-1108cb7cfba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.490855 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68db970-8884-478f-9f94-1108cb7cfba9 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.491848 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68db970-8884-478f-9f94-1108cb7cfba9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:41.492258 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68db970-8884-478f-9f94-1108cb7cfba9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.496216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68db970-8884-478f-9f94-1108cb7cfba9 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.501777 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 347/696] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:41.508431 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25f727-75dc-499d-930b-e75cc11e168a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.523209 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 350/697] 10.222.0.39 () {56 vars in 1155 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:41.529635 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25f727-75dc-499d-930b-e75cc11e168a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.536548 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68db970-8884-478f-9f94-1108cb7cfba9 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.541028 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99efa4-8038-4292-bf07-c286a23b91c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.543223 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99efa4-8038-4292-bf07-c286a23b91c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.544367 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99efa4-8038-4292-bf07-c286a23b91c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.544815 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99efa4-8038-4292-bf07-c286a23b91c6 admin admin] PATH_INFO: `/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/b1918e2aa8f24655875480ef52df324d/roles/ee8894ccdace402484c35b0cb5292526` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.553753 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68db970-8884-478f-9f94-1108cb7cfba9 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.564776 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142031b-3d96-421c-8e4c-d4976b079692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.565605 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142031b-3d96-421c-8e4c-d4976b079692 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.566492 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142031b-3d96-421c-8e4c-d4976b079692 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.568045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142031b-3d96-421c-8e4c-d4976b079692 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.580009 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99efa4-8038-4292-bf07-c286a23b91c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011ec8d2410644a3b7d51a90f803b441, user_id=b1918e2aa8f24655875480ef52df324d, role_id=ee8894ccdace402484c35b0cb5292526)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.580908 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142031b-3d96-421c-8e4c-d4976b079692 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.582704 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99efa4-8038-4292-bf07-c286a23b91c6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.583044 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142031b-3d96-421c-8e4c-d4976b079692 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.593769 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 351/698] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 02:52:41.600321 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142031b-3d96-421c-8e4c-d4976b079692 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.610078 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142031b-3d96-421c-8e4c-d4976b079692 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.610638 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 348/699] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:52:41 2021] PUT /identity/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/b1918e2aa8f24655875480ef52df324d/roles/ee8894ccdace402484c35b0cb5292526 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 02:52:41.678265 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f2abc-57fc-4a70-8d9b-e52722b9d567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.679533 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f2abc-57fc-4a70-8d9b-e52722b9d567 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.680015 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f2abc-57fc-4a70-8d9b-e52722b9d567 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.680436 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f2abc-57fc-4a70-8d9b-e52722b9d567 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.692667 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f2abc-57fc-4a70-8d9b-e52722b9d567 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.694854 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f2abc-57fc-4a70-8d9b-e52722b9d567 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.713541 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-a81f2abc-57fc-4a70-8d9b-e52722b9d567 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:41.718141 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 352/700] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:41.722531 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99efa4-8038-4292-bf07-c286a23b91c6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.734534 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99efa4-8038-4292-bf07-c286a23b91c6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.739917 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20f768-be2a-497a-987d-517e73ea13f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.740860 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20f768-be2a-497a-987d-517e73ea13f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.741290 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20f768-be2a-497a-987d-517e73ea13f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.741744 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20f768-be2a-497a-987d-517e73ea13f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.742710 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20f768-be2a-497a-987d-517e73ea13f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:41.743179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20f768-be2a-497a-987d-517e73ea13f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.745014 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20f768-be2a-497a-987d-517e73ea13f7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.759477 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 349/701] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:41.766935 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f2abc-57fc-4a70-8d9b-e52722b9d567 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.777990 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f2abc-57fc-4a70-8d9b-e52722b9d567 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.783180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8dbee-2ed9-4224-b892-92b91a7a0027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.784336 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8dbee-2ed9-4224-b892-92b91a7a0027 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.784797 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8dbee-2ed9-4224-b892-92b91a7a0027 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.785222 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8dbee-2ed9-4224-b892-92b91a7a0027 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.793707 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8dbee-2ed9-4224-b892-92b91a7a0027 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.796135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8dbee-2ed9-4224-b892-92b91a7a0027 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.810278 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-e1b8dbee-2ed9-4224-b892-92b91a7a0027 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:41.812710 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 353/702] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:41.819324 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20f768-be2a-497a-987d-517e73ea13f7 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.830480 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20f768-be2a-497a-987d-517e73ea13f7 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.835572 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add6275-0c4f-4709-81cd-e955ffbbfc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.836468 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add6275-0c4f-4709-81cd-e955ffbbfc11 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.836895 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add6275-0c4f-4709-81cd-e955ffbbfc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.837365 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add6275-0c4f-4709-81cd-e955ffbbfc11 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.838291 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add6275-0c4f-4709-81cd-e955ffbbfc11 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:41.838805 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add6275-0c4f-4709-81cd-e955ffbbfc11 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.840865 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add6275-0c4f-4709-81cd-e955ffbbfc11 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.855477 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 350/703] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:41.875180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8dbee-2ed9-4224-b892-92b91a7a0027 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:41.891155 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8dbee-2ed9-4224-b892-92b91a7a0027 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:41.896429 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1004a3-1ab1-45a0-871a-9ed18f726d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:41.897367 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1004a3-1ab1-45a0-871a-9ed18f726d01 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:41.897803 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1004a3-1ab1-45a0-871a-9ed18f726d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:41.898298 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1004a3-1ab1-45a0-871a-9ed18f726d01 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:41.899293 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1004a3-1ab1-45a0-871a-9ed18f726d01 admin admin] RBAC: Adding query filter params (role.id=99835eeda2f64af5bc9173a8370d4568, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=a6bb852fc4394f88800ec9616cb65416) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:41.899813 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1004a3-1ab1-45a0-871a-9ed18f726d01 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:41.901895 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1004a3-1ab1-45a0-871a-9ed18f726d01 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:41.909249 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 354/704] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:41 2021] GET /identity/v3/role_assignments?user.id=a6bb852fc4394f88800ec9616cb65416&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:42.385967 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d8ab1-82bf-4ce0-8ca4-c8fc480c9f86 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:42.386272 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d8ab1-82bf-4ce0-8ca4-c8fc480c9f86 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:42.386426 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d8ab1-82bf-4ce0-8ca4-c8fc480c9f86 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:42.388504 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 351/705] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:42.394904 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58533bd4-65bf-4d88-b785-1a4687b54f56 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:42.395196 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58533bd4-65bf-4d88-b785-1a4687b54f56 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:42.395496 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58533bd4-65bf-4d88-b785-1a4687b54f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:42.413692 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-58533bd4-65bf-4d88-b785-1a4687b54f56 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:42.414861 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-58533bd4-65bf-4d88-b785-1a4687b54f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:42.423356 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 355/706] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:42 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:42.447724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d8ab1-82bf-4ce0-8ca4-c8fc480c9f86 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:42.460061 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d8ab1-82bf-4ce0-8ca4-c8fc480c9f86 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:42.464410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1f123-dd2d-485b-8a3e-fe249217adc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:42.465188 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1f123-dd2d-485b-8a3e-fe249217adc0 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:42.465464 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1f123-dd2d-485b-8a3e-fe249217adc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:42.465727 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1f123-dd2d-485b-8a3e-fe249217adc0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:42.477507 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1f123-dd2d-485b-8a3e-fe249217adc0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:42.485058 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-d0e1f123-dd2d-485b-8a3e-fe249217adc0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:52:42.486552 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 352/707] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:52:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:42.493091 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58533bd4-65bf-4d88-b785-1a4687b54f56 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:42.503097 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58533bd4-65bf-4d88-b785-1a4687b54f56 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:42.507615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4c1d8-25c4-4f34-b3ac-51d102e3cc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:42.508275 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4c1d8-25c4-4f34-b3ac-51d102e3cc2f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:42.508554 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4c1d8-25c4-4f34-b3ac-51d102e3cc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:42.508826 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4c1d8-25c4-4f34-b3ac-51d102e3cc2f admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:42.509565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4c1d8-25c4-4f34-b3ac-51d102e3cc2f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:42.509867 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4c1d8-25c4-4f34-b3ac-51d102e3cc2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:42.511480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4c1d8-25c4-4f34-b3ac-51d102e3cc2f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:42.521062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 356/708] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:42.527218 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1f123-dd2d-485b-8a3e-fe249217adc0 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:42.537109 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1f123-dd2d-485b-8a3e-fe249217adc0 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:42.541654 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aba793-0938-4d08-a793-0cf5aa79e698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:42.542433 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aba793-0938-4d08-a793-0cf5aa79e698 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:42.542711 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aba793-0938-4d08-a793-0cf5aa79e698 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:42.542982 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aba793-0938-4d08-a793-0cf5aa79e698 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:42.554099 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aba793-0938-4d08-a793-0cf5aa79e698 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:42.556017 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aba793-0938-4d08-a793-0cf5aa79e698 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:42.578970 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-00aba793-0938-4d08-a793-0cf5aa79e698 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:42.580183 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 353/709] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:42.586466 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4c1d8-25c4-4f34-b3ac-51d102e3cc2f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:42.601437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4c1d8-25c4-4f34-b3ac-51d102e3cc2f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:42.610928 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eceebea-7cbe-4744-92c2-aa89dbe73124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:42.612099 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eceebea-7cbe-4744-92c2-aa89dbe73124 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:42.612611 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eceebea-7cbe-4744-92c2-aa89dbe73124 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:42.613047 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eceebea-7cbe-4744-92c2-aa89dbe73124 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:42.614242 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eceebea-7cbe-4744-92c2-aa89dbe73124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:42.614715 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eceebea-7cbe-4744-92c2-aa89dbe73124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:42.617412 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eceebea-7cbe-4744-92c2-aa89dbe73124 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:42.643521 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 357/710] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:42.650505 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aba793-0938-4d08-a793-0cf5aa79e698 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:42.668459 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aba793-0938-4d08-a793-0cf5aa79e698 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:42.675492 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a2be8-8d13-406d-9cdc-25f2b813f553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:42.676763 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a2be8-8d13-406d-9cdc-25f2b813f553 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:42.677175 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a2be8-8d13-406d-9cdc-25f2b813f553 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:42.677641 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a2be8-8d13-406d-9cdc-25f2b813f553 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:42.689456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a2be8-8d13-406d-9cdc-25f2b813f553 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:42.692965 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a2be8-8d13-406d-9cdc-25f2b813f553 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:42.708058 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-769a2be8-8d13-406d-9cdc-25f2b813f553 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 02:52:42.709692 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 354/711] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:52:42 2021] GET /identity/v3/users/swift => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:42.716023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eceebea-7cbe-4744-92c2-aa89dbe73124 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:42.732712 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eceebea-7cbe-4744-92c2-aa89dbe73124 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:42.748665 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb492c-73ab-4fa8-a50c-a758dd26bd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:42.749450 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb492c-73ab-4fa8-a50c-a758dd26bd05 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:42.749732 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb492c-73ab-4fa8-a50c-a758dd26bd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:42.750007 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb492c-73ab-4fa8-a50c-a758dd26bd05 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:42.750847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb492c-73ab-4fa8-a50c-a758dd26bd05 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:42.751151 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb492c-73ab-4fa8-a50c-a758dd26bd05 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:42.753038 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb492c-73ab-4fa8-a50c-a758dd26bd05 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:42.783645 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 358/712] 10.222.0.39 () {56 vars in 1157 bytes} [Tue Aug 31 02:52:42 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:42.790471 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a2be8-8d13-406d-9cdc-25f2b813f553 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:42.804321 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a2be8-8d13-406d-9cdc-25f2b813f553 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:42.805501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee0870-8470-4345-9b15-657713408976 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:42.805792 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee0870-8470-4345-9b15-657713408976 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:42.806071 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee0870-8470-4345-9b15-657713408976 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:42.808145 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 359/713] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:52:42.809330 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b88449-a157-4634-b1f3-c288e32171aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:42.810334 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b88449-a157-4634-b1f3-c288e32171aa admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:42.810799 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b88449-a157-4634-b1f3-c288e32171aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:42.811259 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b88449-a157-4634-b1f3-c288e32171aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:42.813858 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efd7e0-cc7a-42b7-a329-f51c0d7ebe07 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:42.814144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efd7e0-cc7a-42b7-a329-f51c0d7ebe07 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:42.814420 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efd7e0-cc7a-42b7-a329-f51c0d7ebe07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:42.823782 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b88449-a157-4634-b1f3-c288e32171aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:42.825840 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b88449-a157-4634-b1f3-c288e32171aa admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:42.842171 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-24efd7e0-cc7a-42b7-a329-f51c0d7ebe07 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:42.845050 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-24efd7e0-cc7a-42b7-a329-f51c0d7ebe07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:42.846030 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-b6b88449-a157-4634-b1f3-c288e32171aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:42.847423 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 355/714] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:42.853236 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b88449-a157-4634-b1f3-c288e32171aa admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:42.859427 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 360/715] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:42 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:42.872560 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b88449-a157-4634-b1f3-c288e32171aa admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:42.882265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b4ecd-1df7-421e-bd81-7a745ed2138c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:42.882909 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b4ecd-1df7-421e-bd81-7a745ed2138c admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:42.883199 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b4ecd-1df7-421e-bd81-7a745ed2138c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:42.883526 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b4ecd-1df7-421e-bd81-7a745ed2138c admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:42.884243 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b4ecd-1df7-421e-bd81-7a745ed2138c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:42.884547 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b4ecd-1df7-421e-bd81-7a745ed2138c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:42.886117 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b4ecd-1df7-421e-bd81-7a745ed2138c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:42.904515 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 356/716] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:42.909423 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efd7e0-cc7a-42b7-a329-f51c0d7ebe07 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:42.914399 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b4ecd-1df7-421e-bd81-7a745ed2138c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:42.925910 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efd7e0-cc7a-42b7-a329-f51c0d7ebe07 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:42.928610 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b4ecd-1df7-421e-bd81-7a745ed2138c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:42.935819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b4415-4ab4-44df-a5e6-c26afe2d6890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:42.937202 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b4415-4ab4-44df-a5e6-c26afe2d6890 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:42.937623 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b4415-4ab4-44df-a5e6-c26afe2d6890 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:42.937901 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b4415-4ab4-44df-a5e6-c26afe2d6890 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:42.938555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b4415-4ab4-44df-a5e6-c26afe2d6890 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:42.940175 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b4415-4ab4-44df-a5e6-c26afe2d6890 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:42.941072 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535c7f6-88bd-4fcb-8cdf-c03637bb7ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:42.941841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535c7f6-88bd-4fcb-8cdf-c03637bb7ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:42.942115 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535c7f6-88bd-4fcb-8cdf-c03637bb7ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:42.942382 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535c7f6-88bd-4fcb-8cdf-c03637bb7ff2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:42.958989 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-e91b4415-4ab4-44df-a5e6-c26afe2d6890 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 02:52:42.960395 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 361/717] 10.222.0.39 () {56 vars in 1151 bytes} [Tue Aug 31 02:52:42 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:42.960920 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535c7f6-88bd-4fcb-8cdf-c03637bb7ff2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:42.962865 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535c7f6-88bd-4fcb-8cdf-c03637bb7ff2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:42.975041 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b4415-4ab4-44df-a5e6-c26afe2d6890 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:42.988342 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-b535c7f6-88bd-4fcb-8cdf-c03637bb7ff2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:42.992872 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 357/718] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:42.999442 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b4415-4ab4-44df-a5e6-c26afe2d6890 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:43.000802 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535c7f6-88bd-4fcb-8cdf-c03637bb7ff2 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:43.004737 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732560c0-74e6-4004-a32e-d2c80ae8d9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:43.006716 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732560c0-74e6-4004-a32e-d2c80ae8d9ad admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:43.007003 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732560c0-74e6-4004-a32e-d2c80ae8d9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:43.007276 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732560c0-74e6-4004-a32e-d2c80ae8d9ad admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:43.008133 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732560c0-74e6-4004-a32e-d2c80ae8d9ad admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:43.008416 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732560c0-74e6-4004-a32e-d2c80ae8d9ad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:43.019404 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732560c0-74e6-4004-a32e-d2c80ae8d9ad admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:43.023295 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535c7f6-88bd-4fcb-8cdf-c03637bb7ff2 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:43.026899 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 362/719] 10.222.0.39 () {56 vars in 1146 bytes} [Tue Aug 31 02:52:42 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:43.034744 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0529290-7008-42f0-b0ff-3a644070802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:43.035637 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0529290-7008-42f0-b0ff-3a644070802a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:43.036174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0529290-7008-42f0-b0ff-3a644070802a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:43.036592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0529290-7008-42f0-b0ff-3a644070802a admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:43.037602 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0529290-7008-42f0-b0ff-3a644070802a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:43.038072 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0529290-7008-42f0-b0ff-3a644070802a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:43.040210 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0529290-7008-42f0-b0ff-3a644070802a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:43.048709 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732560c0-74e6-4004-a32e-d2c80ae8d9ad admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:43.064100 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732560c0-74e6-4004-a32e-d2c80ae8d9ad admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:43.069576 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 358/720] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:43.074880 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0529290-7008-42f0-b0ff-3a644070802a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:43.077340 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a83531-dc6c-4dc0-b461-a7ab113b0ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:43.078177 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a83531-dc6c-4dc0-b461-a7ab113b0ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:43.078653 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a83531-dc6c-4dc0-b461-a7ab113b0ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:43.079073 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a83531-dc6c-4dc0-b461-a7ab113b0ee8 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:43.080289 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a83531-dc6c-4dc0-b461-a7ab113b0ee8 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:43.080790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a83531-dc6c-4dc0-b461-a7ab113b0ee8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:43.082822 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a83531-dc6c-4dc0-b461-a7ab113b0ee8 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:43.091018 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0529290-7008-42f0-b0ff-3a644070802a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:43.093066 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 363/721] 10.222.0.39 () {56 vars in 1146 bytes} [Tue Aug 31 02:52:43 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:43.099174 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a83531-dc6c-4dc0-b461-a7ab113b0ee8 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:43.104539 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1574753-5609-4ca0-896a-aeaaa372d8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:43.105673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1574753-5609-4ca0-896a-aeaaa372d8ea admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:43.106121 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1574753-5609-4ca0-896a-aeaaa372d8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:43.106623 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1574753-5609-4ca0-896a-aeaaa372d8ea admin admin] PATH_INFO: `/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/55ed84d2e3ce4c85b552732f3294aac6/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:43.110837 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1574753-5609-4ca0-896a-aeaaa372d8ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=011ec8d2410644a3b7d51a90f803b441, user_id=55ed84d2e3ce4c85b552732f3294aac6, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:43.115881 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a83531-dc6c-4dc0-b461-a7ab113b0ee8 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:43.116308 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1574753-5609-4ca0-896a-aeaaa372d8ea admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:43.133944 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 359/722] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:52:43 2021] PUT /identity/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/55ed84d2e3ce4c85b552732f3294aac6/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 02:52:43.136770 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef3a59-a099-4ff9-96f7-f1c69780f35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:43.137714 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef3a59-a099-4ff9-96f7-f1c69780f35d admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:43.138178 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef3a59-a099-4ff9-96f7-f1c69780f35d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:43.138666 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef3a59-a099-4ff9-96f7-f1c69780f35d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:43.139921 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef3a59-a099-4ff9-96f7-f1c69780f35d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:43.141233 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-4eef3a59-a099-4ff9-96f7-f1c69780f35d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:43.141233 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 02:52:43.141233 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 02:52:43.142514 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef3a59-a099-4ff9-96f7-f1c69780f35d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:43.171737 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 364/723] 10.222.0.39 () {60 vars in 1166 bytes} [Tue Aug 31 02:52:43 2021] POST /identity/v3/endpoints => generated 346 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:52:43.812952 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bb027-8971-4375-bd56-52b388699950 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:43.813839 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bb027-8971-4375-bd56-52b388699950 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:43.814262 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bb027-8971-4375-bd56-52b388699950 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:43.816492 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 360/724] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:43.822199 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f029a0-d1de-44d0-8bb0-8effadec15fe None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:43.822973 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f029a0-d1de-44d0-8bb0-8effadec15fe None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:43.823418 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f029a0-d1de-44d0-8bb0-8effadec15fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:43.845916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-35f029a0-d1de-44d0-8bb0-8effadec15fe None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:43.847342 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-35f029a0-d1de-44d0-8bb0-8effadec15fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:43.932942 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 365/725] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:43 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:43.975483 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bb027-8971-4375-bd56-52b388699950 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:43.989009 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bb027-8971-4375-bd56-52b388699950 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:43.997792 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c40a5-ce4f-4d0f-8a08-70fe6ab32872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:43.998873 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c40a5-ce4f-4d0f-8a08-70fe6ab32872 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:43.999504 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c40a5-ce4f-4d0f-8a08-70fe6ab32872 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:43.999955 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c40a5-ce4f-4d0f-8a08-70fe6ab32872 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:44.000747 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c40a5-ce4f-4d0f-8a08-70fe6ab32872 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:44.002479 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c40a5-ce4f-4d0f-8a08-70fe6ab32872 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:44.017793 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-307c40a5-ce4f-4d0f-8a08-70fe6ab32872 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 02:52:44.019271 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 361/726] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:43 2021] GET /identity/v3/services/network => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:44.025486 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f029a0-d1de-44d0-8bb0-8effadec15fe None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:44.035944 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f029a0-d1de-44d0-8bb0-8effadec15fe None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:44.047895 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28215e-99b4-4077-9082-55d1b4368525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:44.048858 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28215e-99b4-4077-9082-55d1b4368525 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:44.049352 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28215e-99b4-4077-9082-55d1b4368525 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:44.049850 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28215e-99b4-4077-9082-55d1b4368525 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:44.050827 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28215e-99b4-4077-9082-55d1b4368525 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:44.051356 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28215e-99b4-4077-9082-55d1b4368525 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:44.053187 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28215e-99b4-4077-9082-55d1b4368525 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:44.058354 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 366/727] 10.222.0.39 () {56 vars in 1134 bytes} [Tue Aug 31 02:52:44 2021] GET /identity/v3/services?name=network => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:44.064891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c40a5-ce4f-4d0f-8a08-70fe6ab32872 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:44.080296 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c40a5-ce4f-4d0f-8a08-70fe6ab32872 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:44.087454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc166744-e18e-46fe-a7f6-735e585da21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:44.088107 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc166744-e18e-46fe-a7f6-735e585da21f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:44.088386 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc166744-e18e-46fe-a7f6-735e585da21f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:44.088658 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc166744-e18e-46fe-a7f6-735e585da21f admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:44.089359 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc166744-e18e-46fe-a7f6-735e585da21f admin admin] RBAC: Adding query filter params (type=network) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:44.089659 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc166744-e18e-46fe-a7f6-735e585da21f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:44.091233 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc166744-e18e-46fe-a7f6-735e585da21f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:44.099565 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 362/728] 10.222.0.39 () {56 vars in 1134 bytes} [Tue Aug 31 02:52:44 2021] GET /identity/v3/services?type=network => generated 350 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:44.111697 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28215e-99b4-4077-9082-55d1b4368525 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:44.122657 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28215e-99b4-4077-9082-55d1b4368525 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:44.132500 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fb8ae-3a32-4c7c-b881-a59d46743772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:44.133410 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fb8ae-3a32-4c7c-b881-a59d46743772 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:44.133925 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fb8ae-3a32-4c7c-b881-a59d46743772 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:44.134410 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fb8ae-3a32-4c7c-b881-a59d46743772 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:44.135431 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fb8ae-3a32-4c7c-b881-a59d46743772 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:44.137426 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fb8ae-3a32-4c7c-b881-a59d46743772 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:44.165267 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 367/729] 10.222.0.39 () {60 vars in 1166 bytes} [Tue Aug 31 02:52:44 2021] POST /identity/v3/endpoints => generated 327 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:52:44.427630 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaf582-d86f-4a71-af90-6978794ecad5 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:44.427997 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaf582-d86f-4a71-af90-6978794ecad5 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:44.428100 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaf582-d86f-4a71-af90-6978794ecad5 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:44.429843 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 363/730] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:44.435751 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e67b5-060f-41bb-911c-80ea7319a282 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:44.436037 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e67b5-060f-41bb-911c-80ea7319a282 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:44.436499 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e67b5-060f-41bb-911c-80ea7319a282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:44.457346 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-c09e67b5-060f-41bb-911c-80ea7319a282 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:44.458524 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c09e67b5-060f-41bb-911c-80ea7319a282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:44.476373 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 368/731] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:44 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:44.501103 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baaf582-d86f-4a71-af90-6978794ecad5 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:44.513194 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baaf582-d86f-4a71-af90-6978794ecad5 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:44.519015 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd6397-0138-4119-853c-83387eac2757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:44.519825 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd6397-0138-4119-853c-83387eac2757 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:44.520105 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd6397-0138-4119-853c-83387eac2757 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:44.520379 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd6397-0138-4119-853c-83387eac2757 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:44.533797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd6397-0138-4119-853c-83387eac2757 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:44.541393 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-a9bd6397-0138-4119-853c-83387eac2757 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:52:44.542899 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 364/732] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:52:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:44.549538 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e67b5-060f-41bb-911c-80ea7319a282 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:44.558709 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e67b5-060f-41bb-911c-80ea7319a282 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:44.564618 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59a61f-4e38-49c6-9d4d-e5991d9e18fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:44.565282 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59a61f-4e38-49c6-9d4d-e5991d9e18fe admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:44.565558 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59a61f-4e38-49c6-9d4d-e5991d9e18fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:44.565831 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59a61f-4e38-49c6-9d4d-e5991d9e18fe admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:44.566570 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59a61f-4e38-49c6-9d4d-e5991d9e18fe admin admin] RBAC: Adding query filter params (name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:44.566868 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59a61f-4e38-49c6-9d4d-e5991d9e18fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:44.571624 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59a61f-4e38-49c6-9d4d-e5991d9e18fe admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:44.580171 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 369/733] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:52:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:44.586494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd6397-0138-4119-853c-83387eac2757 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:44.598795 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd6397-0138-4119-853c-83387eac2757 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:44.603765 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7205a-66d9-49f6-a55b-cb08c8d11f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:44.604759 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7205a-66d9-49f6-a55b-cb08c8d11f3d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:44.605200 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7205a-66d9-49f6-a55b-cb08c8d11f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:44.605657 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7205a-66d9-49f6-a55b-cb08c8d11f3d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:44.617806 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7205a-66d9-49f6-a55b-cb08c8d11f3d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:44.619919 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7205a-66d9-49f6-a55b-cb08c8d11f3d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:44.637004 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-fed7205a-66d9-49f6-a55b-cb08c8d11f3d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:44.638777 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 365/734] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:44.646041 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59a61f-4e38-49c6-9d4d-e5991d9e18fe admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:44.657093 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59a61f-4e38-49c6-9d4d-e5991d9e18fe admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:44.663655 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bda20-80fe-4a27-8c45-4140d2924b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:44.664492 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bda20-80fe-4a27-8c45-4140d2924b7e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:44.664993 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bda20-80fe-4a27-8c45-4140d2924b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:44.665408 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bda20-80fe-4a27-8c45-4140d2924b7e admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:44.666340 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bda20-80fe-4a27-8c45-4140d2924b7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:44.666783 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bda20-80fe-4a27-8c45-4140d2924b7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:44.668568 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bda20-80fe-4a27-8c45-4140d2924b7e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:44.682438 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 370/735] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:44.688330 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7205a-66d9-49f6-a55b-cb08c8d11f3d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:44.699665 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7205a-66d9-49f6-a55b-cb08c8d11f3d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:44.705590 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae9e70-fb32-4c9c-8f36-dd7a779d4616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:44.706650 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae9e70-fb32-4c9c-8f36-dd7a779d4616 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:44.707067 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae9e70-fb32-4c9c-8f36-dd7a779d4616 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:44.707508 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae9e70-fb32-4c9c-8f36-dd7a779d4616 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:44.720283 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae9e70-fb32-4c9c-8f36-dd7a779d4616 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:44.724156 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae9e70-fb32-4c9c-8f36-dd7a779d4616 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:44.744423 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-cfae9e70-fb32-4c9c-8f36-dd7a779d4616 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 02:52:44.745954 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 366/736] 10.222.0.39 () {56 vars in 1139 bytes} [Tue Aug 31 02:52:44 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:44.753495 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bda20-80fe-4a27-8c45-4140d2924b7e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:44.772778 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bda20-80fe-4a27-8c45-4140d2924b7e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:44.779134 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a89e4-92a0-4131-929f-01133b4e5541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:44.780403 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a89e4-92a0-4131-929f-01133b4e5541 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:44.781088 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a89e4-92a0-4131-929f-01133b4e5541 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:44.781677 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a89e4-92a0-4131-929f-01133b4e5541 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:44.782758 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a89e4-92a0-4131-929f-01133b4e5541 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:44.783205 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a89e4-92a0-4131-929f-01133b4e5541 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:44.785203 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a89e4-92a0-4131-929f-01133b4e5541 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:44.805327 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 371/737] 10.222.0.39 () {56 vars in 1171 bytes} [Tue Aug 31 02:52:44 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:44.811993 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae9e70-fb32-4c9c-8f36-dd7a779d4616 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:44.822217 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae9e70-fb32-4c9c-8f36-dd7a779d4616 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:44.827754 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1173289-4511-4c43-8052-629dd2ab8334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:44.828423 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1173289-4511-4c43-8052-629dd2ab8334 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:44.828708 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1173289-4511-4c43-8052-629dd2ab8334 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:44.828987 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1173289-4511-4c43-8052-629dd2ab8334 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:44.837654 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1173289-4511-4c43-8052-629dd2ab8334 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:44.839437 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1173289-4511-4c43-8052-629dd2ab8334 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:44.849035 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 367/738] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:44 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:44.855157 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a89e4-92a0-4131-929f-01133b4e5541 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:44.865226 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a89e4-92a0-4131-929f-01133b4e5541 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:44.870072 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005bbc3-7fe6-4c1c-b6bf-c0616ba94598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:44.870919 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005bbc3-7fe6-4c1c-b6bf-c0616ba94598 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:44.871206 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005bbc3-7fe6-4c1c-b6bf-c0616ba94598 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:44.871774 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005bbc3-7fe6-4c1c-b6bf-c0616ba94598 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:44.887527 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005bbc3-7fe6-4c1c-b6bf-c0616ba94598 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:44.889901 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005bbc3-7fe6-4c1c-b6bf-c0616ba94598 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:44.908141 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-e005bbc3-7fe6-4c1c-b6bf-c0616ba94598 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:44.909948 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 372/739] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:44.916639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1173289-4511-4c43-8052-629dd2ab8334 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:44.925720 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1173289-4511-4c43-8052-629dd2ab8334 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:44.930433 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add19a1-f803-4ce4-8f9e-54b5261bb8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:44.931086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add19a1-f803-4ce4-8f9e-54b5261bb8bf admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:44.931395 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add19a1-f803-4ce4-8f9e-54b5261bb8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:44.931684 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add19a1-f803-4ce4-8f9e-54b5261bb8bf admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:44.932406 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add19a1-f803-4ce4-8f9e-54b5261bb8bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:44.932758 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add19a1-f803-4ce4-8f9e-54b5261bb8bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:44.934287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add19a1-f803-4ce4-8f9e-54b5261bb8bf admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:44.948602 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 368/740] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:44.955017 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005bbc3-7fe6-4c1c-b6bf-c0616ba94598 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:44.965585 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005bbc3-7fe6-4c1c-b6bf-c0616ba94598 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:44.971036 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309df253-344f-4af9-9855-509a7c7a18ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:44.971933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309df253-344f-4af9-9855-509a7c7a18ca admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:44.972274 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309df253-344f-4af9-9855-509a7c7a18ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:44.972553 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309df253-344f-4af9-9855-509a7c7a18ca admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:44.980362 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309df253-344f-4af9-9855-509a7c7a18ca admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:44.982400 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309df253-344f-4af9-9855-509a7c7a18ca admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:44.996016 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-309df253-344f-4af9-9855-509a7c7a18ca admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:44.997798 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 373/741] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:45.004847 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add19a1-f803-4ce4-8f9e-54b5261bb8bf admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:45.015323 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add19a1-f803-4ce4-8f9e-54b5261bb8bf admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:45.020050 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dbd1b-a53c-44c0-aa51-cc60832ee84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:45.020757 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dbd1b-a53c-44c0-aa51-cc60832ee84c admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:45.021041 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dbd1b-a53c-44c0-aa51-cc60832ee84c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:45.021318 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94dbd1b-a53c-44c0-aa51-cc60832ee84c admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:45.022149 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94dbd1b-a53c-44c0-aa51-cc60832ee84c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:45.022456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94dbd1b-a53c-44c0-aa51-cc60832ee84c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:45.024387 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94dbd1b-a53c-44c0-aa51-cc60832ee84c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:45.037597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 369/742] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:45.039278 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23abe9-ddc2-4776-9603-0b92c4821e2a None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:45.039804 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23abe9-ddc2-4776-9603-0b92c4821e2a None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:45.040318 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23abe9-ddc2-4776-9603-0b92c4821e2a None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:45.042454 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 374/743] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:52:45.047278 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dbd1b-a53c-44c0-aa51-cc60832ee84c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:45.048557 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f93496-5e51-4573-bd46-1f903564a439 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:45.048838 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f93496-5e51-4573-bd46-1f903564a439 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:45.049113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f93496-5e51-4573-bd46-1f903564a439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:45.063960 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94dbd1b-a53c-44c0-aa51-cc60832ee84c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:45.070612 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a114a-961e-4a07-8e7a-ad224bb1143b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:45.070862 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-82f93496-5e51-4573-bd46-1f903564a439 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:45.071786 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a114a-961e-4a07-8e7a-ad224bb1143b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:45.072096 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-82f93496-5e51-4573-bd46-1f903564a439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:45.072570 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a114a-961e-4a07-8e7a-ad224bb1143b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:45.073344 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a114a-961e-4a07-8e7a-ad224bb1143b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:45.074815 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a114a-961e-4a07-8e7a-ad224bb1143b admin admin] RBAC: Adding query filter params (role.id=ee8894ccdace402484c35b0cb5292526, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=b1918e2aa8f24655875480ef52df324d) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:45.075577 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a114a-961e-4a07-8e7a-ad224bb1143b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:45.078907 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a114a-961e-4a07-8e7a-ad224bb1143b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:45.087400 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 375/744] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:45 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:45.088465 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 370/745] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:45 2021] GET /identity/v3/role_assignments?user.id=b1918e2aa8f24655875480ef52df324d&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=ee8894ccdace402484c35b0cb5292526 => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:45.107693 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f93496-5e51-4573-bd46-1f903564a439 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:45.118923 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f93496-5e51-4573-bd46-1f903564a439 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:45.125330 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2507c24-0a35-496d-94c6-9ad92b58d2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:45.127222 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2507c24-0a35-496d-94c6-9ad92b58d2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:45.127741 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2507c24-0a35-496d-94c6-9ad92b58d2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:45.128237 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2507c24-0a35-496d-94c6-9ad92b58d2d0 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:45.129199 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2507c24-0a35-496d-94c6-9ad92b58d2d0 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:45.131117 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2507c24-0a35-496d-94c6-9ad92b58d2d0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:45.144077 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-a2507c24-0a35-496d-94c6-9ad92b58d2d0 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 02:52:45.145986 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 376/746] 10.222.0.39 () {56 vars in 1154 bytes} [Tue Aug 31 02:52:45 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:45.152933 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a114a-961e-4a07-8e7a-ad224bb1143b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:45.165820 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a114a-961e-4a07-8e7a-ad224bb1143b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:45.171842 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83ec99-b329-4f54-a7fc-30800e599f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:45.172985 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83ec99-b329-4f54-a7fc-30800e599f98 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:45.173479 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83ec99-b329-4f54-a7fc-30800e599f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:45.174017 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83ec99-b329-4f54-a7fc-30800e599f98 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:45.174946 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83ec99-b329-4f54-a7fc-30800e599f98 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:45.175533 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83ec99-b329-4f54-a7fc-30800e599f98 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:45.177482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83ec99-b329-4f54-a7fc-30800e599f98 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:45.183511 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 371/747] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Aug 31 02:52:45 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:45.190906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2507c24-0a35-496d-94c6-9ad92b58d2d0 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:45.201915 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2507c24-0a35-496d-94c6-9ad92b58d2d0 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:45.207186 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4b9b1-cba3-4a0b-bc1a-5a67f2f4e46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:45.208290 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4b9b1-cba3-4a0b-bc1a-5a67f2f4e46c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:45.208785 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4b9b1-cba3-4a0b-bc1a-5a67f2f4e46c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:45.209336 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4b9b1-cba3-4a0b-bc1a-5a67f2f4e46c admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:45.210307 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4b9b1-cba3-4a0b-bc1a-5a67f2f4e46c admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:45.210834 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4b9b1-cba3-4a0b-bc1a-5a67f2f4e46c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:45.212810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4b9b1-cba3-4a0b-bc1a-5a67f2f4e46c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:45.218909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 377/748] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Aug 31 02:52:45 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:45.817480 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e8bb2-0727-4b78-b845-f47b59bfc40d None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:45.817902 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e8bb2-0727-4b78-b845-f47b59bfc40d None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:45.818081 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e8bb2-0727-4b78-b845-f47b59bfc40d None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:45.820280 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 372/749] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:45.827797 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0ea09-800c-4178-8ccc-d0f5f60355cd None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:45.828091 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0ea09-800c-4178-8ccc-d0f5f60355cd None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:45.828360 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0ea09-800c-4178-8ccc-d0f5f60355cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:45.845912 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-c4c0ea09-800c-4178-8ccc-d0f5f60355cd None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:45.847097 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c4c0ea09-800c-4178-8ccc-d0f5f60355cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:45.859467 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 378/750] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:45 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:45.881191 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e8bb2-0727-4b78-b845-f47b59bfc40d None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:45.884666 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63706c83-24e7-4b7b-861f-0b5dc6ac547a None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:45.884952 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63706c83-24e7-4b7b-861f-0b5dc6ac547a None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:45.885232 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63706c83-24e7-4b7b-861f-0b5dc6ac547a None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:45.887264 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 379/751] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:45.895410 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13244668-ea11-4d63-8f0f-74f1bdb4c46f None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:45.895684 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13244668-ea11-4d63-8f0f-74f1bdb4c46f None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:45.895966 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13244668-ea11-4d63-8f0f-74f1bdb4c46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:45.899540 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e8bb2-0727-4b78-b845-f47b59bfc40d None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:45.904340 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea252e4-3781-4227-86e4-1d2ae7b5e414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:45.905433 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea252e4-3781-4227-86e4-1d2ae7b5e414 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:45.905998 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea252e4-3781-4227-86e4-1d2ae7b5e414 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:45.906472 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea252e4-3781-4227-86e4-1d2ae7b5e414 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:45.914529 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-13244668-ea11-4d63-8f0f-74f1bdb4c46f None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:45.915761 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-13244668-ea11-4d63-8f0f-74f1bdb4c46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:45.919402 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea252e4-3781-4227-86e4-1d2ae7b5e414 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:45.924535 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 380/752] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:45 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:45.935383 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-9ea252e4-3781-4227-86e4-1d2ae7b5e414 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:52:45.935383 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 373/753] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:52:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:45.944391 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13244668-ea11-4d63-8f0f-74f1bdb4c46f None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:45.951847 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea252e4-3781-4227-86e4-1d2ae7b5e414 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:45.954372 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13244668-ea11-4d63-8f0f-74f1bdb4c46f None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:45.959405 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f476e5e-e56b-4165-9c0f-5b014b901aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:45.959695 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f476e5e-e56b-4165-9c0f-5b014b901aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:45.959981 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f476e5e-e56b-4165-9c0f-5b014b901aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:45.960256 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f476e5e-e56b-4165-9c0f-5b014b901aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:45.961004 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f476e5e-e56b-4165-9c0f-5b014b901aa4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:45.961307 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f476e5e-e56b-4165-9c0f-5b014b901aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:45.962914 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f476e5e-e56b-4165-9c0f-5b014b901aa4 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:45.964276 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea252e4-3781-4227-86e4-1d2ae7b5e414 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:45.969074 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a704f37-a2f9-4e58-b841-2b39f96dc2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:45.970124 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a704f37-a2f9-4e58-b841-2b39f96dc2bf admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:45.970621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a704f37-a2f9-4e58-b841-2b39f96dc2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:45.971096 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a704f37-a2f9-4e58-b841-2b39f96dc2bf admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:45.971980 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a704f37-a2f9-4e58-b841-2b39f96dc2bf admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:45.972566 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 381/754] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:45.973966 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a704f37-a2f9-4e58-b841-2b39f96dc2bf admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:45.979023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f476e5e-e56b-4165-9c0f-5b014b901aa4 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:45.986467 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-0a704f37-a2f9-4e58-b841-2b39f96dc2bf admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 02:52:45.987966 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 374/755] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:45 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:45.989481 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f476e5e-e56b-4165-9c0f-5b014b901aa4 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:45.995284 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a704f37-a2f9-4e58-b841-2b39f96dc2bf admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:45.995482 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc03b81-e8dd-4514-8332-5b6f589cbc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:45.996784 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc03b81-e8dd-4514-8332-5b6f589cbc02 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:45.997209 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc03b81-e8dd-4514-8332-5b6f589cbc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:45.997621 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc03b81-e8dd-4514-8332-5b6f589cbc02 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:46.006127 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a704f37-a2f9-4e58-b841-2b39f96dc2bf admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:46.010554 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc03b81-e8dd-4514-8332-5b6f589cbc02 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:46.010677 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae69a1-f20e-4397-a101-a9400bf6c047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:46.011263 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae69a1-f20e-4397-a101-a9400bf6c047 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:46.011585 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae69a1-f20e-4397-a101-a9400bf6c047 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:46.011861 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae69a1-f20e-4397-a101-a9400bf6c047 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:46.012561 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae69a1-f20e-4397-a101-a9400bf6c047 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:46.012867 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae69a1-f20e-4397-a101-a9400bf6c047 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:46.013640 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc03b81-e8dd-4514-8332-5b6f589cbc02 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:46.015167 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae69a1-f20e-4397-a101-a9400bf6c047 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:46.020676 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 375/756] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:45 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:46.026632 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae69a1-f20e-4397-a101-a9400bf6c047 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:46.033375 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-3dc03b81-e8dd-4514-8332-5b6f589cbc02 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:46.040158 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae69a1-f20e-4397-a101-a9400bf6c047 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:46.040428 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 382/757] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:46.040802 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e99e66-53a3-4e3c-ae7d-a51f8ffb2546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:46.041458 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e99e66-53a3-4e3c-ae7d-a51f8ffb2546 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:46.041741 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e99e66-53a3-4e3c-ae7d-a51f8ffb2546 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:46.042014 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e99e66-53a3-4e3c-ae7d-a51f8ffb2546 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:46.042567 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc03b81-e8dd-4514-8332-5b6f589cbc02 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:46.042729 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e99e66-53a3-4e3c-ae7d-a51f8ffb2546 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:46.043012 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e99e66-53a3-4e3c-ae7d-a51f8ffb2546 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:46.044747 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e99e66-53a3-4e3c-ae7d-a51f8ffb2546 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:46.050689 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 376/758] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:46 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:46.054254 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc03b81-e8dd-4514-8332-5b6f589cbc02 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:46.059518 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7bf85-95ae-4abd-a340-ef0a1e40b9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:46.060517 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7bf85-95ae-4abd-a340-ef0a1e40b9ae admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:46.061063 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7bf85-95ae-4abd-a340-ef0a1e40b9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:46.062119 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7bf85-95ae-4abd-a340-ef0a1e40b9ae admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:46.063085 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7bf85-95ae-4abd-a340-ef0a1e40b9ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:46.063635 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7bf85-95ae-4abd-a340-ef0a1e40b9ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:46.065537 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7bf85-95ae-4abd-a340-ef0a1e40b9ae admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:46.085432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 383/759] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:46.087148 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e99e66-53a3-4e3c-ae7d-a51f8ffb2546 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:46.097830 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e99e66-53a3-4e3c-ae7d-a51f8ffb2546 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:46.103049 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736918be-12e4-4d97-89a9-1808b0ece9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:46.104213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736918be-12e4-4d97-89a9-1808b0ece9bc admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:46.104680 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736918be-12e4-4d97-89a9-1808b0ece9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:46.105212 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736918be-12e4-4d97-89a9-1808b0ece9bc admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:46.116397 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736918be-12e4-4d97-89a9-1808b0ece9bc admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:46.118852 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736918be-12e4-4d97-89a9-1808b0ece9bc admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:46.135054 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-736918be-12e4-4d97-89a9-1808b0ece9bc admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 02:52:46.142551 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 377/760] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:52:46 2021] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:46.144261 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7bf85-95ae-4abd-a340-ef0a1e40b9ae admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:46.154871 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7bf85-95ae-4abd-a340-ef0a1e40b9ae admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:46.160101 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5569f6-7b33-4896-bc7a-5b857e6d4e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:46.161089 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5569f6-7b33-4896-bc7a-5b857e6d4e75 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:46.161552 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5569f6-7b33-4896-bc7a-5b857e6d4e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:46.162035 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5569f6-7b33-4896-bc7a-5b857e6d4e75 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:46.163137 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5569f6-7b33-4896-bc7a-5b857e6d4e75 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:46.163654 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5569f6-7b33-4896-bc7a-5b857e6d4e75 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:46.165743 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5569f6-7b33-4896-bc7a-5b857e6d4e75 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:46.191498 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 384/761] 10.222.0.39 () {56 vars in 1157 bytes} [Tue Aug 31 02:52:46 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:46.194174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736918be-12e4-4d97-89a9-1808b0ece9bc admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:46.205310 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736918be-12e4-4d97-89a9-1808b0ece9bc admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:46.210488 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08664e-73f2-41f6-b7e2-a4f4c48984e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:46.211478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08664e-73f2-41f6-b7e2-a4f4c48984e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:46.211997 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08664e-73f2-41f6-b7e2-a4f4c48984e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:46.212476 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08664e-73f2-41f6-b7e2-a4f4c48984e9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:46.222591 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08664e-73f2-41f6-b7e2-a4f4c48984e9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:46.224646 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08664e-73f2-41f6-b7e2-a4f4c48984e9 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:46.234580 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 378/762] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:46 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:46.241149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5569f6-7b33-4896-bc7a-5b857e6d4e75 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:46.253628 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5569f6-7b33-4896-bc7a-5b857e6d4e75 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:46.259500 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80cd6b-3fd3-42c5-bbb2-edb4fab24410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:46.260357 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80cd6b-3fd3-42c5-bbb2-edb4fab24410 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:46.260710 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80cd6b-3fd3-42c5-bbb2-edb4fab24410 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:46.261045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80cd6b-3fd3-42c5-bbb2-edb4fab24410 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:46.272631 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80cd6b-3fd3-42c5-bbb2-edb4fab24410 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:46.274562 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80cd6b-3fd3-42c5-bbb2-edb4fab24410 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:46.292250 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-4b80cd6b-3fd3-42c5-bbb2-edb4fab24410 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:46.293831 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 385/763] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:46.300617 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08664e-73f2-41f6-b7e2-a4f4c48984e9 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:46.309716 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08664e-73f2-41f6-b7e2-a4f4c48984e9 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:46.315020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31033ac7-254d-41d2-8a2d-5d7df2a3aa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:46.315827 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31033ac7-254d-41d2-8a2d-5d7df2a3aa54 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:46.316213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31033ac7-254d-41d2-8a2d-5d7df2a3aa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:46.316887 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31033ac7-254d-41d2-8a2d-5d7df2a3aa54 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:46.317708 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31033ac7-254d-41d2-8a2d-5d7df2a3aa54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:46.318113 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31033ac7-254d-41d2-8a2d-5d7df2a3aa54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:46.319816 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31033ac7-254d-41d2-8a2d-5d7df2a3aa54 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:46.334068 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 379/764] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:46.340319 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80cd6b-3fd3-42c5-bbb2-edb4fab24410 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:46.350727 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80cd6b-3fd3-42c5-bbb2-edb4fab24410 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:46.355543 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17c8f2-1b6c-4598-ab19-a4e7766ef947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:46.356490 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17c8f2-1b6c-4598-ab19-a4e7766ef947 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:46.356915 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17c8f2-1b6c-4598-ab19-a4e7766ef947 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:46.357333 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17c8f2-1b6c-4598-ab19-a4e7766ef947 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:46.365203 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17c8f2-1b6c-4598-ab19-a4e7766ef947 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:46.367381 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17c8f2-1b6c-4598-ab19-a4e7766ef947 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:46.381994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-5f17c8f2-1b6c-4598-ab19-a4e7766ef947 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:46.387508 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 386/765] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:46.391469 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31033ac7-254d-41d2-8a2d-5d7df2a3aa54 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:46.401523 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31033ac7-254d-41d2-8a2d-5d7df2a3aa54 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:46.406262 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718b81c-900b-4a78-925e-856a9fa5cfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:46.407050 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718b81c-900b-4a78-925e-856a9fa5cfc8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:46.407478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718b81c-900b-4a78-925e-856a9fa5cfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:46.407857 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718b81c-900b-4a78-925e-856a9fa5cfc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:46.408736 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718b81c-900b-4a78-925e-856a9fa5cfc8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:46.409144 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718b81c-900b-4a78-925e-856a9fa5cfc8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:46.411075 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718b81c-900b-4a78-925e-856a9fa5cfc8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:46.423926 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 380/766] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:46.431096 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17c8f2-1b6c-4598-ab19-a4e7766ef947 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:46.443017 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17c8f2-1b6c-4598-ab19-a4e7766ef947 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:46.447768 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4f2d9-3cdb-43f8-9598-61838514f4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:46.448568 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4f2d9-3cdb-43f8-9598-61838514f4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:46.449016 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4f2d9-3cdb-43f8-9598-61838514f4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:46.449435 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4f2d9-3cdb-43f8-9598-61838514f4f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:46.450409 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4f2d9-3cdb-43f8-9598-61838514f4f0 admin admin] RBAC: Adding query filter params (role.id=99835eeda2f64af5bc9173a8370d4568, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=55ed84d2e3ce4c85b552732f3294aac6) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:46.450861 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4f2d9-3cdb-43f8-9598-61838514f4f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:46.453608 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4f2d9-3cdb-43f8-9598-61838514f4f0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:46.467504 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 387/767] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:46 2021] GET /identity/v3/role_assignments?user.id=55ed84d2e3ce4c85b552732f3294aac6&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:47.425942 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25581f8b-7b69-4196-b726-495eb5ffaaae None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:47.426449 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25581f8b-7b69-4196-b726-495eb5ffaaae None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:47.426449 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25581f8b-7b69-4196-b726-495eb5ffaaae None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:47.428421 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 381/768] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:47.434783 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31df13-042e-4f42-83f0-be6100df2d95 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:47.435300 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31df13-042e-4f42-83f0-be6100df2d95 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:47.435300 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31df13-042e-4f42-83f0-be6100df2d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:47.454983 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-ce31df13-042e-4f42-83f0-be6100df2d95 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:47.456258 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ce31df13-042e-4f42-83f0-be6100df2d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:47.464571 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 388/769] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:47 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:47.489666 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25581f8b-7b69-4196-b726-495eb5ffaaae None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:47.502984 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25581f8b-7b69-4196-b726-495eb5ffaaae None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:47.507784 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d5a49-95a0-403d-9759-9078a11d30d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:47.508812 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d5a49-95a0-403d-9759-9078a11d30d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:47.509316 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d5a49-95a0-403d-9759-9078a11d30d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:47.509794 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d5a49-95a0-403d-9759-9078a11d30d4 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:47.521356 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d5a49-95a0-403d-9759-9078a11d30d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:47.529331 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-df2d5a49-95a0-403d-9759-9078a11d30d4 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 02:52:47.529457 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50734706-6a4e-4e74-a6f7-4238ad1f114f None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:47.529693 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50734706-6a4e-4e74-a6f7-4238ad1f114f None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:47.530119 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50734706-6a4e-4e74-a6f7-4238ad1f114f None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:47.531832 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 382/770] 10.222.0.39 () {56 vars in 1142 bytes} [Tue Aug 31 02:52:47 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:47.536502 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 389/771] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:52:47.537996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2114d55-d5bb-486f-8585-e25b304c9cf5 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:47.538514 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2114d55-d5bb-486f-8585-e25b304c9cf5 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:47.539010 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2114d55-d5bb-486f-8585-e25b304c9cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:47.540483 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50734706-6a4e-4e74-a6f7-4238ad1f114f None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:47.556232 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50734706-6a4e-4e74-a6f7-4238ad1f114f None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:47.558686 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-e2114d55-d5bb-486f-8585-e25b304c9cf5 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:47.560174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-e2114d55-d5bb-486f-8585-e25b304c9cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:47.560921 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6806f1-0b45-4ebd-9fae-7d74ce87b76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:47.562432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6806f1-0b45-4ebd-9fae-7d74ce87b76c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:47.562715 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6806f1-0b45-4ebd-9fae-7d74ce87b76c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:47.562997 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6806f1-0b45-4ebd-9fae-7d74ce87b76c admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:47.563785 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6806f1-0b45-4ebd-9fae-7d74ce87b76c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:47.564093 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6806f1-0b45-4ebd-9fae-7d74ce87b76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:47.565882 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6806f1-0b45-4ebd-9fae-7d74ce87b76c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:47.571178 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 383/772] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:47 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:47.574876 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 390/773] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Aug 31 02:52:47 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:47.584591 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2114d55-d5bb-486f-8585-e25b304c9cf5 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:47.594454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2114d55-d5bb-486f-8585-e25b304c9cf5 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:47.596275 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6806f1-0b45-4ebd-9fae-7d74ce87b76c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:47.599600 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8a1d7-ae89-4d15-b12c-2c54db4eb3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:47.600622 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8a1d7-ae89-4d15-b12c-2c54db4eb3da admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:47.601177 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8a1d7-ae89-4d15-b12c-2c54db4eb3da admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:47.601860 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8a1d7-ae89-4d15-b12c-2c54db4eb3da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:47.606973 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6806f1-0b45-4ebd-9fae-7d74ce87b76c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:47.612953 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43364d9-1e12-4cd8-8e0a-42c1ba0ac85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:47.613891 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43364d9-1e12-4cd8-8e0a-42c1ba0ac85e admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:47.614180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43364d9-1e12-4cd8-8e0a-42c1ba0ac85e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:47.614455 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43364d9-1e12-4cd8-8e0a-42c1ba0ac85e admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:47.615112 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8a1d7-ae89-4d15-b12c-2c54db4eb3da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:47.615228 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43364d9-1e12-4cd8-8e0a-42c1ba0ac85e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:47.616796 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43364d9-1e12-4cd8-8e0a-42c1ba0ac85e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:47.617631 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8a1d7-ae89-4d15-b12c-2c54db4eb3da admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:47.633381 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 391/774] 10.222.0.39 () {60 vars in 1163 bytes} [Tue Aug 31 02:52:47 2021] POST /identity/v3/services => generated 269 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 02:52:47.637593 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-15f8a1d7-ae89-4d15-b12c-2c54db4eb3da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:47.639466 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 384/775] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:47.648862 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43364d9-1e12-4cd8-8e0a-42c1ba0ac85e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:47.672705 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43364d9-1e12-4cd8-8e0a-42c1ba0ac85e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:47.677790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d0657-00f2-4086-8ad1-65f10e5283f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:47.678462 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d0657-00f2-4086-8ad1-65f10e5283f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:47.678750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d0657-00f2-4086-8ad1-65f10e5283f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:47.679028 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d0657-00f2-4086-8ad1-65f10e5283f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:47.679826 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d0657-00f2-4086-8ad1-65f10e5283f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:47.680192 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d0657-00f2-4086-8ad1-65f10e5283f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:47.682067 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d0657-00f2-4086-8ad1-65f10e5283f2 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:47.698711 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 392/776] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:47.707318 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8a1d7-ae89-4d15-b12c-2c54db4eb3da admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:47.720679 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8a1d7-ae89-4d15-b12c-2c54db4eb3da admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:47.726731 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e70c9d-d16f-4a02-872a-b0c4b2df1615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:47.727694 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e70c9d-d16f-4a02-872a-b0c4b2df1615 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:47.728037 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e70c9d-d16f-4a02-872a-b0c4b2df1615 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:47.728316 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e70c9d-d16f-4a02-872a-b0c4b2df1615 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:47.737349 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e70c9d-d16f-4a02-872a-b0c4b2df1615 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:47.739549 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e70c9d-d16f-4a02-872a-b0c4b2df1615 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:47.756110 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-88e70c9d-d16f-4a02-872a-b0c4b2df1615 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 02:52:47.757754 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 385/777] 10.222.0.39 () {56 vars in 1139 bytes} [Tue Aug 31 02:52:47 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:47.764797 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d0657-00f2-4086-8ad1-65f10e5283f2 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:47.775227 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d0657-00f2-4086-8ad1-65f10e5283f2 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:47.780096 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2a316-6968-4dd2-a68e-f6d66e47220d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:47.780825 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2a316-6968-4dd2-a68e-f6d66e47220d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:47.781107 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2a316-6968-4dd2-a68e-f6d66e47220d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:47.781376 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2a316-6968-4dd2-a68e-f6d66e47220d admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:47.782234 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2a316-6968-4dd2-a68e-f6d66e47220d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:47.782540 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2a316-6968-4dd2-a68e-f6d66e47220d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:47.784472 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2a316-6968-4dd2-a68e-f6d66e47220d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:47.805004 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 393/778] 10.222.0.39 () {56 vars in 1171 bytes} [Tue Aug 31 02:52:47 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:47.811779 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e70c9d-d16f-4a02-872a-b0c4b2df1615 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:47.821993 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e70c9d-d16f-4a02-872a-b0c4b2df1615 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:47.828629 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58167661-835d-42a5-8a49-e80479a58472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:47.829261 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58167661-835d-42a5-8a49-e80479a58472 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:47.829539 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58167661-835d-42a5-8a49-e80479a58472 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:47.829809 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58167661-835d-42a5-8a49-e80479a58472 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:47.837770 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58167661-835d-42a5-8a49-e80479a58472 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:47.839612 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58167661-835d-42a5-8a49-e80479a58472 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:47.849085 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 386/779] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:47 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:47.856440 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2a316-6968-4dd2-a68e-f6d66e47220d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:47.866360 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2a316-6968-4dd2-a68e-f6d66e47220d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:47.870879 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7291e-a2c4-4634-8844-196a572e397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:47.872051 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7291e-a2c4-4634-8844-196a572e397d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:47.872335 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7291e-a2c4-4634-8844-196a572e397d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:47.872608 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7291e-a2c4-4634-8844-196a572e397d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:47.883939 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7291e-a2c4-4634-8844-196a572e397d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:47.885824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7291e-a2c4-4634-8844-196a572e397d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:47.903267 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-acf7291e-a2c4-4634-8844-196a572e397d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:47.904838 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 394/780] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:47.911539 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58167661-835d-42a5-8a49-e80479a58472 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:47.920669 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58167661-835d-42a5-8a49-e80479a58472 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:47.925564 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e62848-f357-4678-bed7-291f781c7415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:47.926436 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e62848-f357-4678-bed7-291f781c7415 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:47.926912 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e62848-f357-4678-bed7-291f781c7415 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:47.927525 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e62848-f357-4678-bed7-291f781c7415 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:47.928514 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e62848-f357-4678-bed7-291f781c7415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:47.929015 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e62848-f357-4678-bed7-291f781c7415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:47.930793 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e62848-f357-4678-bed7-291f781c7415 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:47.943580 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 387/781] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:47.955496 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7291e-a2c4-4634-8844-196a572e397d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:47.964845 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7291e-a2c4-4634-8844-196a572e397d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:47.970236 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d6ff6-41f2-459a-b146-26519ee9ef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:47.971258 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d6ff6-41f2-459a-b146-26519ee9ef85 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:47.971761 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d6ff6-41f2-459a-b146-26519ee9ef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:47.972177 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d6ff6-41f2-459a-b146-26519ee9ef85 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:47.979788 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d6ff6-41f2-459a-b146-26519ee9ef85 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:47.982006 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d6ff6-41f2-459a-b146-26519ee9ef85 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:47.995550 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-c88d6ff6-41f2-459a-b146-26519ee9ef85 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:47.997508 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 395/782] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:48.004671 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e62848-f357-4678-bed7-291f781c7415 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:48.015047 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e62848-f357-4678-bed7-291f781c7415 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:48.020040 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddba66-e8c5-4f11-99c1-56a88514046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:48.020863 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddba66-e8c5-4f11-99c1-56a88514046e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:48.021339 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddba66-e8c5-4f11-99c1-56a88514046e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:48.021759 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddba66-e8c5-4f11-99c1-56a88514046e admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:48.022750 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddba66-e8c5-4f11-99c1-56a88514046e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:48.023199 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddba66-e8c5-4f11-99c1-56a88514046e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:48.025373 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddba66-e8c5-4f11-99c1-56a88514046e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:48.042729 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 388/783] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:48.046541 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d6ff6-41f2-459a-b146-26519ee9ef85 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:48.057470 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d6ff6-41f2-459a-b146-26519ee9ef85 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:48.062950 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67629f22-0583-4b1f-919e-8359096d3f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:48.063824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67629f22-0583-4b1f-919e-8359096d3f43 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:48.064270 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67629f22-0583-4b1f-919e-8359096d3f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:48.064730 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67629f22-0583-4b1f-919e-8359096d3f43 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:48.065786 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67629f22-0583-4b1f-919e-8359096d3f43 admin admin] RBAC: Adding query filter params (role.id=0c932d1474bf47918c81da6c0fa7c7ff, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=b1918e2aa8f24655875480ef52df324d) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:48.066288 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67629f22-0583-4b1f-919e-8359096d3f43 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:48.068389 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67629f22-0583-4b1f-919e-8359096d3f43 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:48.074808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 396/784] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:48 2021] GET /identity/v3/role_assignments?user.id=b1918e2aa8f24655875480ef52df324d&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=0c932d1474bf47918c81da6c0fa7c7ff => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:48.370387 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b5509-1f8a-4500-a9af-b48581ffd250 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:48.370762 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b5509-1f8a-4500-a9af-b48581ffd250 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:48.370944 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b5509-1f8a-4500-a9af-b48581ffd250 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:48.373355 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 389/785] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:48.382700 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca6d86-96d2-44d8-914e-e689f4787348 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:48.382987 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca6d86-96d2-44d8-914e-e689f4787348 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:48.383263 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca6d86-96d2-44d8-914e-e689f4787348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:48.404893 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-91ca6d86-96d2-44d8-914e-e689f4787348 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:48.406569 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-91ca6d86-96d2-44d8-914e-e689f4787348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:48.414828 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 397/786] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:48 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:48.444347 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b5509-1f8a-4500-a9af-b48581ffd250 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:48.457147 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b5509-1f8a-4500-a9af-b48581ffd250 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:48.461601 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c504fa-080b-489f-aa82-f25e66fd0b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:48.462381 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c504fa-080b-489f-aa82-f25e66fd0b9a admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:48.462727 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c504fa-080b-489f-aa82-f25e66fd0b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:48.463077 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c504fa-080b-489f-aa82-f25e66fd0b9a admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:48.463898 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c504fa-080b-489f-aa82-f25e66fd0b9a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:48.464957 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-13c504fa-080b-489f-aa82-f25e66fd0b9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:48.464957 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 02:52:48.464957 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 02:52:48.465982 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c504fa-080b-489f-aa82-f25e66fd0b9a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:48.484809 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 390/787] 10.222.0.39 () {60 vars in 1163 bytes} [Tue Aug 31 02:52:48 2021] POST /identity/v3/services => generated 251 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:52:48.699386 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba5989-b61d-442b-a3a3-226d918a3707 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:48.699877 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba5989-b61d-442b-a3a3-226d918a3707 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:48.700109 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba5989-b61d-442b-a3a3-226d918a3707 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:48.702761 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 398/788] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:48 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:48.709044 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e57dc1-5409-4aa3-aea3-9058341f0af7 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:48.709336 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e57dc1-5409-4aa3-aea3-9058341f0af7 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:48.709614 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e57dc1-5409-4aa3-aea3-9058341f0af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:48.729719 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-26e57dc1-5409-4aa3-aea3-9058341f0af7 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:48.730911 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-26e57dc1-5409-4aa3-aea3-9058341f0af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:48.755484 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 391/789] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:48 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:48.772117 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba5989-b61d-442b-a3a3-226d918a3707 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:48.785163 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba5989-b61d-442b-a3a3-226d918a3707 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:48.789645 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010f150-f888-423b-a23a-86d37632aadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:48.790441 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010f150-f888-423b-a23a-86d37632aadb admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:48.790722 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010f150-f888-423b-a23a-86d37632aadb admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:48.790996 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010f150-f888-423b-a23a-86d37632aadb admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:48.791740 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010f150-f888-423b-a23a-86d37632aadb admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:48.793348 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010f150-f888-423b-a23a-86d37632aadb admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:48.805668 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-3010f150-f888-423b-a23a-86d37632aadb admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 02:52:48.811496 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 399/790] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Aug 31 02:52:48 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:48.814404 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e57dc1-5409-4aa3-aea3-9058341f0af7 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:48.823726 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e57dc1-5409-4aa3-aea3-9058341f0af7 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:48.829232 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0690f-c31b-424a-8355-8791afe6f5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:48.829895 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0690f-c31b-424a-8355-8791afe6f5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:48.830178 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0690f-c31b-424a-8355-8791afe6f5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:48.830451 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0690f-c31b-424a-8355-8791afe6f5e7 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:48.831153 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0690f-c31b-424a-8355-8791afe6f5e7 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:48.831499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0690f-c31b-424a-8355-8791afe6f5e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:48.833093 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0690f-c31b-424a-8355-8791afe6f5e7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:48.843498 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 392/791] 10.222.0.39 () {56 vars in 1144 bytes} [Tue Aug 31 02:52:48 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:48.845900 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010f150-f888-423b-a23a-86d37632aadb admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:48.855917 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010f150-f888-423b-a23a-86d37632aadb admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:48.860843 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fa2a9-2ff9-45d1-816b-d6154ec9d490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:48.861560 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fa2a9-2ff9-45d1-816b-d6154ec9d490 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:48.861840 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fa2a9-2ff9-45d1-816b-d6154ec9d490 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:48.862176 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fa2a9-2ff9-45d1-816b-d6154ec9d490 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:48.862877 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fa2a9-2ff9-45d1-816b-d6154ec9d490 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:48.863181 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fa2a9-2ff9-45d1-816b-d6154ec9d490 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:48.864904 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fa2a9-2ff9-45d1-816b-d6154ec9d490 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:48.875533 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 400/792] 10.222.0.39 () {56 vars in 1144 bytes} [Tue Aug 31 02:52:48 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:49.935609 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1355bf6-2cc2-4bde-a047-a122985ce05f None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:49.937230 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1355bf6-2cc2-4bde-a047-a122985ce05f None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:49.937721 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1355bf6-2cc2-4bde-a047-a122985ce05f None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:49.940023 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 393/793] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:49 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:49.946371 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ec929-2330-47ac-a733-87aa30255952 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:49.947235 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ec929-2330-47ac-a733-87aa30255952 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:49.947788 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ec929-2330-47ac-a733-87aa30255952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:49.966000 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-b97ec929-2330-47ac-a733-87aa30255952 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:49.968075 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b97ec929-2330-47ac-a733-87aa30255952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:49.976274 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 401/794] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:49 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:50.001138 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1355bf6-2cc2-4bde-a047-a122985ce05f None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:50.013593 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1355bf6-2cc2-4bde-a047-a122985ce05f None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:50.018274 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37dff4-d55b-4a2e-b960-316df32539f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:50.019306 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37dff4-d55b-4a2e-b960-316df32539f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.019837 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37dff4-d55b-4a2e-b960-316df32539f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.020322 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37dff4-d55b-4a2e-b960-316df32539f3 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.021158 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37dff4-d55b-4a2e-b960-316df32539f3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:50.022927 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37dff4-d55b-4a2e-b960-316df32539f3 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:50.035305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-1e37dff4-d55b-4a2e-b960-316df32539f3 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 02:52:50.037217 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 394/795] 10.222.0.39 () {56 vars in 1154 bytes} [Tue Aug 31 02:52:50 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:50.043974 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ec929-2330-47ac-a733-87aa30255952 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:50.054184 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ec929-2330-47ac-a733-87aa30255952 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:50.059489 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85148102-a7b8-41aa-a3d9-b7a1f9f13821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:50.060702 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85148102-a7b8-41aa-a3d9-b7a1f9f13821 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.061249 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85148102-a7b8-41aa-a3d9-b7a1f9f13821 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.061750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85148102-a7b8-41aa-a3d9-b7a1f9f13821 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.062696 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85148102-a7b8-41aa-a3d9-b7a1f9f13821 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:50.063211 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85148102-a7b8-41aa-a3d9-b7a1f9f13821 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:50.065057 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85148102-a7b8-41aa-a3d9-b7a1f9f13821 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:50.070890 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 402/796] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Aug 31 02:52:50 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:50.077417 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37dff4-d55b-4a2e-b960-316df32539f3 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:50.087473 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37dff4-d55b-4a2e-b960-316df32539f3 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:50.092775 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f45d98-87e4-495a-bb46-0cd765d0aa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:50.093691 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f45d98-87e4-495a-bb46-0cd765d0aa58 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.094170 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f45d98-87e4-495a-bb46-0cd765d0aa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.094641 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f45d98-87e4-495a-bb46-0cd765d0aa58 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.095566 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f45d98-87e4-495a-bb46-0cd765d0aa58 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:50.096064 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f45d98-87e4-495a-bb46-0cd765d0aa58 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:50.097962 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f45d98-87e4-495a-bb46-0cd765d0aa58 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:50.103696 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 395/797] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Aug 31 02:52:50 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:50.110616 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85148102-a7b8-41aa-a3d9-b7a1f9f13821 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:50.120716 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85148102-a7b8-41aa-a3d9-b7a1f9f13821 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:50.129519 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f3dab-8657-46bd-82fb-ab70cd3692fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:50.130724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f3dab-8657-46bd-82fb-ab70cd3692fe admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.131262 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f3dab-8657-46bd-82fb-ab70cd3692fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.131757 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f3dab-8657-46bd-82fb-ab70cd3692fe admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.132605 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f3dab-8657-46bd-82fb-ab70cd3692fe admin admin] RBAC: Adding query filter params (interface=public, service_id=94a59e42c3804de9afb6da59b20ff98b, region_id=RegionOne) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:50.133098 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f3dab-8657-46bd-82fb-ab70cd3692fe admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:50.134429 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-950f3dab-8657-46bd-82fb-ab70cd3692fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:50.134429 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 02:52:50.134429 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 02:52:50.135402 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f3dab-8657-46bd-82fb-ab70cd3692fe admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:50.148787 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 403/798] 10.222.0.39 () {56 vars in 1273 bytes} [Tue Aug 31 02:52:50 2021] GET /identity/v3/endpoints?service_id=94a59e42c3804de9afb6da59b20ff98b&interface=public®ion_id=RegionOne => generated 194 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:50.156633 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f45d98-87e4-495a-bb46-0cd765d0aa58 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:50.171466 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f45d98-87e4-495a-bb46-0cd765d0aa58 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:50.178174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52a64b-9197-4c90-bc24-e63d6f91909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:50.179191 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52a64b-9197-4c90-bc24-e63d6f91909f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.179647 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52a64b-9197-4c90-bc24-e63d6f91909f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.180111 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52a64b-9197-4c90-bc24-e63d6f91909f admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.181216 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52a64b-9197-4c90-bc24-e63d6f91909f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:50.183525 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52a64b-9197-4c90-bc24-e63d6f91909f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:50.193206 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 396/799] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Aug 31 02:52:50 2021] GET /identity/v3/services => generated 1268 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 02:52:50.316752 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caea2b7-35fc-48f3-9c63-781bb29c7202 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.317099 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caea2b7-35fc-48f3-9c63-781bb29c7202 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.317296 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caea2b7-35fc-48f3-9c63-781bb29c7202 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.319333 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 404/800] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:50.325775 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f942d80-57fa-454c-931d-fda47c06211a None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.326074 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f942d80-57fa-454c-931d-fda47c06211a None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.326334 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f942d80-57fa-454c-931d-fda47c06211a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.346368 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-6f942d80-57fa-454c-931d-fda47c06211a None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:50.347615 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-6f942d80-57fa-454c-931d-fda47c06211a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:50.355869 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 397/801] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:50 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:50.381470 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caea2b7-35fc-48f3-9c63-781bb29c7202 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:50.394479 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caea2b7-35fc-48f3-9c63-781bb29c7202 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:50.398899 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f133d-fb71-44a9-ae69-6d503ef69669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:50.399725 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f133d-fb71-44a9-ae69-6d503ef69669 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.400004 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f133d-fb71-44a9-ae69-6d503ef69669 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.400282 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f133d-fb71-44a9-ae69-6d503ef69669 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.413093 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f133d-fb71-44a9-ae69-6d503ef69669 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:50.420587 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-ea1f133d-fb71-44a9-ae69-6d503ef69669 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 02:52:50.422010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 405/802] 10.222.0.39 () {56 vars in 1142 bytes} [Tue Aug 31 02:52:50 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:50.428427 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f942d80-57fa-454c-931d-fda47c06211a None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:50.437541 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f942d80-57fa-454c-931d-fda47c06211a None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:50.442139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419454d1-5e28-4443-85cd-2117a7caf9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:50.442795 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419454d1-5e28-4443-85cd-2117a7caf9ca admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.443133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419454d1-5e28-4443-85cd-2117a7caf9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.443486 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419454d1-5e28-4443-85cd-2117a7caf9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.444227 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419454d1-5e28-4443-85cd-2117a7caf9ca admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:50.444536 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419454d1-5e28-4443-85cd-2117a7caf9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:50.446103 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419454d1-5e28-4443-85cd-2117a7caf9ca admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:50.456793 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 398/803] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Aug 31 02:52:50 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:50.466642 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f133d-fb71-44a9-ae69-6d503ef69669 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:50.478158 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f133d-fb71-44a9-ae69-6d503ef69669 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:50.483505 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009c647-3de0-4e3e-ba02-d1833de40a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:50.484400 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009c647-3de0-4e3e-ba02-d1833de40a13 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.484615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009c647-3de0-4e3e-ba02-d1833de40a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.484971 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009c647-3de0-4e3e-ba02-d1833de40a13 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.495660 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009c647-3de0-4e3e-ba02-d1833de40a13 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:50.497823 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009c647-3de0-4e3e-ba02-d1833de40a13 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:50.516129 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-8009c647-3de0-4e3e-ba02-d1833de40a13 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:50.517660 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 406/804] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:50.523844 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419454d1-5e28-4443-85cd-2117a7caf9ca admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:50.534141 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419454d1-5e28-4443-85cd-2117a7caf9ca admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:50.538910 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f9112-6a51-44dd-bddf-f5152d73960b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:50.539630 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f9112-6a51-44dd-bddf-f5152d73960b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.539913 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f9112-6a51-44dd-bddf-f5152d73960b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.540235 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f9112-6a51-44dd-bddf-f5152d73960b admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.540948 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f9112-6a51-44dd-bddf-f5152d73960b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:50.541305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f9112-6a51-44dd-bddf-f5152d73960b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:50.542934 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f9112-6a51-44dd-bddf-f5152d73960b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:50.556107 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 399/805] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:50.562938 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009c647-3de0-4e3e-ba02-d1833de40a13 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:50.572584 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009c647-3de0-4e3e-ba02-d1833de40a13 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:50.577319 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76c081-5c69-4a69-af71-e41a51a086b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:50.578110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76c081-5c69-4a69-af71-e41a51a086b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.578439 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76c081-5c69-4a69-af71-e41a51a086b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.578714 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76c081-5c69-4a69-af71-e41a51a086b1 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.586306 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76c081-5c69-4a69-af71-e41a51a086b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:50.588403 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76c081-5c69-4a69-af71-e41a51a086b1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:50.603626 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-fb76c081-5c69-4a69-af71-e41a51a086b1 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 02:52:50.605081 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 407/806] 10.222.0.39 () {56 vars in 1139 bytes} [Tue Aug 31 02:52:50 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:50.611960 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f9112-6a51-44dd-bddf-f5152d73960b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:50.622039 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f9112-6a51-44dd-bddf-f5152d73960b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:50.627226 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222830ef-ef67-48b0-b51c-0fbb5aec461a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:50.628014 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222830ef-ef67-48b0-b51c-0fbb5aec461a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.628293 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222830ef-ef67-48b0-b51c-0fbb5aec461a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.628618 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222830ef-ef67-48b0-b51c-0fbb5aec461a admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.629448 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222830ef-ef67-48b0-b51c-0fbb5aec461a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:50.629805 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222830ef-ef67-48b0-b51c-0fbb5aec461a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:50.631728 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222830ef-ef67-48b0-b51c-0fbb5aec461a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:50.649798 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 400/807] 10.222.0.39 () {56 vars in 1171 bytes} [Tue Aug 31 02:52:50 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:50.656140 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76c081-5c69-4a69-af71-e41a51a086b1 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:50.666069 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76c081-5c69-4a69-af71-e41a51a086b1 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:50.671512 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1c662-ff2b-4102-93bb-4d39bae1e70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:50.672343 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1c662-ff2b-4102-93bb-4d39bae1e70b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.672622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1c662-ff2b-4102-93bb-4d39bae1e70b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.672888 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1c662-ff2b-4102-93bb-4d39bae1e70b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.683594 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1c662-ff2b-4102-93bb-4d39bae1e70b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:50.685418 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1c662-ff2b-4102-93bb-4d39bae1e70b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:50.703508 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-30e1c662-ff2b-4102-93bb-4d39bae1e70b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:50.704997 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 408/808] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:50.711505 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222830ef-ef67-48b0-b51c-0fbb5aec461a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:50.722592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222830ef-ef67-48b0-b51c-0fbb5aec461a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:50.727614 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fb20c-4a33-45b5-854e-fe68e14a6a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:50.728340 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fb20c-4a33-45b5-854e-fe68e14a6a8b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.728622 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fb20c-4a33-45b5-854e-fe68e14a6a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.728895 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fb20c-4a33-45b5-854e-fe68e14a6a8b admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.729676 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fb20c-4a33-45b5-854e-fe68e14a6a8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:50.729982 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fb20c-4a33-45b5-854e-fe68e14a6a8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:50.731667 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fb20c-4a33-45b5-854e-fe68e14a6a8b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:50.744870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 401/809] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:50.751752 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1c662-ff2b-4102-93bb-4d39bae1e70b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:50.761807 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1c662-ff2b-4102-93bb-4d39bae1e70b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:50.767103 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cf5e3-ac75-46c6-8571-b73cb048f774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:50.768024 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cf5e3-ac75-46c6-8571-b73cb048f774 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.768301 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cf5e3-ac75-46c6-8571-b73cb048f774 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.768567 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cf5e3-ac75-46c6-8571-b73cb048f774 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.775821 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cf5e3-ac75-46c6-8571-b73cb048f774 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:50.777774 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cf5e3-ac75-46c6-8571-b73cb048f774 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:50.791187 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-a17cf5e3-ac75-46c6-8571-b73cb048f774 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:50.792689 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 409/810] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:50.798669 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fb20c-4a33-45b5-854e-fe68e14a6a8b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:50.806019 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9776b-3b21-4323-bc69-01f637961dd5 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.806299 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9776b-3b21-4323-bc69-01f637961dd5 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.806571 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9776b-3b21-4323-bc69-01f637961dd5 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.808793 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 410/811] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:50.812360 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fb20c-4a33-45b5-854e-fe68e14a6a8b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:50.816881 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d92c88-df37-4235-91f0-c2327689a47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:50.817429 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c1cfc-6495-4aa6-903a-77f8fb35e936 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.817724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c1cfc-6495-4aa6-903a-77f8fb35e936 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.818005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c1cfc-6495-4aa6-903a-77f8fb35e936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.818430 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d92c88-df37-4235-91f0-c2327689a47f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.818908 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d92c88-df37-4235-91f0-c2327689a47f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.819431 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d92c88-df37-4235-91f0-c2327689a47f admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.820413 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d92c88-df37-4235-91f0-c2327689a47f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:50.821001 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d92c88-df37-4235-91f0-c2327689a47f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:50.823236 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d92c88-df37-4235-91f0-c2327689a47f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:50.837050 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 402/812] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:50.840386 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-c11c1cfc-6495-4aa6-903a-77f8fb35e936 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:50.841814 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c11c1cfc-6495-4aa6-903a-77f8fb35e936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:50.843907 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d92c88-df37-4235-91f0-c2327689a47f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:50.855373 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d92c88-df37-4235-91f0-c2327689a47f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:50.861260 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 411/813] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:50 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:50.869811 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a9c82-1bdd-455e-a243-a3d2ab656999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:50.870816 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a9c82-1bdd-455e-a243-a3d2ab656999 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.871196 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a9c82-1bdd-455e-a243-a3d2ab656999 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.871863 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a9c82-1bdd-455e-a243-a3d2ab656999 admin admin] PATH_INFO: `/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/b1918e2aa8f24655875480ef52df324d/roles/0c932d1474bf47918c81da6c0fa7c7ff` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.874854 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a9c82-1bdd-455e-a243-a3d2ab656999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011ec8d2410644a3b7d51a90f803b441, user_id=b1918e2aa8f24655875480ef52df324d, role_id=0c932d1474bf47918c81da6c0fa7c7ff)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:50.877615 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a9c82-1bdd-455e-a243-a3d2ab656999 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:50.890189 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c1cfc-6495-4aa6-903a-77f8fb35e936 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:50.894819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 403/814] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:52:50 2021] PUT /identity/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/b1918e2aa8f24655875480ef52df324d/roles/0c932d1474bf47918c81da6c0fa7c7ff => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 02:52:50.899984 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c1cfc-6495-4aa6-903a-77f8fb35e936 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:50.964037 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933021fb-0b28-4e43-8fb4-dd11ee44e4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:50.964761 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933021fb-0b28-4e43-8fb4-dd11ee44e4ca admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:50.965042 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933021fb-0b28-4e43-8fb4-dd11ee44e4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:50.965312 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933021fb-0b28-4e43-8fb4-dd11ee44e4ca admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:50.965968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933021fb-0b28-4e43-8fb4-dd11ee44e4ca admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:50.967653 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933021fb-0b28-4e43-8fb4-dd11ee44e4ca admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:50.979687 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-933021fb-0b28-4e43-8fb4-dd11ee44e4ca admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 02:52:50.981263 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 412/815] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:50 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:50.988034 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a9c82-1bdd-455e-a243-a3d2ab656999 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:51.000450 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a9c82-1bdd-455e-a243-a3d2ab656999 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:51.005762 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf1e61-b821-4da9-b78e-169df25e7ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:51.006851 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf1e61-b821-4da9-b78e-169df25e7ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:51.007358 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf1e61-b821-4da9-b78e-169df25e7ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:51.007938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf1e61-b821-4da9-b78e-169df25e7ba5 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:51.008912 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf1e61-b821-4da9-b78e-169df25e7ba5 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:51.009471 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf1e61-b821-4da9-b78e-169df25e7ba5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:51.011390 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf1e61-b821-4da9-b78e-169df25e7ba5 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:51.018358 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 404/816] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:50 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:51.025637 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933021fb-0b28-4e43-8fb4-dd11ee44e4ca admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:51.036909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933021fb-0b28-4e43-8fb4-dd11ee44e4ca admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:51.042326 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c765838-adbe-4953-8d13-44f84b810060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:51.043440 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c765838-adbe-4953-8d13-44f84b810060 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:51.043942 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c765838-adbe-4953-8d13-44f84b810060 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:51.044433 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c765838-adbe-4953-8d13-44f84b810060 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:51.045461 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c765838-adbe-4953-8d13-44f84b810060 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:51.046191 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c765838-adbe-4953-8d13-44f84b810060 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:51.048324 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c765838-adbe-4953-8d13-44f84b810060 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:51.054610 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 413/817] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:51 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:51.062342 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf1e61-b821-4da9-b78e-169df25e7ba5 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:51.073183 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf1e61-b821-4da9-b78e-169df25e7ba5 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:51.078661 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e48daf-affa-478d-9d74-9bd6b7b3cba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:51.079598 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e48daf-affa-478d-9d74-9bd6b7b3cba8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:51.080207 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e48daf-affa-478d-9d74-9bd6b7b3cba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:51.080689 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e48daf-affa-478d-9d74-9bd6b7b3cba8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:51.081694 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e48daf-affa-478d-9d74-9bd6b7b3cba8 admin admin] RBAC: Adding query filter params (interface=public, service_id=bb9b63acd1694800b91b206fced8a84b, region_id=RegionOne) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:51.082254 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e48daf-affa-478d-9d74-9bd6b7b3cba8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:51.084137 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e48daf-affa-478d-9d74-9bd6b7b3cba8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:51.091906 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 405/818] 10.222.0.39 () {56 vars in 1273 bytes} [Tue Aug 31 02:52:51 2021] GET /identity/v3/endpoints?service_id=bb9b63acd1694800b91b206fced8a84b&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:51.101135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c765838-adbe-4953-8d13-44f84b810060 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:51.105095 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fa7fa-6c85-47f0-b2e5-72ff4a67985e None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:51.105390 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fa7fa-6c85-47f0-b2e5-72ff4a67985e None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:51.105657 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fa7fa-6c85-47f0-b2e5-72ff4a67985e None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:51.108873 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 406/819] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:51.113305 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c765838-adbe-4953-8d13-44f84b810060 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:51.117221 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cd2e4-4676-4803-a57c-ded9beed2999 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:51.117513 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cd2e4-4676-4803-a57c-ded9beed2999 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:51.117778 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cd2e4-4676-4803-a57c-ded9beed2999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:51.119100 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf35428-5586-4c73-8ff7-b466ef1bffdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:51.119809 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf35428-5586-4c73-8ff7-b466ef1bffdf admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:51.120096 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf35428-5586-4c73-8ff7-b466ef1bffdf admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:51.120375 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf35428-5586-4c73-8ff7-b466ef1bffdf admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:51.121051 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf35428-5586-4c73-8ff7-b466ef1bffdf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:51.123296 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf35428-5586-4c73-8ff7-b466ef1bffdf admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:51.134848 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 414/820] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Aug 31 02:52:51 2021] GET /identity/v3/services => generated 1268 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 02:52:51.138629 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-a76cd2e4-4676-4803-a57c-ded9beed2999 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:51.140154 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a76cd2e4-4676-4803-a57c-ded9beed2999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:51.149004 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 407/821] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:51 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:51.175042 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf35428-5586-4c73-8ff7-b466ef1bffdf admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:51.191063 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf35428-5586-4c73-8ff7-b466ef1bffdf admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:51.197024 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4040d-f9b8-4391-ae84-eb40a1beb523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:51.200886 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4040d-f9b8-4391-ae84-eb40a1beb523 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:51.201479 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4040d-f9b8-4391-ae84-eb40a1beb523 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:51.202221 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4040d-f9b8-4391-ae84-eb40a1beb523 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:51.203336 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4040d-f9b8-4391-ae84-eb40a1beb523 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:51.205544 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4040d-f9b8-4391-ae84-eb40a1beb523 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:51.223968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 415/822] 10.222.0.39 () {60 vars in 1163 bytes} [Tue Aug 31 02:52:51 2021] POST /identity/v3/services => generated 241 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 02:52:52.475184 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ef5e0-938e-426e-90d2-41d93bc0e198 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:52.475743 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ef5e0-938e-426e-90d2-41d93bc0e198 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:52.475743 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ef5e0-938e-426e-90d2-41d93bc0e198 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:52.477635 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 408/823] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:52:52.483509 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4906179-3dca-4043-948d-684ee6ef1cc7 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:52.484145 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4906179-3dca-4043-948d-684ee6ef1cc7 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:52.484145 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4906179-3dca-4043-948d-684ee6ef1cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:52.503574 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-e4906179-3dca-4043-948d-684ee6ef1cc7 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:52.504718 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-e4906179-3dca-4043-948d-684ee6ef1cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:52.522594 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 416/824] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:52 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:52.546468 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ef5e0-938e-426e-90d2-41d93bc0e198 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:52.559042 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ef5e0-938e-426e-90d2-41d93bc0e198 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:52.564141 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb890eb-cdf8-47a4-bea2-7b53ce5b7f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:52.564951 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb890eb-cdf8-47a4-bea2-7b53ce5b7f97 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:52.565273 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb890eb-cdf8-47a4-bea2-7b53ce5b7f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:52.565597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb890eb-cdf8-47a4-bea2-7b53ce5b7f97 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:52.566199 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb890eb-cdf8-47a4-bea2-7b53ce5b7f97 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:52.567830 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb890eb-cdf8-47a4-bea2-7b53ce5b7f97 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:52.580133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-5bb890eb-cdf8-47a4-bea2-7b53ce5b7f97 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 02:52:52.581606 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 409/825] 10.222.0.39 () {56 vars in 1154 bytes} [Tue Aug 31 02:52:52 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:52.588304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4906179-3dca-4043-948d-684ee6ef1cc7 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:52.598135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4906179-3dca-4043-948d-684ee6ef1cc7 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:52.603222 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169bb49-20ec-4c15-8d13-44b862945503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:52.603983 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169bb49-20ec-4c15-8d13-44b862945503 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:52.604268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169bb49-20ec-4c15-8d13-44b862945503 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:52.604543 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169bb49-20ec-4c15-8d13-44b862945503 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:52.605258 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169bb49-20ec-4c15-8d13-44b862945503 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:52.605562 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169bb49-20ec-4c15-8d13-44b862945503 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:52.607209 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169bb49-20ec-4c15-8d13-44b862945503 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:52.613440 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 417/826] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Aug 31 02:52:52 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:52.619608 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb890eb-cdf8-47a4-bea2-7b53ce5b7f97 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:52.630456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb890eb-cdf8-47a4-bea2-7b53ce5b7f97 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:52.635126 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164c882-84bc-430d-bfd0-0c6c8b3bc778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:52.635814 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164c882-84bc-430d-bfd0-0c6c8b3bc778 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:52.636140 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164c882-84bc-430d-bfd0-0c6c8b3bc778 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:52.636371 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164c882-84bc-430d-bfd0-0c6c8b3bc778 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:52.637074 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164c882-84bc-430d-bfd0-0c6c8b3bc778 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:52.637425 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164c882-84bc-430d-bfd0-0c6c8b3bc778 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:52.638962 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164c882-84bc-430d-bfd0-0c6c8b3bc778 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:52.644645 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 410/827] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Aug 31 02:52:52 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:52.650530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169bb49-20ec-4c15-8d13-44b862945503 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:52.660590 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169bb49-20ec-4c15-8d13-44b862945503 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:52.665221 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d421ca2-4bbc-4fc1-a4dd-035995de277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:52.665892 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d421ca2-4bbc-4fc1-a4dd-035995de277a admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:52.666150 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d421ca2-4bbc-4fc1-a4dd-035995de277a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:52.666429 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d421ca2-4bbc-4fc1-a4dd-035995de277a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:52.667167 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d421ca2-4bbc-4fc1-a4dd-035995de277a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:52.668789 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d421ca2-4bbc-4fc1-a4dd-035995de277a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:52.689949 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 418/828] 10.222.0.39 () {60 vars in 1166 bytes} [Tue Aug 31 02:52:52 2021] POST /identity/v3/endpoints => generated 347 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:52:53.152135 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4f6b8-4743-4f0d-b064-21f0220247b6 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.152453 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4f6b8-4743-4f0d-b064-21f0220247b6 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.152684 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4f6b8-4743-4f0d-b064-21f0220247b6 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.155247 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 411/829] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:53.161086 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee03fe-190b-4a4d-9560-6437c340fa6d None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.161383 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee03fe-190b-4a4d-9560-6437c340fa6d None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.161668 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee03fe-190b-4a4d-9560-6437c340fa6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.179961 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-15ee03fe-190b-4a4d-9560-6437c340fa6d None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:53.181148 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-15ee03fe-190b-4a4d-9560-6437c340fa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:53.203476 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 419/830] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:53 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:53.224222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4f6b8-4743-4f0d-b064-21f0220247b6 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.237074 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4f6b8-4743-4f0d-b064-21f0220247b6 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.241528 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0ea91-7e8f-4953-9899-18da1b0ae339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.242330 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0ea91-7e8f-4953-9899-18da1b0ae339 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.242610 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0ea91-7e8f-4953-9899-18da1b0ae339 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.242883 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0ea91-7e8f-4953-9899-18da1b0ae339 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.253891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0ea91-7e8f-4953-9899-18da1b0ae339 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:52:53.261166 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-aff0ea91-7e8f-4953-9899-18da1b0ae339 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 02:52:53.267482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 412/831] 10.222.0.39 () {56 vars in 1142 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:53.269750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee03fe-190b-4a4d-9560-6437c340fa6d None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.279246 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee03fe-190b-4a4d-9560-6437c340fa6d None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.284854 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00323c04-7501-46db-beb7-4258c07aa4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.285619 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00323c04-7501-46db-beb7-4258c07aa4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.285820 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00323c04-7501-46db-beb7-4258c07aa4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.286091 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00323c04-7501-46db-beb7-4258c07aa4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.286868 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00323c04-7501-46db-beb7-4258c07aa4b7 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:53.287179 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00323c04-7501-46db-beb7-4258c07aa4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:53.288887 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00323c04-7501-46db-beb7-4258c07aa4b7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:53.303509 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 420/832] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:53.305949 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0ea91-7e8f-4953-9899-18da1b0ae339 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.315968 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0ea91-7e8f-4953-9899-18da1b0ae339 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.320586 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db347d5-2a8d-4604-8c22-5b3d8ce480b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.321374 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db347d5-2a8d-4604-8c22-5b3d8ce480b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.321658 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db347d5-2a8d-4604-8c22-5b3d8ce480b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.321931 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db347d5-2a8d-4604-8c22-5b3d8ce480b4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.332946 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db347d5-2a8d-4604-8c22-5b3d8ce480b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:53.334799 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db347d5-2a8d-4604-8c22-5b3d8ce480b4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:53.353735 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-1db347d5-2a8d-4604-8c22-5b3d8ce480b4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:53.359469 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 413/833] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:53.361687 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00323c04-7501-46db-beb7-4258c07aa4b7 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.365111 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a505d-9332-4bcd-9be7-77fab70bfb64 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.365398 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a505d-9332-4bcd-9be7-77fab70bfb64 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.365672 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a505d-9332-4bcd-9be7-77fab70bfb64 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.367673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 414/834] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:53.372510 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00323c04-7501-46db-beb7-4258c07aa4b7 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.373660 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b313ce5-0e77-4265-8d34-cd3900712161 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.373965 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b313ce5-0e77-4265-8d34-cd3900712161 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.374311 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b313ce5-0e77-4265-8d34-cd3900712161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.377352 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009bbc4-c910-4efb-8d55-f72ae44abc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.378106 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009bbc4-c910-4efb-8d55-f72ae44abc96 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.378389 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009bbc4-c910-4efb-8d55-f72ae44abc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.378665 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009bbc4-c910-4efb-8d55-f72ae44abc96 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.379514 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009bbc4-c910-4efb-8d55-f72ae44abc96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:53.379819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009bbc4-c910-4efb-8d55-f72ae44abc96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:53.382542 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009bbc4-c910-4efb-8d55-f72ae44abc96 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:53.392866 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-9b313ce5-0e77-4265-8d34-cd3900712161 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:53.394080 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-9b313ce5-0e77-4265-8d34-cd3900712161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:53.399451 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 421/835] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:53.403095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009bbc4-c910-4efb-8d55-f72ae44abc96 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.408179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 415/836] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:53 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:53.414194 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009bbc4-c910-4efb-8d55-f72ae44abc96 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.419130 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f389649-2bd9-4802-aee6-462b64fcb7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.420100 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f389649-2bd9-4802-aee6-462b64fcb7cf admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.420581 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f389649-2bd9-4802-aee6-462b64fcb7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.420925 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f389649-2bd9-4802-aee6-462b64fcb7cf admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.429832 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f389649-2bd9-4802-aee6-462b64fcb7cf admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:53.431172 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f389649-2bd9-4802-aee6-462b64fcb7cf admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:53.432999 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b313ce5-0e77-4265-8d34-cd3900712161 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.444237 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b313ce5-0e77-4265-8d34-cd3900712161 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.448872 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a9c46-59d3-4c76-99df-c3f5a949ab27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.449337 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-3f389649-2bd9-4802-aee6-462b64fcb7cf admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 02:52:53.449727 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a9c46-59d3-4c76-99df-c3f5a949ab27 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.450011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a9c46-59d3-4c76-99df-c3f5a949ab27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.450289 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a9c46-59d3-4c76-99df-c3f5a949ab27 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.450993 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a9c46-59d3-4c76-99df-c3f5a949ab27 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:53.452675 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 422/837] 10.222.0.39 () {56 vars in 1139 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:53.454428 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a9c46-59d3-4c76-99df-c3f5a949ab27 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:53.459094 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f389649-2bd9-4802-aee6-462b64fcb7cf admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.470859 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f389649-2bd9-4802-aee6-462b64fcb7cf admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.471753 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-112a9c46-59d3-4c76-99df-c3f5a949ab27 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 02:52:53.473666 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 416/838] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:53.480155 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a9c46-59d3-4c76-99df-c3f5a949ab27 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.484170 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8d5a4-ab27-4e5e-b66e-27cfe30c9701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.485408 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8d5a4-ab27-4e5e-b66e-27cfe30c9701 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.485947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8d5a4-ab27-4e5e-b66e-27cfe30c9701 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.486432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8d5a4-ab27-4e5e-b66e-27cfe30c9701 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.487558 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8d5a4-ab27-4e5e-b66e-27cfe30c9701 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:53.488074 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8d5a4-ab27-4e5e-b66e-27cfe30c9701 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:53.490206 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8d5a4-ab27-4e5e-b66e-27cfe30c9701 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:53.491023 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a9c46-59d3-4c76-99df-c3f5a949ab27 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.496101 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704ad35-ae04-4b5a-837a-a05e510778b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.497015 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704ad35-ae04-4b5a-837a-a05e510778b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.497297 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704ad35-ae04-4b5a-837a-a05e510778b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.497569 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704ad35-ae04-4b5a-837a-a05e510778b4 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.498274 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704ad35-ae04-4b5a-837a-a05e510778b4 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:53.498733 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704ad35-ae04-4b5a-837a-a05e510778b4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:53.500469 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704ad35-ae04-4b5a-837a-a05e510778b4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:53.510231 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 417/839] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:53.512669 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704ad35-ae04-4b5a-837a-a05e510778b4 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.526318 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 423/840] 10.222.0.39 () {56 vars in 1171 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:53.527242 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704ad35-ae04-4b5a-837a-a05e510778b4 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.527619 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8d5a4-ab27-4e5e-b66e-27cfe30c9701 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.534234 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e655bde-fcd6-4f64-b700-6feb50c7cb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.535558 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e655bde-fcd6-4f64-b700-6feb50c7cb00 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.536025 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e655bde-fcd6-4f64-b700-6feb50c7cb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.536532 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e655bde-fcd6-4f64-b700-6feb50c7cb00 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.538053 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e655bde-fcd6-4f64-b700-6feb50c7cb00 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:53.538821 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e655bde-fcd6-4f64-b700-6feb50c7cb00 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:53.540689 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e655bde-fcd6-4f64-b700-6feb50c7cb00 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:53.540798 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8d5a4-ab27-4e5e-b66e-27cfe30c9701 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.545581 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4a32c-60b5-44ee-bce4-552002be6cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.546294 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4a32c-60b5-44ee-bce4-552002be6cdd admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.546658 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4a32c-60b5-44ee-bce4-552002be6cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.546990 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4a32c-60b5-44ee-bce4-552002be6cdd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.548979 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 418/841] 10.222.0.39 () {56 vars in 1136 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:53.555140 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e655bde-fcd6-4f64-b700-6feb50c7cb00 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.557833 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4a32c-60b5-44ee-bce4-552002be6cdd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:53.559833 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4a32c-60b5-44ee-bce4-552002be6cdd admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:53.567596 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e655bde-fcd6-4f64-b700-6feb50c7cb00 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.572346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42b01d-d776-425a-9092-1b2566a6c355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.573264 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42b01d-d776-425a-9092-1b2566a6c355 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.573749 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42b01d-d776-425a-9092-1b2566a6c355 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.574241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42b01d-d776-425a-9092-1b2566a6c355 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.574693 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 424/842] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/auth/tokens => generated 2105 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:52:53.575686 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42b01d-d776-425a-9092-1b2566a6c355 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:53.576124 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4a32c-60b5-44ee-bce4-552002be6cdd admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.577763 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-7e42b01d-d776-425a-9092-1b2566a6c355 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:52:53.577763 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 02:52:53.577763 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 02:52:53.578999 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42b01d-d776-425a-9092-1b2566a6c355 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:53.586591 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4a32c-60b5-44ee-bce4-552002be6cdd admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.594768 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44041057-ca9f-418b-8900-735c1feea829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.595549 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44041057-ca9f-418b-8900-735c1feea829 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.595829 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44041057-ca9f-418b-8900-735c1feea829 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.596302 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44041057-ca9f-418b-8900-735c1feea829 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.611483 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 419/843] 10.222.0.39 () {60 vars in 1166 bytes} [Tue Aug 31 02:52:53 2021] POST /identity/v3/endpoints => generated 346 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:52:53.612784 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44041057-ca9f-418b-8900-735c1feea829 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:53.616325 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44041057-ca9f-418b-8900-735c1feea829 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:53.637731 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-44041057-ca9f-418b-8900-735c1feea829 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:52:53.639908 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 425/844] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:53.646213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42b01d-d776-425a-9092-1b2566a6c355 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.673505 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42b01d-d776-425a-9092-1b2566a6c355 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.678850 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b15512-8fcf-4f2a-987d-3d0804458245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.680017 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b15512-8fcf-4f2a-987d-3d0804458245 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.680565 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b15512-8fcf-4f2a-987d-3d0804458245 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.681100 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b15512-8fcf-4f2a-987d-3d0804458245 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.682237 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b15512-8fcf-4f2a-987d-3d0804458245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:53.682775 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b15512-8fcf-4f2a-987d-3d0804458245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:53.684882 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b15512-8fcf-4f2a-987d-3d0804458245 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:53.703552 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 420/845] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:53.707757 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44041057-ca9f-418b-8900-735c1feea829 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.719807 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44041057-ca9f-418b-8900-735c1feea829 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.725303 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8563c-6ba1-4545-8cc0-0e700f7e4047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.726636 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8563c-6ba1-4545-8cc0-0e700f7e4047 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.727124 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8563c-6ba1-4545-8cc0-0e700f7e4047 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.727676 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8563c-6ba1-4545-8cc0-0e700f7e4047 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.736128 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8563c-6ba1-4545-8cc0-0e700f7e4047 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:53.738556 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8563c-6ba1-4545-8cc0-0e700f7e4047 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:53.754149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-2da8563c-6ba1-4545-8cc0-0e700f7e4047 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:53.760085 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 426/846] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:53.763354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b15512-8fcf-4f2a-987d-3d0804458245 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.774783 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b15512-8fcf-4f2a-987d-3d0804458245 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.780337 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad26e7c-ca00-4e3f-940d-da7a22d24da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.781391 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad26e7c-ca00-4e3f-940d-da7a22d24da0 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.781972 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad26e7c-ca00-4e3f-940d-da7a22d24da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.782455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad26e7c-ca00-4e3f-940d-da7a22d24da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.783557 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad26e7c-ca00-4e3f-940d-da7a22d24da0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:53.784084 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad26e7c-ca00-4e3f-940d-da7a22d24da0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:53.786714 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad26e7c-ca00-4e3f-940d-da7a22d24da0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:53.787735 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeb8ac-2cd8-4aa7-a538-b33a381b57b2 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.788100 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeb8ac-2cd8-4aa7-a538-b33a381b57b2 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.788452 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeb8ac-2cd8-4aa7-a538-b33a381b57b2 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.791628 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 427/847] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:53.800397 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83d9e0-1ce7-44b3-9626-229c1d586a01 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.800805 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83d9e0-1ce7-44b3-9626-229c1d586a01 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.801089 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83d9e0-1ce7-44b3-9626-229c1d586a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.802778 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 421/848] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:53.809545 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad26e7c-ca00-4e3f-940d-da7a22d24da0 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.821480 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad26e7c-ca00-4e3f-940d-da7a22d24da0 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.824564 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-dd83d9e0-1ce7-44b3-9626-229c1d586a01 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:53.825752 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-dd83d9e0-1ce7-44b3-9626-229c1d586a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:53.827786 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc8858-923e-4064-97dc-42d5ae06df98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.828693 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc8858-923e-4064-97dc-42d5ae06df98 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.829104 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc8858-923e-4064-97dc-42d5ae06df98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.829473 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc8858-923e-4064-97dc-42d5ae06df98 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.830396 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc8858-923e-4064-97dc-42d5ae06df98 admin admin] RBAC: Adding query filter params (role.id=0c932d1474bf47918c81da6c0fa7c7ff, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=b1918e2aa8f24655875480ef52df324d) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:53.830809 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc8858-923e-4064-97dc-42d5ae06df98 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:53.832778 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc8858-923e-4064-97dc-42d5ae06df98 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:53.838713 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 428/849] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:53 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:53.847515 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 422/850] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/role_assignments?user.id=b1918e2aa8f24655875480ef52df324d&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=0c932d1474bf47918c81da6c0fa7c7ff => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:53.865636 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83d9e0-1ce7-44b3-9626-229c1d586a01 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.876542 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83d9e0-1ce7-44b3-9626-229c1d586a01 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.881817 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d34bb2-ec56-4674-a19d-399738d92243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.882640 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d34bb2-ec56-4674-a19d-399738d92243 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.882914 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d34bb2-ec56-4674-a19d-399738d92243 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.883247 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d34bb2-ec56-4674-a19d-399738d92243 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.883941 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d34bb2-ec56-4674-a19d-399738d92243 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:53.885608 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d34bb2-ec56-4674-a19d-399738d92243 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:53.899597 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-b4d34bb2-ec56-4674-a19d-399738d92243 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 02:52:53.901085 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 429/851] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:53.908814 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc8858-923e-4064-97dc-42d5ae06df98 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.927952 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc8858-923e-4064-97dc-42d5ae06df98 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.932952 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a331da-57d6-48b3-89ed-f0b94d2a4249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.933623 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a331da-57d6-48b3-89ed-f0b94d2a4249 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.933970 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a331da-57d6-48b3-89ed-f0b94d2a4249 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.934289 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a331da-57d6-48b3-89ed-f0b94d2a4249 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.935019 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a331da-57d6-48b3-89ed-f0b94d2a4249 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:53.935325 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a331da-57d6-48b3-89ed-f0b94d2a4249 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:53.937923 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a331da-57d6-48b3-89ed-f0b94d2a4249 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:53.944118 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 423/852] 10.222.0.39 () {56 vars in 1144 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:53.950895 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d34bb2-ec56-4674-a19d-399738d92243 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.961922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d34bb2-ec56-4674-a19d-399738d92243 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:53.966964 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816b6a0-8079-444a-9c26-2be203719f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:53.967765 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816b6a0-8079-444a-9c26-2be203719f9f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:53.968053 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816b6a0-8079-444a-9c26-2be203719f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:53.968379 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816b6a0-8079-444a-9c26-2be203719f9f admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:53.969102 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816b6a0-8079-444a-9c26-2be203719f9f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:53.969460 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816b6a0-8079-444a-9c26-2be203719f9f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:53.971155 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816b6a0-8079-444a-9c26-2be203719f9f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:53.977511 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 430/853] 10.222.0.39 () {56 vars in 1144 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:53.984545 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a331da-57d6-48b3-89ed-f0b94d2a4249 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:53.995265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a331da-57d6-48b3-89ed-f0b94d2a4249 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:54.001377 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442b1a7-a6c2-4bd6-8229-edc7e4552aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:54.002104 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442b1a7-a6c2-4bd6-8229-edc7e4552aab admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:54.002388 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442b1a7-a6c2-4bd6-8229-edc7e4552aab admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:54.002711 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442b1a7-a6c2-4bd6-8229-edc7e4552aab admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:54.003550 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442b1a7-a6c2-4bd6-8229-edc7e4552aab admin admin] RBAC: Adding query filter params (interface=public, service_id=7ad3a6871bf34c2682a115abe048e1a3, region_id=RegionOne) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:54.003912 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442b1a7-a6c2-4bd6-8229-edc7e4552aab admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:54.005580 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442b1a7-a6c2-4bd6-8229-edc7e4552aab admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:54.015769 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 424/854] 10.222.0.39 () {56 vars in 1273 bytes} [Tue Aug 31 02:52:53 2021] GET /identity/v3/endpoints?service_id=7ad3a6871bf34c2682a115abe048e1a3&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:54.018922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816b6a0-8079-444a-9c26-2be203719f9f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:54.029086 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816b6a0-8079-444a-9c26-2be203719f9f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:54.033909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8ed2c-3176-4f9c-94c7-28e7451cb6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:54.034623 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8ed2c-3176-4f9c-94c7-28e7451cb6ee admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:54.034905 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8ed2c-3176-4f9c-94c7-28e7451cb6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:54.035227 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8ed2c-3176-4f9c-94c7-28e7451cb6ee admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:54.035945 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8ed2c-3176-4f9c-94c7-28e7451cb6ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:54.037585 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8ed2c-3176-4f9c-94c7-28e7451cb6ee admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:54.044691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 431/855] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Aug 31 02:52:54 2021] GET /identity/v3/services => generated 1497 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 02:52:54.984292 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f85bc2-39d3-4d2c-8d5d-0069df4a2b81 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:54.984983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f85bc2-39d3-4d2c-8d5d-0069df4a2b81 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:54.984983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f85bc2-39d3-4d2c-8d5d-0069df4a2b81 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:54.986855 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 425/856] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:54.992959 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9528a-ecf0-495e-bd41-4eb72f7e7106 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:54.993525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9528a-ecf0-495e-bd41-4eb72f7e7106 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:54.993525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9528a-ecf0-495e-bd41-4eb72f7e7106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:55.011543 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-3bf9528a-ecf0-495e-bd41-4eb72f7e7106 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:55.012719 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-3bf9528a-ecf0-495e-bd41-4eb72f7e7106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:55.021162 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 432/857] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:54 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:55.044903 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f85bc2-39d3-4d2c-8d5d-0069df4a2b81 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:55.057273 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f85bc2-39d3-4d2c-8d5d-0069df4a2b81 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:55.061683 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4621ffa-6fdd-444e-a4d7-dee4b4a23fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:55.062455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4621ffa-6fdd-444e-a4d7-dee4b4a23fce admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:55.062734 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4621ffa-6fdd-444e-a4d7-dee4b4a23fce admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:55.063004 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4621ffa-6fdd-444e-a4d7-dee4b4a23fce admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:55.063677 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4621ffa-6fdd-444e-a4d7-dee4b4a23fce admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:55.065241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4621ffa-6fdd-444e-a4d7-dee4b4a23fce admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:55.076035 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-c4621ffa-6fdd-444e-a4d7-dee4b4a23fce admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 02:52:55.078002 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 426/858] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:55 2021] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:55.084539 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9528a-ecf0-495e-bd41-4eb72f7e7106 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:55.094374 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9528a-ecf0-495e-bd41-4eb72f7e7106 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:55.099214 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59cd4e-e97b-4f8d-8c9b-980d577632f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:55.099927 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59cd4e-e97b-4f8d-8c9b-980d577632f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:55.100203 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59cd4e-e97b-4f8d-8c9b-980d577632f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:55.100472 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59cd4e-e97b-4f8d-8c9b-980d577632f0 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:55.101185 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59cd4e-e97b-4f8d-8c9b-980d577632f0 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:55.101483 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59cd4e-e97b-4f8d-8c9b-980d577632f0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:55.105929 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59cd4e-e97b-4f8d-8c9b-980d577632f0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:55.114512 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 433/859] 10.222.0.39 () {56 vars in 1134 bytes} [Tue Aug 31 02:52:55 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:55.118406 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4621ffa-6fdd-444e-a4d7-dee4b4a23fce admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:55.127556 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4621ffa-6fdd-444e-a4d7-dee4b4a23fce admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:55.132218 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddc7d0-8354-4c02-9077-18a1c1e314bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:55.132932 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddc7d0-8354-4c02-9077-18a1c1e314bd admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:55.133210 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddc7d0-8354-4c02-9077-18a1c1e314bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:55.133482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddc7d0-8354-4c02-9077-18a1c1e314bd admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:55.134229 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddc7d0-8354-4c02-9077-18a1c1e314bd admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:55.134534 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddc7d0-8354-4c02-9077-18a1c1e314bd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:55.136146 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddc7d0-8354-4c02-9077-18a1c1e314bd admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:55.141861 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 427/860] 10.222.0.39 () {56 vars in 1134 bytes} [Tue Aug 31 02:52:55 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:55.925933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fed92-1239-4be2-b2cd-a78f74cdbcbf None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:55.926621 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fed92-1239-4be2-b2cd-a78f74cdbcbf None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:55.927134 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fed92-1239-4be2-b2cd-a78f74cdbcbf None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:55.929570 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 434/861] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:55 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:55.935881 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e3506-1e7e-43f5-ad09-4bb4564ee939 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:55.937064 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e3506-1e7e-43f5-ad09-4bb4564ee939 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:55.937547 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e3506-1e7e-43f5-ad09-4bb4564ee939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:55.955504 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-d71e3506-1e7e-43f5-ad09-4bb4564ee939 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:55.957019 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d71e3506-1e7e-43f5-ad09-4bb4564ee939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:55.965214 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 428/862] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:55 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:52:55.991626 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fed92-1239-4be2-b2cd-a78f74cdbcbf None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:56.005383 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fed92-1239-4be2-b2cd-a78f74cdbcbf None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:56.010820 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77409851-3b8a-4217-a134-0970829fb5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:56.011889 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77409851-3b8a-4217-a134-0970829fb5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:56.012377 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77409851-3b8a-4217-a134-0970829fb5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:56.012873 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77409851-3b8a-4217-a134-0970829fb5a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:56.013808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77409851-3b8a-4217-a134-0970829fb5a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:56.016070 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77409851-3b8a-4217-a134-0970829fb5a7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:56.017776 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.common [None req-77409851-3b8a-4217-a134-0970829fb5a7 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 02:52:56.037916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.sql.core [None req-77409851-3b8a-4217-a134-0970829fb5a7 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 02:52:56.037916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 02:52:56.037916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [parameters: {'id': 'abbf0b4fdf0c495bbe5ef68ccb48fc5f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 02:52:56.037916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73351) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 02:52:56.048021 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-77409851-3b8a-4217-a134-0970829fb5a7 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id abbf0b4fdf0c495bbe5ef68ccb48fc5f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id abbf0b4fdf0c495bbe5ef68ccb48fc5f. Aug 31 02:52:56.050112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 435/863] 10.222.0.39 () {60 vars in 1162 bytes} [Tue Aug 31 02:52:55 2021] POST /identity/v3/projects => generated 262 bytes in 59 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:56.056842 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e3506-1e7e-43f5-ad09-4bb4564ee939 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:56.066956 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e3506-1e7e-43f5-ad09-4bb4564ee939 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:56.072480 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a58cc6-e555-4803-9729-6d1f60deb1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:56.073581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a58cc6-e555-4803-9729-6d1f60deb1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:56.074064 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a58cc6-e555-4803-9729-6d1f60deb1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:56.074571 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a58cc6-e555-4803-9729-6d1f60deb1f3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:56.082486 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a58cc6-e555-4803-9729-6d1f60deb1f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:56.084866 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a58cc6-e555-4803-9729-6d1f60deb1f3 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:56.099246 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-76a58cc6-e555-4803-9729-6d1f60deb1f3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:52:56.101030 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 429/864] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:56.107882 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ee360-3f2c-4d1b-80be-8c6c947d552b None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:56.107882 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ee360-3f2c-4d1b-80be-8c6c947d552b None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:56.107882 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ee360-3f2c-4d1b-80be-8c6c947d552b None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:56.113147 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 436/865] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:56 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:56.113995 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a58cc6-e555-4803-9729-6d1f60deb1f3 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:56.119167 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c552fec-622d-4a9b-a560-035dadcaad91 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:56.119533 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c552fec-622d-4a9b-a560-035dadcaad91 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:56.119814 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c552fec-622d-4a9b-a560-035dadcaad91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:56.132345 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a58cc6-e555-4803-9729-6d1f60deb1f3 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:56.138023 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56969005-0dc9-4403-bccb-121f8487e4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:56.138907 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-8c552fec-622d-4a9b-a560-035dadcaad91 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:56.139149 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56969005-0dc9-4403-bccb-121f8487e4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:56.139819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56969005-0dc9-4403-bccb-121f8487e4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:56.140294 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56969005-0dc9-4403-bccb-121f8487e4a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:56.140504 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-8c552fec-622d-4a9b-a560-035dadcaad91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:56.141437 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56969005-0dc9-4403-bccb-121f8487e4a9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:56.141941 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56969005-0dc9-4403-bccb-121f8487e4a9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:56.144086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56969005-0dc9-4403-bccb-121f8487e4a9 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:56.149147 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 437/866] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:56 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:56.162712 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 430/867] 10.222.0.39 () {56 vars in 1134 bytes} [Tue Aug 31 02:52:56 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:56.175571 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c552fec-622d-4a9b-a560-035dadcaad91 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:56.186182 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c552fec-622d-4a9b-a560-035dadcaad91 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:56.193957 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cddf5-2402-4d68-ba8e-5c2d8fbf3d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:56.195132 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cddf5-2402-4d68-ba8e-5c2d8fbf3d30 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:56.195657 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cddf5-2402-4d68-ba8e-5c2d8fbf3d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:56.196120 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cddf5-2402-4d68-ba8e-5c2d8fbf3d30 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:56.197003 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cddf5-2402-4d68-ba8e-5c2d8fbf3d30 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:56.199168 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cddf5-2402-4d68-ba8e-5c2d8fbf3d30 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:56.211674 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-072cddf5-2402-4d68-ba8e-5c2d8fbf3d30 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 02:52:56.213569 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 438/868] 10.222.0.39 () {56 vars in 1127 bytes} [Tue Aug 31 02:52:56 2021] GET /identity/v3/services/image => generated 86 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:56.221524 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56969005-0dc9-4403-bccb-121f8487e4a9 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:56.233573 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56969005-0dc9-4403-bccb-121f8487e4a9 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:56.238952 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ade9f3-ac8f-4792-a098-c477a548b138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:56.239971 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ade9f3-ac8f-4792-a098-c477a548b138 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:56.240486 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ade9f3-ac8f-4792-a098-c477a548b138 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:56.240937 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ade9f3-ac8f-4792-a098-c477a548b138 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:56.241896 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ade9f3-ac8f-4792-a098-c477a548b138 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:56.242442 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ade9f3-ac8f-4792-a098-c477a548b138 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:56.244394 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ade9f3-ac8f-4792-a098-c477a548b138 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:56.251014 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 431/869] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:56 2021] GET /identity/v3/services?name=image => generated 122 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:56.257723 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cddf5-2402-4d68-ba8e-5c2d8fbf3d30 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:56.268700 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cddf5-2402-4d68-ba8e-5c2d8fbf3d30 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:56.273994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37162c4-9649-4a3a-a142-dd3ac5e188e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:56.275017 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37162c4-9649-4a3a-a142-dd3ac5e188e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:56.275513 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37162c4-9649-4a3a-a142-dd3ac5e188e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:56.277473 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37162c4-9649-4a3a-a142-dd3ac5e188e0 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:56.277864 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ad9d9-f271-4051-8c09-f72f0f538a92 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:56.278288 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37162c4-9649-4a3a-a142-dd3ac5e188e0 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:56.278538 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ad9d9-f271-4051-8c09-f72f0f538a92 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:56.278637 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37162c4-9649-4a3a-a142-dd3ac5e188e0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:56.279067 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ad9d9-f271-4051-8c09-f72f0f538a92 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:56.280865 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37162c4-9649-4a3a-a142-dd3ac5e188e0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:56.282383 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 432/870] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:56 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:52:56.290355 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 439/871] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:52:56 2021] GET /identity/v3/services?type=image => generated 122 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:56.295916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8eb3b-0c0b-4032-b665-464f10a435bc None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:56.295916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8eb3b-0c0b-4032-b665-464f10a435bc None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:56.295916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8eb3b-0c0b-4032-b665-464f10a435bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:56.313296 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-42f8eb3b-0c0b-4032-b665-464f10a435bc None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:56.314569 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-42f8eb3b-0c0b-4032-b665-464f10a435bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:56.327556 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 433/872] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:56 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:56.349906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37162c4-9649-4a3a-a142-dd3ac5e188e0 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:56.360910 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37162c4-9649-4a3a-a142-dd3ac5e188e0 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:56.365806 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d745a75-4f2e-4f46-b935-b4ffba152b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:56.366625 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d745a75-4f2e-4f46-b935-b4ffba152b2e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:56.366913 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d745a75-4f2e-4f46-b935-b4ffba152b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:56.367191 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d745a75-4f2e-4f46-b935-b4ffba152b2e admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:56.367881 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d745a75-4f2e-4f46-b935-b4ffba152b2e admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:56.369499 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d745a75-4f2e-4f46-b935-b4ffba152b2e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:56.381762 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-4d745a75-4f2e-4f46-b935-b4ffba152b2e admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 02:52:56.386960 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 440/873] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Aug 31 02:52:56 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:56.391207 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8eb3b-0c0b-4032-b665-464f10a435bc None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:56.401468 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8eb3b-0c0b-4032-b665-464f10a435bc None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:56.407484 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaa682-24f8-44b2-8665-84d60dc0d6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:56.408220 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaa682-24f8-44b2-8665-84d60dc0d6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:56.408502 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaa682-24f8-44b2-8665-84d60dc0d6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:56.408833 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaa682-24f8-44b2-8665-84d60dc0d6b8 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:56.409561 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaa682-24f8-44b2-8665-84d60dc0d6b8 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:56.409870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaa682-24f8-44b2-8665-84d60dc0d6b8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:56.411764 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaa682-24f8-44b2-8665-84d60dc0d6b8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:56.417647 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 434/874] 10.222.0.39 () {56 vars in 1144 bytes} [Tue Aug 31 02:52:56 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:56.424887 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d745a75-4f2e-4f46-b935-b4ffba152b2e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:56.435811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d745a75-4f2e-4f46-b935-b4ffba152b2e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:56.440951 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2c777-2fc0-44bc-b99a-255b04aa7fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:56.441560 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2c777-2fc0-44bc-b99a-255b04aa7fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:56.441845 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2c777-2fc0-44bc-b99a-255b04aa7fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:56.442123 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2c777-2fc0-44bc-b99a-255b04aa7fc7 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:56.442851 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2c777-2fc0-44bc-b99a-255b04aa7fc7 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:56.443159 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2c777-2fc0-44bc-b99a-255b04aa7fc7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:56.444822 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2c777-2fc0-44bc-b99a-255b04aa7fc7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:56.451343 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 441/875] 10.222.0.39 () {56 vars in 1144 bytes} [Tue Aug 31 02:52:56 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:56.458351 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaa682-24f8-44b2-8665-84d60dc0d6b8 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:56.468889 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaa682-24f8-44b2-8665-84d60dc0d6b8 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:56.473477 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceaee0d-cfe8-422b-b2d3-ba2b83919c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:56.474129 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaee0d-cfe8-422b-b2d3-ba2b83919c59 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:56.474414 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaee0d-cfe8-422b-b2d3-ba2b83919c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:56.474686 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaee0d-cfe8-422b-b2d3-ba2b83919c59 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:56.475470 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceaee0d-cfe8-422b-b2d3-ba2b83919c59 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:56.477068 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceaee0d-cfe8-422b-b2d3-ba2b83919c59 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:56.496862 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 435/876] 10.222.0.39 () {60 vars in 1166 bytes} [Tue Aug 31 02:52:56 2021] POST /identity/v3/endpoints => generated 349 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 02:52:57.347544 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde97279-e104-41bd-a733-39abadcd838c None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:57.348273 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde97279-e104-41bd-a733-39abadcd838c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:57.348467 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde97279-e104-41bd-a733-39abadcd838c None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:57.351435 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 442/877] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:57.358370 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53317666-f623-4570-a296-6a97dfa42f64 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:57.358945 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53317666-f623-4570-a296-6a97dfa42f64 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:57.358945 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53317666-f623-4570-a296-6a97dfa42f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:57.377259 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-53317666-f623-4570-a296-6a97dfa42f64 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:57.378368 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-53317666-f623-4570-a296-6a97dfa42f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:57.395933 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 436/878] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:57 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:57.420918 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde97279-e104-41bd-a733-39abadcd838c None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:57.433620 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde97279-e104-41bd-a733-39abadcd838c None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:57.439170 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df027c28-e8b7-42bf-ae7e-c64105f3792e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:57.439861 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df027c28-e8b7-42bf-ae7e-c64105f3792e admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:57.440144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df027c28-e8b7-42bf-ae7e-c64105f3792e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:57.440414 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df027c28-e8b7-42bf-ae7e-c64105f3792e admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:57.441141 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df027c28-e8b7-42bf-ae7e-c64105f3792e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:57.442734 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df027c28-e8b7-42bf-ae7e-c64105f3792e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:57.457640 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 443/879] 10.222.0.39 () {60 vars in 1163 bytes} [Tue Aug 31 02:52:57 2021] POST /identity/v3/services => generated 242 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:52:58.500426 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745dc1c-a917-4ec1-ac56-abdf0812dd8f None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:58.501110 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745dc1c-a917-4ec1-ac56-abdf0812dd8f None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:58.501110 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745dc1c-a917-4ec1-ac56-abdf0812dd8f None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:58.503006 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 437/880] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:58.508986 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ef6b3-8e90-4a29-80a3-5a477916d6b1 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:58.509492 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ef6b3-8e90-4a29-80a3-5a477916d6b1 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:58.509666 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ef6b3-8e90-4a29-80a3-5a477916d6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:58.527942 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-a58ef6b3-8e90-4a29-80a3-5a477916d6b1 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:58.529137 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a58ef6b3-8e90-4a29-80a3-5a477916d6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:58.548615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 444/881] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:58 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:58.574680 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745dc1c-a917-4ec1-ac56-abdf0812dd8f None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:58.587766 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745dc1c-a917-4ec1-ac56-abdf0812dd8f None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:58.593793 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4877791-1234-44f0-bdc2-ac7d529e482a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:58.594458 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4877791-1234-44f0-bdc2-ac7d529e482a admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:58.594740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4877791-1234-44f0-bdc2-ac7d529e482a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:58.595015 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4877791-1234-44f0-bdc2-ac7d529e482a admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:58.595753 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4877791-1234-44f0-bdc2-ac7d529e482a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:58.597631 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4877791-1234-44f0-bdc2-ac7d529e482a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:58.598951 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.common [None req-b4877791-1234-44f0-bdc2-ac7d529e482a admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 02:52:58.611911 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.sql.core [None req-b4877791-1234-44f0-bdc2-ac7d529e482a admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 02:52:58.611911 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 02:52:58.611911 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [parameters: {'user_id': '78ec08999f8c4fb3b81cefbbc1b32438', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 02:52:58.611911 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73350) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 02:52:58.627050 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-b4877791-1234-44f0-bdc2-ac7d529e482a admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 02:52:58.628977 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 438/882] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 02:52:58 2021] POST /identity/v3/users => generated 160 bytes in 55 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:58.635526 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ef6b3-8e90-4a29-80a3-5a477916d6b1 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:58.645845 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ef6b3-8e90-4a29-80a3-5a477916d6b1 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:58.653408 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9bc34-96da-4ac4-8409-67861b4e8a92 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:58.653408 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9bc34-96da-4ac4-8409-67861b4e8a92 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:58.655693 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db5af9-a5b2-4fcf-ad8e-3d57457a6af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:58.656036 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9bc34-96da-4ac4-8409-67861b4e8a92 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:58.656212 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db5af9-a5b2-4fcf-ad8e-3d57457a6af5 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:58.656212 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db5af9-a5b2-4fcf-ad8e-3d57457a6af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:58.656212 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db5af9-a5b2-4fcf-ad8e-3d57457a6af5 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:58.658152 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 439/883] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:58 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:58.664406 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1ba7c-87ff-47ef-916d-8dd4416bc7cb None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:58.664695 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1ba7c-87ff-47ef-916d-8dd4416bc7cb None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:58.664972 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1ba7c-87ff-47ef-916d-8dd4416bc7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:58.665744 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db5af9-a5b2-4fcf-ad8e-3d57457a6af5 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:58.668235 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db5af9-a5b2-4fcf-ad8e-3d57457a6af5 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:58.685280 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-c4db5af9-a5b2-4fcf-ad8e-3d57457a6af5 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 02:52:58.685595 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-2fb1ba7c-87ff-47ef-916d-8dd4416bc7cb None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:58.687959 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 445/884] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:52:58 2021] GET /identity/v3/users/cinder => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:58.688093 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-2fb1ba7c-87ff-47ef-916d-8dd4416bc7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:58.695562 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db5af9-a5b2-4fcf-ad8e-3d57457a6af5 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:58.707398 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 440/885] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:58 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:58.713316 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db5af9-a5b2-4fcf-ad8e-3d57457a6af5 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:58.718810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b2385-b59e-493e-82a6-4e4cba1d5466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:58.719509 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b2385-b59e-493e-82a6-4e4cba1d5466 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:58.719861 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b2385-b59e-493e-82a6-4e4cba1d5466 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:58.720144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b2385-b59e-493e-82a6-4e4cba1d5466 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:58.720940 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b2385-b59e-493e-82a6-4e4cba1d5466 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:58.721246 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b2385-b59e-493e-82a6-4e4cba1d5466 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:58.723070 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b2385-b59e-493e-82a6-4e4cba1d5466 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:58.728206 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1ba7c-87ff-47ef-916d-8dd4416bc7cb None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:58.737583 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1ba7c-87ff-47ef-916d-8dd4416bc7cb None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:58.743139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde9bfe-4da3-47d1-bf22-10f73dd5aab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:58.744474 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde9bfe-4da3-47d1-bf22-10f73dd5aab0 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:58.744765 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde9bfe-4da3-47d1-bf22-10f73dd5aab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:58.745042 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde9bfe-4da3-47d1-bf22-10f73dd5aab0 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:58.745767 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde9bfe-4da3-47d1-bf22-10f73dd5aab0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:58.748036 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde9bfe-4da3-47d1-bf22-10f73dd5aab0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:58.770760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 441/886] 10.222.0.39 () {60 vars in 1163 bytes} [Tue Aug 31 02:52:58 2021] POST /identity/v3/services => generated 242 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 02:52:58.770958 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 446/887] 10.222.0.39 () {56 vars in 1123 bytes} [Tue Aug 31 02:52:58 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:58.913503 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474d84e-a72e-4060-b522-e554ce4e4665 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:58.913788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474d84e-a72e-4060-b522-e554ce4e4665 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:58.914076 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474d84e-a72e-4060-b522-e554ce4e4665 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:58.916221 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 442/888] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:58.927115 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd12a6-cd6a-4254-a5a9-591924b6b9c8 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:58.927674 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd12a6-cd6a-4254-a5a9-591924b6b9c8 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:58.928063 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd12a6-cd6a-4254-a5a9-591924b6b9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:58.949516 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-30cd12a6-cd6a-4254-a5a9-591924b6b9c8 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:58.950803 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-30cd12a6-cd6a-4254-a5a9-591924b6b9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:58.970033 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 447/889] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:58 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:58.995223 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474d84e-a72e-4060-b522-e554ce4e4665 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:59.009155 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474d84e-a72e-4060-b522-e554ce4e4665 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:59.013660 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f77003-df5e-4982-b827-98b09ca94289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:59.014636 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f77003-df5e-4982-b827-98b09ca94289 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:59.014916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f77003-df5e-4982-b827-98b09ca94289 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:59.015191 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f77003-df5e-4982-b827-98b09ca94289 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:59.015885 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f77003-df5e-4982-b827-98b09ca94289 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:59.017469 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f77003-df5e-4982-b827-98b09ca94289 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:59.029135 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-05f77003-df5e-4982-b827-98b09ca94289 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 02:52:59.031054 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 443/890] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Aug 31 02:52:58 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:52:59.038284 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd12a6-cd6a-4254-a5a9-591924b6b9c8 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:59.050819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd12a6-cd6a-4254-a5a9-591924b6b9c8 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:59.055533 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc8482-1671-4ec1-a87d-56286a6c67de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:59.056202 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc8482-1671-4ec1-a87d-56286a6c67de admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:59.056485 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc8482-1671-4ec1-a87d-56286a6c67de admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:59.056759 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc8482-1671-4ec1-a87d-56286a6c67de admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:59.057468 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc8482-1671-4ec1-a87d-56286a6c67de admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:59.057774 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc8482-1671-4ec1-a87d-56286a6c67de admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:59.059436 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc8482-1671-4ec1-a87d-56286a6c67de admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:59.066802 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 448/891] 10.222.0.39 () {56 vars in 1144 bytes} [Tue Aug 31 02:52:59 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:59.073915 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f77003-df5e-4982-b827-98b09ca94289 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:59.084518 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f77003-df5e-4982-b827-98b09ca94289 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:59.090296 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72ebe6-b475-457f-9146-2824b6df2e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:59.091229 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72ebe6-b475-457f-9146-2824b6df2e27 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:59.091834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72ebe6-b475-457f-9146-2824b6df2e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:59.092968 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72ebe6-b475-457f-9146-2824b6df2e27 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:59.094029 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72ebe6-b475-457f-9146-2824b6df2e27 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:59.094586 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72ebe6-b475-457f-9146-2824b6df2e27 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:59.096576 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72ebe6-b475-457f-9146-2824b6df2e27 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:59.102696 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 444/892] 10.222.0.39 () {56 vars in 1144 bytes} [Tue Aug 31 02:52:59 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:59.112649 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc8482-1671-4ec1-a87d-56286a6c67de admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:59.123261 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc8482-1671-4ec1-a87d-56286a6c67de admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:59.127895 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2b84d-11ad-45d1-9ef9-455247918ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:59.128551 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2b84d-11ad-45d1-9ef9-455247918ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:59.128833 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2b84d-11ad-45d1-9ef9-455247918ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:59.129105 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2b84d-11ad-45d1-9ef9-455247918ba0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:59.129885 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2b84d-11ad-45d1-9ef9-455247918ba0 admin admin] RBAC: Adding query filter params (interface=admin, service_id=7ad3a6871bf34c2682a115abe048e1a3, region_id=RegionOne) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:59.130195 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2b84d-11ad-45d1-9ef9-455247918ba0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:59.131839 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2b84d-11ad-45d1-9ef9-455247918ba0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:59.137058 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 449/893] 10.222.0.39 () {56 vars in 1271 bytes} [Tue Aug 31 02:52:59 2021] GET /identity/v3/endpoints?service_id=7ad3a6871bf34c2682a115abe048e1a3&interface=admin®ion_id=RegionOne => generated 193 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:59.143439 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72ebe6-b475-457f-9146-2824b6df2e27 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:59.153286 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72ebe6-b475-457f-9146-2824b6df2e27 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:59.158348 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364fa7f-b325-444c-9658-bf29f018a9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:59.158995 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364fa7f-b325-444c-9658-bf29f018a9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:59.159277 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364fa7f-b325-444c-9658-bf29f018a9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:59.159581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364fa7f-b325-444c-9658-bf29f018a9b1 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:59.160250 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364fa7f-b325-444c-9658-bf29f018a9b1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:59.161841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364fa7f-b325-444c-9658-bf29f018a9b1 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:59.168437 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 445/894] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Aug 31 02:52:59 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 02:52:59.813534 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d0845-d70c-47f4-b2d2-eb24cdd51017 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:59.814586 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d0845-d70c-47f4-b2d2-eb24cdd51017 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:59.815107 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d0845-d70c-47f4-b2d2-eb24cdd51017 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:59.817143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 450/895] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:52:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:52:59.823007 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cc0ae-698a-4ea8-a4de-d7269308a2c6 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:59.823846 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cc0ae-698a-4ea8-a4de-d7269308a2c6 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:59.824335 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cc0ae-698a-4ea8-a4de-d7269308a2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:59.843282 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-b60cc0ae-698a-4ea8-a4de-d7269308a2c6 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:52:59.845002 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b60cc0ae-698a-4ea8-a4de-d7269308a2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:52:59.853376 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 446/896] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:52:59 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:52:59.877490 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d0845-d70c-47f4-b2d2-eb24cdd51017 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:59.891144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d0845-d70c-47f4-b2d2-eb24cdd51017 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:59.896059 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1374a18-9412-4f07-9137-1ab73c897dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:59.897303 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1374a18-9412-4f07-9137-1ab73c897dbd admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:59.897817 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1374a18-9412-4f07-9137-1ab73c897dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:59.898294 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1374a18-9412-4f07-9137-1ab73c897dbd admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:59.899142 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1374a18-9412-4f07-9137-1ab73c897dbd admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:59.900970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1374a18-9412-4f07-9137-1ab73c897dbd admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:59.912565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-b1374a18-9412-4f07-9137-1ab73c897dbd admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 02:52:59.914015 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 451/897] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:52:59 2021] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:52:59.920731 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cc0ae-698a-4ea8-a4de-d7269308a2c6 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:59.930312 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cc0ae-698a-4ea8-a4de-d7269308a2c6 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:59.935136 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17388892-9320-425b-9d2d-3ef3f9beb354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:59.936646 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17388892-9320-425b-9d2d-3ef3f9beb354 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:59.937234 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17388892-9320-425b-9d2d-3ef3f9beb354 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:59.937751 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17388892-9320-425b-9d2d-3ef3f9beb354 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:59.938660 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17388892-9320-425b-9d2d-3ef3f9beb354 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:59.939179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17388892-9320-425b-9d2d-3ef3f9beb354 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:59.941002 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17388892-9320-425b-9d2d-3ef3f9beb354 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:59.946624 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 447/898] 10.222.0.39 () {56 vars in 1134 bytes} [Tue Aug 31 02:52:59 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:52:59.953582 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1374a18-9412-4f07-9137-1ab73c897dbd admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:59.963065 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1374a18-9412-4f07-9137-1ab73c897dbd admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:59.967766 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a569af5-6546-4b7f-93e3-3c90a5a092a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:59.968431 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a569af5-6546-4b7f-93e3-3c90a5a092a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:59.968713 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a569af5-6546-4b7f-93e3-3c90a5a092a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:59.968986 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a569af5-6546-4b7f-93e3-3c90a5a092a0 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:52:59.969671 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a569af5-6546-4b7f-93e3-3c90a5a092a0 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:52:59.969972 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a569af5-6546-4b7f-93e3-3c90a5a092a0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:52:59.971557 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a569af5-6546-4b7f-93e3-3c90a5a092a0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:52:59.976373 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 452/899] 10.222.0.39 () {56 vars in 1134 bytes} [Tue Aug 31 02:52:59 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:52:59.982480 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17388892-9320-425b-9d2d-3ef3f9beb354 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:52:59.993097 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17388892-9320-425b-9d2d-3ef3f9beb354 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:52:59.998110 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d2942-b4e1-408c-a51d-a2d22f98507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:52:59.999338 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d2942-b4e1-408c-a51d-a2d22f98507b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:52:59.999664 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d2942-b4e1-408c-a51d-a2d22f98507b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:52:59.999936 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d2942-b4e1-408c-a51d-a2d22f98507b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:00.000747 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d2942-b4e1-408c-a51d-a2d22f98507b admin admin] RBAC: Adding query filter params (interface=public, service_id=726af522ed354d069518bb67947f9a10, region_id=RegionOne) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:00.001061 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d2942-b4e1-408c-a51d-a2d22f98507b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:00.002703 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d2942-b4e1-408c-a51d-a2d22f98507b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:00.008752 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 448/900] 10.222.0.39 () {56 vars in 1273 bytes} [Tue Aug 31 02:52:59 2021] GET /identity/v3/endpoints?service_id=726af522ed354d069518bb67947f9a10&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:53:00.016073 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a569af5-6546-4b7f-93e3-3c90a5a092a0 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:00.025960 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a569af5-6546-4b7f-93e3-3c90a5a092a0 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:00.030645 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87d6c6-93ec-4b59-b975-6c61f0e16996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:00.031304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87d6c6-93ec-4b59-b975-6c61f0e16996 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:00.031633 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87d6c6-93ec-4b59-b975-6c61f0e16996 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:00.031902 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87d6c6-93ec-4b59-b975-6c61f0e16996 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:00.032565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87d6c6-93ec-4b59-b975-6c61f0e16996 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:00.034133 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87d6c6-93ec-4b59-b975-6c61f0e16996 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:00.041034 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 453/901] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Aug 31 02:53:00 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 02:53:01.008202 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb84fe-0695-4950-8ebe-7aafbae6fed1 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:01.008788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb84fe-0695-4950-8ebe-7aafbae6fed1 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:01.008788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb84fe-0695-4950-8ebe-7aafbae6fed1 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:01.010678 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 449/902] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:01.016611 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117ca84-87ee-484a-8d1c-623271be84dc None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:01.017030 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117ca84-87ee-484a-8d1c-623271be84dc None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:01.017219 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117ca84-87ee-484a-8d1c-623271be84dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:01.035592 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-8117ca84-87ee-484a-8d1c-623271be84dc None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:01.037353 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-8117ca84-87ee-484a-8d1c-623271be84dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:01.047029 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 454/903] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:01 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:01.074137 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb84fe-0695-4950-8ebe-7aafbae6fed1 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:01.086847 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb84fe-0695-4950-8ebe-7aafbae6fed1 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:01.091255 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2aef4-49ce-4674-8750-ddfea7a37802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:01.092153 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2aef4-49ce-4674-8750-ddfea7a37802 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:01.093030 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2aef4-49ce-4674-8750-ddfea7a37802 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:01.093305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2aef4-49ce-4674-8750-ddfea7a37802 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:01.093949 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2aef4-49ce-4674-8750-ddfea7a37802 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:01.095544 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2aef4-49ce-4674-8750-ddfea7a37802 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:01.106139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-5be2aef4-49ce-4674-8750-ddfea7a37802 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 02:53:01.109203 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 450/904] 10.222.0.39 () {56 vars in 1127 bytes} [Tue Aug 31 02:53:01 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:01.118688 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117ca84-87ee-484a-8d1c-623271be84dc None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:01.129608 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117ca84-87ee-484a-8d1c-623271be84dc None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:01.134145 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1642599-0be8-4deb-8a83-ac420561d0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:01.134802 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1642599-0be8-4deb-8a83-ac420561d0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:01.135085 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1642599-0be8-4deb-8a83-ac420561d0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:01.135379 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1642599-0be8-4deb-8a83-ac420561d0e9 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:01.136098 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1642599-0be8-4deb-8a83-ac420561d0e9 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:01.136403 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1642599-0be8-4deb-8a83-ac420561d0e9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:01.138000 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1642599-0be8-4deb-8a83-ac420561d0e9 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:01.142992 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 455/905] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:53:01 2021] GET /identity/v3/services?name=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:01.149288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2aef4-49ce-4674-8750-ddfea7a37802 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:01.159437 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2aef4-49ce-4674-8750-ddfea7a37802 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:01.163875 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965b18a-9cae-4083-94f6-778d91257916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:01.164516 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965b18a-9cae-4083-94f6-778d91257916 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:01.164794 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965b18a-9cae-4083-94f6-778d91257916 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:01.165066 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965b18a-9cae-4083-94f6-778d91257916 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:01.165755 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965b18a-9cae-4083-94f6-778d91257916 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:01.166057 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965b18a-9cae-4083-94f6-778d91257916 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:01.167640 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965b18a-9cae-4083-94f6-778d91257916 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:01.173605 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 451/906] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:53:01 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:53:01.180111 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1642599-0be8-4deb-8a83-ac420561d0e9 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:01.190878 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1642599-0be8-4deb-8a83-ac420561d0e9 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:01.195386 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9c271-c2c1-47bf-ae97-706861e9aa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:01.196129 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9c271-c2c1-47bf-ae97-706861e9aa77 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:01.196476 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9c271-c2c1-47bf-ae97-706861e9aa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:01.196821 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9c271-c2c1-47bf-ae97-706861e9aa77 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:01.197599 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9c271-c2c1-47bf-ae97-706861e9aa77 admin admin] RBAC: Adding query filter params (interface=public, service_id=675940ebeb594b2c9b576612c608ca3c, region_id=RegionOne) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:01.197904 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9c271-c2c1-47bf-ae97-706861e9aa77 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:01.199520 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9c271-c2c1-47bf-ae97-706861e9aa77 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:01.205647 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 456/907] 10.222.0.39 () {56 vars in 1273 bytes} [Tue Aug 31 02:53:01 2021] GET /identity/v3/endpoints?service_id=675940ebeb594b2c9b576612c608ca3c&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:01.211911 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965b18a-9cae-4083-94f6-778d91257916 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:01.224287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965b18a-9cae-4083-94f6-778d91257916 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:01.228943 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e645d8c-6f14-4d71-9564-1e505a36592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:01.229619 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e645d8c-6f14-4d71-9564-1e505a36592b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:01.229896 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e645d8c-6f14-4d71-9564-1e505a36592b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:01.230167 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e645d8c-6f14-4d71-9564-1e505a36592b admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:01.230846 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e645d8c-6f14-4d71-9564-1e505a36592b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:01.232483 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e645d8c-6f14-4d71-9564-1e505a36592b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:01.239791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 452/908] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Aug 31 02:53:01 2021] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 02:53:01.361235 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fa2c0-cbc6-4af0-8c6a-1417dbcac3bf None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:01.361538 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fa2c0-cbc6-4af0-8c6a-1417dbcac3bf None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:01.361704 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fa2c0-cbc6-4af0-8c6a-1417dbcac3bf None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:01.363701 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 457/909] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:01.370007 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7d378-a94c-489f-b848-5ad41bc82c2e None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:01.370294 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7d378-a94c-489f-b848-5ad41bc82c2e None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:01.370578 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7d378-a94c-489f-b848-5ad41bc82c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:01.390557 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-d6c7d378-a94c-489f-b848-5ad41bc82c2e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:01.391822 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d6c7d378-a94c-489f-b848-5ad41bc82c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:01.399753 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 453/910] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:01 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:01.424483 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fa2c0-cbc6-4af0-8c6a-1417dbcac3bf None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:01.438215 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fa2c0-cbc6-4af0-8c6a-1417dbcac3bf None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:01.442612 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea12db9-ac50-400c-b04d-1143c5ef7fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:01.443516 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea12db9-ac50-400c-b04d-1143c5ef7fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:01.443801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea12db9-ac50-400c-b04d-1143c5ef7fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:01.444083 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea12db9-ac50-400c-b04d-1143c5ef7fa6 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:01.444731 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea12db9-ac50-400c-b04d-1143c5ef7fa6 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:01.446413 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea12db9-ac50-400c-b04d-1143c5ef7fa6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:01.457847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-fea12db9-ac50-400c-b04d-1143c5ef7fa6 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 02:53:01.459436 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 458/911] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Aug 31 02:53:01 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:01.465904 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7d378-a94c-489f-b848-5ad41bc82c2e None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:01.475658 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7d378-a94c-489f-b848-5ad41bc82c2e None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:01.480145 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c38c0-0458-48c5-a9e7-f664990bb772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:01.480798 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c38c0-0458-48c5-a9e7-f664990bb772 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:01.481089 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c38c0-0458-48c5-a9e7-f664990bb772 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:01.481365 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c38c0-0458-48c5-a9e7-f664990bb772 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:01.482061 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c38c0-0458-48c5-a9e7-f664990bb772 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:01.482367 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c38c0-0458-48c5-a9e7-f664990bb772 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:01.484741 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c38c0-0458-48c5-a9e7-f664990bb772 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:01.489788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 454/912] 10.222.0.39 () {56 vars in 1144 bytes} [Tue Aug 31 02:53:01 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:53:01.496129 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea12db9-ac50-400c-b04d-1143c5ef7fa6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:01.506659 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea12db9-ac50-400c-b04d-1143c5ef7fa6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:01.511135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c5be4-0218-4cfa-8131-9bd41d55adf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:01.511817 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c5be4-0218-4cfa-8131-9bd41d55adf8 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:01.512101 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c5be4-0218-4cfa-8131-9bd41d55adf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:01.512374 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c5be4-0218-4cfa-8131-9bd41d55adf8 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:01.513065 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c5be4-0218-4cfa-8131-9bd41d55adf8 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:01.513368 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c5be4-0218-4cfa-8131-9bd41d55adf8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:01.514941 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c5be4-0218-4cfa-8131-9bd41d55adf8 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:01.519911 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 459/913] 10.222.0.39 () {56 vars in 1144 bytes} [Tue Aug 31 02:53:01 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:01.525916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c38c0-0458-48c5-a9e7-f664990bb772 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:01.536332 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c38c0-0458-48c5-a9e7-f664990bb772 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:01.541213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2eec7-1af7-470c-a19a-b986574b844e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:01.541862 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2eec7-1af7-470c-a19a-b986574b844e admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:01.542201 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2eec7-1af7-470c-a19a-b986574b844e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:01.542478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2eec7-1af7-470c-a19a-b986574b844e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:01.543261 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2eec7-1af7-470c-a19a-b986574b844e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:01.544956 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2eec7-1af7-470c-a19a-b986574b844e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:01.563402 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 455/914] 10.222.0.39 () {60 vars in 1166 bytes} [Tue Aug 31 02:53:01 2021] POST /identity/v3/endpoints => generated 325 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 02:53:02.224318 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c078a3d-b37b-4a54-a849-a2a77cbf5364 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:02.224829 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c078a3d-b37b-4a54-a849-a2a77cbf5364 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:02.224905 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c078a3d-b37b-4a54-a849-a2a77cbf5364 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:02.226793 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 460/915] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:02.232552 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb51bcf-93f7-4f60-bf14-067e06ddf9e4 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:02.233747 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb51bcf-93f7-4f60-bf14-067e06ddf9e4 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:02.233747 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb51bcf-93f7-4f60-bf14-067e06ddf9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:02.254179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-afb51bcf-93f7-4f60-bf14-067e06ddf9e4 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:02.255383 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-afb51bcf-93f7-4f60-bf14-067e06ddf9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:02.272430 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 456/916] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:02 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:53:02.298877 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c078a3d-b37b-4a54-a849-a2a77cbf5364 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:02.310897 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c078a3d-b37b-4a54-a849-a2a77cbf5364 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:02.315384 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791c980-22ec-42af-8f3c-7e7ddab4c3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:02.316183 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791c980-22ec-42af-8f3c-7e7ddab4c3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:02.316458 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791c980-22ec-42af-8f3c-7e7ddab4c3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:02.316734 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791c980-22ec-42af-8f3c-7e7ddab4c3f0 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:02.317373 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791c980-22ec-42af-8f3c-7e7ddab4c3f0 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:02.318949 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791c980-22ec-42af-8f3c-7e7ddab4c3f0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:02.330729 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-b791c980-22ec-42af-8f3c-7e7ddab4c3f0 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 02:53:02.332087 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 461/917] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:53:02 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:02.338695 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb51bcf-93f7-4f60-bf14-067e06ddf9e4 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:02.350699 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb51bcf-93f7-4f60-bf14-067e06ddf9e4 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:02.355201 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf1ad0-7003-4303-94f9-c4d5084b167d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:02.355894 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1ad0-7003-4303-94f9-c4d5084b167d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:02.356635 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1ad0-7003-4303-94f9-c4d5084b167d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:02.356635 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1ad0-7003-4303-94f9-c4d5084b167d admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:02.357205 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf1ad0-7003-4303-94f9-c4d5084b167d admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:02.357513 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf1ad0-7003-4303-94f9-c4d5084b167d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:02.359664 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf1ad0-7003-4303-94f9-c4d5084b167d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:02.368879 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 457/918] 10.222.0.39 () {56 vars in 1134 bytes} [Tue Aug 31 02:53:02 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:02.376281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791c980-22ec-42af-8f3c-7e7ddab4c3f0 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:02.386304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791c980-22ec-42af-8f3c-7e7ddab4c3f0 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:02.391042 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac4f09-2e24-4265-8913-7849b707e2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:02.391712 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac4f09-2e24-4265-8913-7849b707e2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:02.391995 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac4f09-2e24-4265-8913-7849b707e2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:02.392263 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac4f09-2e24-4265-8913-7849b707e2e7 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:02.392954 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac4f09-2e24-4265-8913-7849b707e2e7 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:02.393255 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac4f09-2e24-4265-8913-7849b707e2e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:02.394836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac4f09-2e24-4265-8913-7849b707e2e7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:02.402669 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 462/919] 10.222.0.39 () {56 vars in 1134 bytes} [Tue Aug 31 02:53:02 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:02.406531 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf1ad0-7003-4303-94f9-c4d5084b167d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:02.416264 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf1ad0-7003-4303-94f9-c4d5084b167d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:02.421368 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbe490-2e88-41c3-9c77-a4db44c896cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:02.422036 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbe490-2e88-41c3-9c77-a4db44c896cc admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:02.422309 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbe490-2e88-41c3-9c77-a4db44c896cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:02.422583 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbe490-2e88-41c3-9c77-a4db44c896cc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:02.423321 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbe490-2e88-41c3-9c77-a4db44c896cc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:02.424936 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbe490-2e88-41c3-9c77-a4db44c896cc admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:02.451447 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 458/920] 10.222.0.39 () {60 vars in 1166 bytes} [Tue Aug 31 02:53:02 2021] POST /identity/v3/endpoints => generated 334 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:53:03.434195 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434df49e-1037-4ae9-99ca-d2523c71c5bd None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:03.434685 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434df49e-1037-4ae9-99ca-d2523c71c5bd None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:03.434685 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434df49e-1037-4ae9-99ca-d2523c71c5bd None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:03.436675 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 463/921] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:03.442361 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b95229-56df-4e79-bbfb-f0cc8cfd6289 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:03.442764 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b95229-56df-4e79-bbfb-f0cc8cfd6289 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:03.442933 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b95229-56df-4e79-bbfb-f0cc8cfd6289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:03.460652 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-e6b95229-56df-4e79-bbfb-f0cc8cfd6289 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:03.461819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-e6b95229-56df-4e79-bbfb-f0cc8cfd6289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:03.479553 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 459/922] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:03 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:03.503876 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434df49e-1037-4ae9-99ca-d2523c71c5bd None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:03.516340 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434df49e-1037-4ae9-99ca-d2523c71c5bd None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:03.520599 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9d100-5dcf-40fb-bad6-cba5cd78e003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:03.521371 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9d100-5dcf-40fb-bad6-cba5cd78e003 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:03.521649 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9d100-5dcf-40fb-bad6-cba5cd78e003 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:03.521919 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9d100-5dcf-40fb-bad6-cba5cd78e003 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:03.522556 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9d100-5dcf-40fb-bad6-cba5cd78e003 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:03.524171 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9d100-5dcf-40fb-bad6-cba5cd78e003 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:03.534876 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-91b9d100-5dcf-40fb-bad6-cba5cd78e003 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 02:53:03.536196 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 464/923] 10.222.0.39 () {56 vars in 1127 bytes} [Tue Aug 31 02:53:03 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:03.542569 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b95229-56df-4e79-bbfb-f0cc8cfd6289 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:03.551497 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b95229-56df-4e79-bbfb-f0cc8cfd6289 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:03.555883 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefbe29-c809-4717-8444-541b563ae00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:03.556532 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefbe29-c809-4717-8444-541b563ae00d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:03.556809 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefbe29-c809-4717-8444-541b563ae00d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:03.557077 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefbe29-c809-4717-8444-541b563ae00d admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:03.557769 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefbe29-c809-4717-8444-541b563ae00d admin admin] RBAC: Adding query filter params (name=image) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:03.558070 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefbe29-c809-4717-8444-541b563ae00d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:03.559660 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefbe29-c809-4717-8444-541b563ae00d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:03.565139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 460/924] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:53:03 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:03.571101 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9d100-5dcf-40fb-bad6-cba5cd78e003 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:03.581411 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9d100-5dcf-40fb-bad6-cba5cd78e003 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:03.585943 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc698279-5b25-4c52-b0fd-78e4fe489b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:03.586593 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc698279-5b25-4c52-b0fd-78e4fe489b2c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:03.586874 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc698279-5b25-4c52-b0fd-78e4fe489b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:03.587146 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc698279-5b25-4c52-b0fd-78e4fe489b2c admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:03.587877 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc698279-5b25-4c52-b0fd-78e4fe489b2c admin admin] RBAC: Adding query filter params (type=image) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:03.588182 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc698279-5b25-4c52-b0fd-78e4fe489b2c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:03.590105 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc698279-5b25-4c52-b0fd-78e4fe489b2c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:03.596093 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 465/925] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:53:03 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:53:03.602570 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefbe29-c809-4717-8444-541b563ae00d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:03.612544 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefbe29-c809-4717-8444-541b563ae00d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:03.617078 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57f17b-e1d1-409a-8d63-52841f1a0d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:03.617809 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57f17b-e1d1-409a-8d63-52841f1a0d74 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:03.618093 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57f17b-e1d1-409a-8d63-52841f1a0d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:03.618361 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57f17b-e1d1-409a-8d63-52841f1a0d74 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:03.619097 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57f17b-e1d1-409a-8d63-52841f1a0d74 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:03.620710 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57f17b-e1d1-409a-8d63-52841f1a0d74 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:03.640255 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 461/926] 10.222.0.39 () {60 vars in 1166 bytes} [Tue Aug 31 02:53:03 2021] POST /identity/v3/endpoints => generated 327 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:53:03.765167 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b32a4c-c3d1-400e-8135-9ac902030095 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:03.765543 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b32a4c-c3d1-400e-8135-9ac902030095 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:03.765904 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b32a4c-c3d1-400e-8135-9ac902030095 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:03.767860 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 466/927] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:53:03.774294 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2a0f6-94b1-4eff-87ba-2bfcae9e3cb5 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:03.774591 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2a0f6-94b1-4eff-87ba-2bfcae9e3cb5 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:03.774873 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2a0f6-94b1-4eff-87ba-2bfcae9e3cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:03.793349 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-9ef2a0f6-94b1-4eff-87ba-2bfcae9e3cb5 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:03.794626 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-9ef2a0f6-94b1-4eff-87ba-2bfcae9e3cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:03.813664 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 462/928] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:03 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:03.839049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b32a4c-c3d1-400e-8135-9ac902030095 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:03.852002 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b32a4c-c3d1-400e-8135-9ac902030095 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:03.856515 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b3636-deeb-4485-83c3-82baf031781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:03.857467 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b3636-deeb-4485-83c3-82baf031781a admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:03.858310 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b3636-deeb-4485-83c3-82baf031781a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:03.858678 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b3636-deeb-4485-83c3-82baf031781a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:03.859903 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b3636-deeb-4485-83c3-82baf031781a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:03.861561 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b3636-deeb-4485-83c3-82baf031781a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:03.863286 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 467/929] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:53:03 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:03.869709 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2a0f6-94b1-4eff-87ba-2bfcae9e3cb5 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:03.880005 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2a0f6-94b1-4eff-87ba-2bfcae9e3cb5 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:03.885308 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d58f1e-41c9-48aa-b03a-f27e8003b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:03.885962 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d58f1e-41c9-48aa-b03a-f27e8003b494 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:03.886239 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d58f1e-41c9-48aa-b03a-f27e8003b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:03.886508 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d58f1e-41c9-48aa-b03a-f27e8003b494 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:03.887206 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d58f1e-41c9-48aa-b03a-f27e8003b494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:03.889157 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d58f1e-41c9-48aa-b03a-f27e8003b494 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:03.915010 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 463/930] 10.222.0.39 () {60 vars in 1163 bytes} [Tue Aug 31 02:53:03 2021] POST /identity/v3/projects => generated 311 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:53:04.726966 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563efe34-831f-4152-a61d-cabe940ef01c None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:04.727532 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563efe34-831f-4152-a61d-cabe940ef01c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:04.727532 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563efe34-831f-4152-a61d-cabe940ef01c None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:04.729476 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 468/931] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:04.736038 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e372f04-67bb-47d9-b916-9fbb5da8fb38 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:04.736451 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e372f04-67bb-47d9-b916-9fbb5da8fb38 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:04.736618 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e372f04-67bb-47d9-b916-9fbb5da8fb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:04.755293 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-1e372f04-67bb-47d9-b916-9fbb5da8fb38 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:04.756542 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1e372f04-67bb-47d9-b916-9fbb5da8fb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:04.815841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 464/932] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:04.840476 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563efe34-831f-4152-a61d-cabe940ef01c None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:04.852900 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563efe34-831f-4152-a61d-cabe940ef01c None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:04.857362 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cda6bb-3cd6-4269-a868-341c9c4cc5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:04.858974 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cda6bb-3cd6-4269-a868-341c9c4cc5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:04.859258 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cda6bb-3cd6-4269-a868-341c9c4cc5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:04.859609 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cda6bb-3cd6-4269-a868-341c9c4cc5c5 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:04.871291 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cda6bb-3cd6-4269-a868-341c9c4cc5c5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:53:04.879220 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-89cda6bb-3cd6-4269-a868-341c9c4cc5c5 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 02:53:04.883525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 469/933] 10.222.0.39 () {56 vars in 1142 bytes} [Tue Aug 31 02:53:04 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:04.887107 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e372f04-67bb-47d9-b916-9fbb5da8fb38 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:04.896881 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e372f04-67bb-47d9-b916-9fbb5da8fb38 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:04.901467 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e43eda-a2dc-4a28-8e31-63cf8cad2f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:04.902128 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e43eda-a2dc-4a28-8e31-63cf8cad2f5f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:04.902412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e43eda-a2dc-4a28-8e31-63cf8cad2f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:04.902687 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e43eda-a2dc-4a28-8e31-63cf8cad2f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:04.903468 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e43eda-a2dc-4a28-8e31-63cf8cad2f5f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:04.903779 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e43eda-a2dc-4a28-8e31-63cf8cad2f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:04.906042 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e43eda-a2dc-4a28-8e31-63cf8cad2f5f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:04.914387 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 465/934] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Aug 31 02:53:04 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:53:04.920908 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cda6bb-3cd6-4269-a868-341c9c4cc5c5 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:04.930582 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cda6bb-3cd6-4269-a868-341c9c4cc5c5 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:04.935208 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cf546-12c7-4d99-a4fc-f7a0dce9fafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:04.936047 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cf546-12c7-4d99-a4fc-f7a0dce9fafb admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:04.936330 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cf546-12c7-4d99-a4fc-f7a0dce9fafb admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:04.936608 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cf546-12c7-4d99-a4fc-f7a0dce9fafb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:04.946663 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cf546-12c7-4d99-a4fc-f7a0dce9fafb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:04.948543 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cf546-12c7-4d99-a4fc-f7a0dce9fafb admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:04.966922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-344cf546-12c7-4d99-a4fc-f7a0dce9fafb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:53:04.968824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 470/935] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:53:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:04.974939 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e43eda-a2dc-4a28-8e31-63cf8cad2f5f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:04.984789 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e43eda-a2dc-4a28-8e31-63cf8cad2f5f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:04.989225 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb884c9-7171-40e5-b876-0bb645bdf6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:04.989940 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb884c9-7171-40e5-b876-0bb645bdf6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:04.990238 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb884c9-7171-40e5-b876-0bb645bdf6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:04.990516 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb884c9-7171-40e5-b876-0bb645bdf6b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:04.991233 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb884c9-7171-40e5-b876-0bb645bdf6b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:04.991590 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb884c9-7171-40e5-b876-0bb645bdf6b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:04.993179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb884c9-7171-40e5-b876-0bb645bdf6b8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:05.006263 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 466/936] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:53:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:05.012310 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cf546-12c7-4d99-a4fc-f7a0dce9fafb admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:05.022067 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cf546-12c7-4d99-a4fc-f7a0dce9fafb admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:05.026727 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b00391-0541-491b-92a6-22e809f97e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:05.027639 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b00391-0541-491b-92a6-22e809f97e7e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:05.027921 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b00391-0541-491b-92a6-22e809f97e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:05.028191 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b00391-0541-491b-92a6-22e809f97e7e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:05.036281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b00391-0541-491b-92a6-22e809f97e7e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:05.038277 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b00391-0541-491b-92a6-22e809f97e7e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:05.052682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-00b00391-0541-491b-92a6-22e809f97e7e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 02:53:05.055462 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 471/937] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Aug 31 02:53:05 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:53:05.060494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb884c9-7171-40e5-b876-0bb645bdf6b8 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:05.070311 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb884c9-7171-40e5-b876-0bb645bdf6b8 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:05.074930 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d5a5f-9bc0-4195-9967-1fcb2cc9c52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:05.075707 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d5a5f-9bc0-4195-9967-1fcb2cc9c52a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:05.076085 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d5a5f-9bc0-4195-9967-1fcb2cc9c52a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:05.076484 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d5a5f-9bc0-4195-9967-1fcb2cc9c52a admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:05.077588 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d5a5f-9bc0-4195-9967-1fcb2cc9c52a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:05.077968 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d5a5f-9bc0-4195-9967-1fcb2cc9c52a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:05.079932 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d5a5f-9bc0-4195-9967-1fcb2cc9c52a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:05.097807 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 467/938] 10.222.0.39 () {56 vars in 1155 bytes} [Tue Aug 31 02:53:05 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:05.104185 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b00391-0541-491b-92a6-22e809f97e7e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:05.115389 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b00391-0541-491b-92a6-22e809f97e7e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:05.120128 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f467aa-2890-48fd-99b1-1e7718b359ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:05.120727 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f467aa-2890-48fd-99b1-1e7718b359ba admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:05.121009 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f467aa-2890-48fd-99b1-1e7718b359ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:05.121281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f467aa-2890-48fd-99b1-1e7718b359ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:05.129558 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f467aa-2890-48fd-99b1-1e7718b359ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:05.131302 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f467aa-2890-48fd-99b1-1e7718b359ba admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:05.141271 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 472/939] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:53:05 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:53:05.147610 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d5a5f-9bc0-4195-9967-1fcb2cc9c52a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:05.157937 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d5a5f-9bc0-4195-9967-1fcb2cc9c52a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:05.162401 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247adcf6-9194-42dc-b9e1-133ae1086573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:05.163186 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247adcf6-9194-42dc-b9e1-133ae1086573 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:05.163499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247adcf6-9194-42dc-b9e1-133ae1086573 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:05.163772 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247adcf6-9194-42dc-b9e1-133ae1086573 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:05.173966 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247adcf6-9194-42dc-b9e1-133ae1086573 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:05.175820 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247adcf6-9194-42dc-b9e1-133ae1086573 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:05.192444 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-247adcf6-9194-42dc-b9e1-133ae1086573 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:53:05.193836 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 468/940] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:53:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:05.199900 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f467aa-2890-48fd-99b1-1e7718b359ba admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:05.209757 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f467aa-2890-48fd-99b1-1e7718b359ba admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:05.214399 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d50bd4-583b-4613-aed0-f5285751c508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:05.215116 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d50bd4-583b-4613-aed0-f5285751c508 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:05.215497 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d50bd4-583b-4613-aed0-f5285751c508 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:05.215841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d50bd4-583b-4613-aed0-f5285751c508 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:05.216623 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d50bd4-583b-4613-aed0-f5285751c508 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:05.217066 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d50bd4-583b-4613-aed0-f5285751c508 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:05.219785 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d50bd4-583b-4613-aed0-f5285751c508 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:05.238340 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 473/941] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:53:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:05.239609 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247adcf6-9194-42dc-b9e1-133ae1086573 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:05.250087 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247adcf6-9194-42dc-b9e1-133ae1086573 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:05.254489 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653701b-da5a-4849-8037-9c0aae703906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:05.255271 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653701b-da5a-4849-8037-9c0aae703906 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:05.255584 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653701b-da5a-4849-8037-9c0aae703906 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:05.255856 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653701b-da5a-4849-8037-9c0aae703906 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:05.263000 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653701b-da5a-4849-8037-9c0aae703906 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:05.265808 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653701b-da5a-4849-8037-9c0aae703906 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:05.280295 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-5653701b-da5a-4849-8037-9c0aae703906 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:53:05.286745 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 469/942] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:53:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:05.288279 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d50bd4-583b-4613-aed0-f5285751c508 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:05.298009 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d50bd4-583b-4613-aed0-f5285751c508 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:05.302546 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a8f23-952f-4e6e-91b0-cff53fe022b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:05.303264 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a8f23-952f-4e6e-91b0-cff53fe022b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:05.303640 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a8f23-952f-4e6e-91b0-cff53fe022b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:05.303987 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a8f23-952f-4e6e-91b0-cff53fe022b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:05.304829 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a8f23-952f-4e6e-91b0-cff53fe022b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:05.305202 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a8f23-952f-4e6e-91b0-cff53fe022b2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:05.307249 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a8f23-952f-4e6e-91b0-cff53fe022b2 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:05.323700 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 474/943] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:53:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:05.327325 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653701b-da5a-4849-8037-9c0aae703906 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:05.337965 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653701b-da5a-4849-8037-9c0aae703906 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:05.342505 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923625a-6d95-4554-ab97-2901f501314d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:05.343211 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923625a-6d95-4554-ab97-2901f501314d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:05.343587 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923625a-6d95-4554-ab97-2901f501314d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:05.343928 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923625a-6d95-4554-ab97-2901f501314d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:05.344754 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923625a-6d95-4554-ab97-2901f501314d admin admin] RBAC: Adding query filter params (role.id=0c932d1474bf47918c81da6c0fa7c7ff, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=a6bb852fc4394f88800ec9616cb65416) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:05.345068 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923625a-6d95-4554-ab97-2901f501314d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:05.346911 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923625a-6d95-4554-ab97-2901f501314d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:05.352615 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 470/944] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:53:05 2021] GET /identity/v3/role_assignments?user.id=a6bb852fc4394f88800ec9616cb65416&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=0c932d1474bf47918c81da6c0fa7c7ff => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:05.874830 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce9546-9988-40bd-9fae-c6f32583cb56 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:05.875343 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce9546-9988-40bd-9fae-c6f32583cb56 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:05.875343 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce9546-9988-40bd-9fae-c6f32583cb56 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:05.877190 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 475/945] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:05.882902 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846affc-8bb5-4171-a36b-8adee16fd51e None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:05.883274 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846affc-8bb5-4171-a36b-8adee16fd51e None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:05.883499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846affc-8bb5-4171-a36b-8adee16fd51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:05.901837 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-3846affc-8bb5-4171-a36b-8adee16fd51e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:05.903021 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-3846affc-8bb5-4171-a36b-8adee16fd51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:05.910886 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 471/946] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:05 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:05.934113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce9546-9988-40bd-9fae-c6f32583cb56 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:05.946627 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce9546-9988-40bd-9fae-c6f32583cb56 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:05.950967 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8865eb-487b-4fec-9064-624a89b2102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:05.952239 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8865eb-487b-4fec-9064-624a89b2102b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:05.952521 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8865eb-487b-4fec-9064-624a89b2102b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:05.952798 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8865eb-487b-4fec-9064-624a89b2102b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:05.960387 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8865eb-487b-4fec-9064-624a89b2102b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:05.962128 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8865eb-487b-4fec-9064-624a89b2102b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:05.971042 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 476/947] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:53:05 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 02:53:05.977137 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846affc-8bb5-4171-a36b-8adee16fd51e None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:05.986107 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846affc-8bb5-4171-a36b-8adee16fd51e None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:05.990716 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1aa882-ba6a-40d5-b41f-a8360fafdbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:05.991529 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1aa882-ba6a-40d5-b41f-a8360fafdbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:05.991819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1aa882-ba6a-40d5-b41f-a8360fafdbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:05.992094 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1aa882-ba6a-40d5-b41f-a8360fafdbe6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:05.993264 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1aa882-ba6a-40d5-b41f-a8360fafdbe6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:05.995046 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1aa882-ba6a-40d5-b41f-a8360fafdbe6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:05.997111 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 472/948] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:53:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:06.161204 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae909e-f6f2-4834-9809-7a86eff7496b None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:06.161481 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae909e-f6f2-4834-9809-7a86eff7496b None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:06.161685 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae909e-f6f2-4834-9809-7a86eff7496b None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:06.167398 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 477/949] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:06.169672 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f810e50-54de-4822-b73c-4156d1831015 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:06.169940 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f810e50-54de-4822-b73c-4156d1831015 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:06.170935 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f810e50-54de-4822-b73c-4156d1831015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:06.190164 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-7f810e50-54de-4822-b73c-4156d1831015 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:06.191377 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-7f810e50-54de-4822-b73c-4156d1831015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:06.200004 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 473/950] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:06 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:06.226360 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae909e-f6f2-4834-9809-7a86eff7496b None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:06.239337 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae909e-f6f2-4834-9809-7a86eff7496b None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:06.243811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab820d48-e904-46b7-829b-97fba77bf0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:06.244603 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab820d48-e904-46b7-829b-97fba77bf0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:06.244886 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab820d48-e904-46b7-829b-97fba77bf0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:06.245154 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab820d48-e904-46b7-829b-97fba77bf0f7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:06.246380 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab820d48-e904-46b7-829b-97fba77bf0f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:06.248970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab820d48-e904-46b7-829b-97fba77bf0f7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:06.250783 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 478/951] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:53:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:06.257141 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f810e50-54de-4822-b73c-4156d1831015 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:06.266648 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f810e50-54de-4822-b73c-4156d1831015 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:06.272878 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9fd48-827c-4092-8a5e-48fcf70525b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:06.273876 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9fd48-827c-4092-8a5e-48fcf70525b8 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:06.274162 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9fd48-827c-4092-8a5e-48fcf70525b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:06.274440 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9fd48-827c-4092-8a5e-48fcf70525b8 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:06.275152 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9fd48-827c-4092-8a5e-48fcf70525b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:06.277143 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9fd48-827c-4092-8a5e-48fcf70525b8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:06.298058 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 474/952] 10.222.0.39 () {60 vars in 1154 bytes} [Tue Aug 31 02:53:06 2021] POST /identity/v3/users => generated 285 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:53:07.521989 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b5adb-54a5-4fa0-82c9-b1033cb066bd None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:07.522511 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b5adb-54a5-4fa0-82c9-b1033cb066bd None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:07.522511 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b5adb-54a5-4fa0-82c9-b1033cb066bd None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:07.524319 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 479/953] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:07.530241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00aad5c-5cef-4333-aac3-9ec5fc3a43d0 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:07.530663 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00aad5c-5cef-4333-aac3-9ec5fc3a43d0 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:07.530831 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00aad5c-5cef-4333-aac3-9ec5fc3a43d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:07.548070 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-b00aad5c-5cef-4333-aac3-9ec5fc3a43d0 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:07.549252 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b00aad5c-5cef-4333-aac3-9ec5fc3a43d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:07.556888 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 475/954] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:07 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:07.582443 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b5adb-54a5-4fa0-82c9-b1033cb066bd None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:07.595105 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b5adb-54a5-4fa0-82c9-b1033cb066bd None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:07.599563 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddecf50-7405-478e-bdb6-4f76ef774902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:07.600362 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddecf50-7405-478e-bdb6-4f76ef774902 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:07.600648 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddecf50-7405-478e-bdb6-4f76ef774902 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:07.600920 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddecf50-7405-478e-bdb6-4f76ef774902 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:07.611715 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddecf50-7405-478e-bdb6-4f76ef774902 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:53:07.618966 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-bddecf50-7405-478e-bdb6-4f76ef774902 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 02:53:07.620311 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 480/955] 10.222.0.39 () {56 vars in 1142 bytes} [Tue Aug 31 02:53:07 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:07.627867 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00aad5c-5cef-4333-aac3-9ec5fc3a43d0 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:07.636749 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00aad5c-5cef-4333-aac3-9ec5fc3a43d0 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:07.641438 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e124c-ca26-41fb-b754-88da3b011682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:07.642086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e124c-ca26-41fb-b754-88da3b011682 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:07.642367 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e124c-ca26-41fb-b754-88da3b011682 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:07.642640 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e124c-ca26-41fb-b754-88da3b011682 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:07.643397 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e124c-ca26-41fb-b754-88da3b011682 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:07.643705 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e124c-ca26-41fb-b754-88da3b011682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:07.645286 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e124c-ca26-41fb-b754-88da3b011682 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:07.653031 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 476/956] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Aug 31 02:53:07 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:07.659060 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddecf50-7405-478e-bdb6-4f76ef774902 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:07.668883 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddecf50-7405-478e-bdb6-4f76ef774902 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:07.673978 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b395c88-0cdc-4508-a051-6fdbdd30028c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:07.674734 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b395c88-0cdc-4508-a051-6fdbdd30028c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:07.675008 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b395c88-0cdc-4508-a051-6fdbdd30028c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:07.675277 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b395c88-0cdc-4508-a051-6fdbdd30028c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:07.685128 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b395c88-0cdc-4508-a051-6fdbdd30028c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:07.687518 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b395c88-0cdc-4508-a051-6fdbdd30028c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:07.703452 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-2b395c88-0cdc-4508-a051-6fdbdd30028c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:53:07.704591 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 481/957] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:53:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:53:07.710932 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e124c-ca26-41fb-b754-88da3b011682 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:07.720471 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e124c-ca26-41fb-b754-88da3b011682 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:07.724907 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdeea69-3e77-4277-92e9-40155d3c9de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:07.725548 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdeea69-3e77-4277-92e9-40155d3c9de2 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:07.725832 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdeea69-3e77-4277-92e9-40155d3c9de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:07.726109 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdeea69-3e77-4277-92e9-40155d3c9de2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:07.726824 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdeea69-3e77-4277-92e9-40155d3c9de2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:07.727130 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdeea69-3e77-4277-92e9-40155d3c9de2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:07.728733 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdeea69-3e77-4277-92e9-40155d3c9de2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:07.741369 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 477/958] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:53:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:07.747681 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b395c88-0cdc-4508-a051-6fdbdd30028c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:07.757287 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b395c88-0cdc-4508-a051-6fdbdd30028c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:07.761815 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ebec9-ae9c-48a5-ba5a-9f96831409fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:07.762585 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ebec9-ae9c-48a5-ba5a-9f96831409fb admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:07.762871 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ebec9-ae9c-48a5-ba5a-9f96831409fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:07.763275 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ebec9-ae9c-48a5-ba5a-9f96831409fb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:07.770891 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ebec9-ae9c-48a5-ba5a-9f96831409fb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:07.772976 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ebec9-ae9c-48a5-ba5a-9f96831409fb admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:07.786726 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-933ebec9-ae9c-48a5-ba5a-9f96831409fb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 02:53:07.787879 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 482/959] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Aug 31 02:53:07 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:53:07.794172 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdeea69-3e77-4277-92e9-40155d3c9de2 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:07.803857 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdeea69-3e77-4277-92e9-40155d3c9de2 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:07.808283 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d13617-5316-4bfd-8a64-346ad016e228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:07.808929 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d13617-5316-4bfd-8a64-346ad016e228 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:07.809204 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d13617-5316-4bfd-8a64-346ad016e228 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:07.809472 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d13617-5316-4bfd-8a64-346ad016e228 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:07.810287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d13617-5316-4bfd-8a64-346ad016e228 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:07.810628 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d13617-5316-4bfd-8a64-346ad016e228 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:07.812571 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d13617-5316-4bfd-8a64-346ad016e228 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:07.829899 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 478/960] 10.222.0.39 () {56 vars in 1155 bytes} [Tue Aug 31 02:53:07 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:07.836438 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ebec9-ae9c-48a5-ba5a-9f96831409fb admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:07.846764 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ebec9-ae9c-48a5-ba5a-9f96831409fb admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:07.851347 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab39416-057e-42da-b301-2330825024f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:07.852140 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab39416-057e-42da-b301-2330825024f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:07.852417 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab39416-057e-42da-b301-2330825024f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:07.852686 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab39416-057e-42da-b301-2330825024f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:07.862603 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab39416-057e-42da-b301-2330825024f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:07.864474 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab39416-057e-42da-b301-2330825024f5 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:07.880808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-2ab39416-057e-42da-b301-2330825024f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:53:07.881948 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 483/961] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:53:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:07.888147 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d13617-5316-4bfd-8a64-346ad016e228 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:07.898182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d13617-5316-4bfd-8a64-346ad016e228 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:07.902621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e250ad9-f027-49c5-8e4f-c70983ca8075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:07.903266 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e250ad9-f027-49c5-8e4f-c70983ca8075 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:07.903575 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e250ad9-f027-49c5-8e4f-c70983ca8075 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:07.903851 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e250ad9-f027-49c5-8e4f-c70983ca8075 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:07.905104 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e250ad9-f027-49c5-8e4f-c70983ca8075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:07.905405 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e250ad9-f027-49c5-8e4f-c70983ca8075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:07.907133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e250ad9-f027-49c5-8e4f-c70983ca8075 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:07.918144 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 479/962] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:53:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:07.924631 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab39416-057e-42da-b301-2330825024f5 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:07.934258 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab39416-057e-42da-b301-2330825024f5 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:07.939798 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8c874-ec8c-4c30-9bfb-58b7e3f93490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:07.940578 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8c874-ec8c-4c30-9bfb-58b7e3f93490 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:07.940863 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8c874-ec8c-4c30-9bfb-58b7e3f93490 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:07.941137 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8c874-ec8c-4c30-9bfb-58b7e3f93490 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:07.947840 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8c874-ec8c-4c30-9bfb-58b7e3f93490 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:07.949783 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8c874-ec8c-4c30-9bfb-58b7e3f93490 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:07.963535 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-33e8c874-ec8c-4c30-9bfb-58b7e3f93490 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:53:07.964686 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 484/963] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:53:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:07.971797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e250ad9-f027-49c5-8e4f-c70983ca8075 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:07.981229 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e250ad9-f027-49c5-8e4f-c70983ca8075 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:07.986424 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f295662-f4f3-4609-bbba-1e7797f24b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:07.987088 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f295662-f4f3-4609-bbba-1e7797f24b70 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:07.987385 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f295662-f4f3-4609-bbba-1e7797f24b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:07.987678 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f295662-f4f3-4609-bbba-1e7797f24b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:07.988452 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f295662-f4f3-4609-bbba-1e7797f24b70 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:07.988760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f295662-f4f3-4609-bbba-1e7797f24b70 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:07.990578 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f295662-f4f3-4609-bbba-1e7797f24b70 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:08.008041 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 480/964] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:53:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:08.009187 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8c874-ec8c-4c30-9bfb-58b7e3f93490 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:08.019606 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8c874-ec8c-4c30-9bfb-58b7e3f93490 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:08.024053 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c60488-86f4-419f-9008-36c9b826d7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:08.024854 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c60488-86f4-419f-9008-36c9b826d7b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:08.025127 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c60488-86f4-419f-9008-36c9b826d7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:08.025393 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c60488-86f4-419f-9008-36c9b826d7b1 admin admin] PATH_INFO: `/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/a6bb852fc4394f88800ec9616cb65416/roles/0c932d1474bf47918c81da6c0fa7c7ff` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:08.027573 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c60488-86f4-419f-9008-36c9b826d7b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011ec8d2410644a3b7d51a90f803b441, user_id=a6bb852fc4394f88800ec9616cb65416, role_id=0c932d1474bf47918c81da6c0fa7c7ff)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:08.031104 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c60488-86f4-419f-9008-36c9b826d7b1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:08.043725 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 485/965] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:53:08 2021] PUT /identity/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/a6bb852fc4394f88800ec9616cb65416/roles/0c932d1474bf47918c81da6c0fa7c7ff => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:53:08.497258 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae0181-d521-421d-bce7-1d9d96d942a6 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:08.497452 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae0181-d521-421d-bce7-1d9d96d942a6 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:08.497978 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae0181-d521-421d-bce7-1d9d96d942a6 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:08.499788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 481/966] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:08.505765 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a808f-a737-4cf0-8309-199dcd2a460e None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:08.506054 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a808f-a737-4cf0-8309-199dcd2a460e None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:08.506333 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a808f-a737-4cf0-8309-199dcd2a460e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:08.523970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-8f2a808f-a737-4cf0-8309-199dcd2a460e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:08.525149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-8f2a808f-a737-4cf0-8309-199dcd2a460e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:08.580086 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 486/967] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:08 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:08.604747 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae0181-d521-421d-bce7-1d9d96d942a6 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:08.617406 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae0181-d521-421d-bce7-1d9d96d942a6 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:08.621991 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac548e5-4a9f-4da3-97db-e3b7d81a1553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:08.622770 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac548e5-4a9f-4da3-97db-e3b7d81a1553 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:08.623055 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac548e5-4a9f-4da3-97db-e3b7d81a1553 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:08.624231 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac548e5-4a9f-4da3-97db-e3b7d81a1553 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:08.633806 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac548e5-4a9f-4da3-97db-e3b7d81a1553 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:53:08.640615 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-eac548e5-4a9f-4da3-97db-e3b7d81a1553 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:53:08.641757 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 482/968] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:53:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:08.648355 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a808f-a737-4cf0-8309-199dcd2a460e None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:08.657251 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a808f-a737-4cf0-8309-199dcd2a460e None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:08.661700 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4acb7-4a29-4a4a-8523-a4282506256c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:08.662349 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4acb7-4a29-4a4a-8523-a4282506256c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:08.662633 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4acb7-4a29-4a4a-8523-a4282506256c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:08.662910 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4acb7-4a29-4a4a-8523-a4282506256c admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:08.663684 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4acb7-4a29-4a4a-8523-a4282506256c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:08.663991 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4acb7-4a29-4a4a-8523-a4282506256c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:08.665607 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4acb7-4a29-4a4a-8523-a4282506256c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:08.674325 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 487/969] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:53:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:08.680366 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac548e5-4a9f-4da3-97db-e3b7d81a1553 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:08.690923 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac548e5-4a9f-4da3-97db-e3b7d81a1553 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:08.695323 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24724871-6cbf-4cb1-a940-a883f386036a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:08.696191 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24724871-6cbf-4cb1-a940-a883f386036a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:08.696467 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24724871-6cbf-4cb1-a940-a883f386036a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:08.696732 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24724871-6cbf-4cb1-a940-a883f386036a admin admin] PATH_INFO: `/v3/users/68496879e3b943729b33ca968765ff64` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:08.709673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24724871-6cbf-4cb1-a940-a883f386036a admin admin] RBAC: Authorizing `identity:get_user(user_id=68496879e3b943729b33ca968765ff64)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:08.711827 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24724871-6cbf-4cb1-a940-a883f386036a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:08.713468 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 483/970] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:53:08 2021] GET /identity/v3/users/68496879e3b943729b33ca968765ff64 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:53:08.720735 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4acb7-4a29-4a4a-8523-a4282506256c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:08.730218 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4acb7-4a29-4a4a-8523-a4282506256c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:08.735309 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aae63d-849b-4ec8-adb5-f55598ea99e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:08.735970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aae63d-849b-4ec8-adb5-f55598ea99e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:08.736255 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aae63d-849b-4ec8-adb5-f55598ea99e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:08.736528 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aae63d-849b-4ec8-adb5-f55598ea99e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:08.744194 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aae63d-849b-4ec8-adb5-f55598ea99e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:08.745936 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aae63d-849b-4ec8-adb5-f55598ea99e6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:08.754881 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 488/971] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:53:08 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:53:08.761397 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24724871-6cbf-4cb1-a940-a883f386036a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:08.770928 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24724871-6cbf-4cb1-a940-a883f386036a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:08.775410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c39484-162a-467d-bdd8-fe438e5c6733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:08.776317 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c39484-162a-467d-bdd8-fe438e5c6733 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:08.776683 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c39484-162a-467d-bdd8-fe438e5c6733 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:08.777022 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c39484-162a-467d-bdd8-fe438e5c6733 admin admin] PATH_INFO: `/v3/projects/16281534bfb145deb85ccb6f132e26eb` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:08.778224 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c39484-162a-467d-bdd8-fe438e5c6733 admin admin] RBAC: Authorizing `identity:get_project(project_id=16281534bfb145deb85ccb6f132e26eb)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:08.780838 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c39484-162a-467d-bdd8-fe438e5c6733 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:08.782610 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 484/972] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:53:08 2021] GET /identity/v3/projects/16281534bfb145deb85ccb6f132e26eb => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:53:08.788883 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aae63d-849b-4ec8-adb5-f55598ea99e6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:08.797758 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aae63d-849b-4ec8-adb5-f55598ea99e6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:08.802262 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4c454-a0fc-44c2-a9d6-2a3105f12efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:08.802897 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4c454-a0fc-44c2-a9d6-2a3105f12efe admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:08.803180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4c454-a0fc-44c2-a9d6-2a3105f12efe admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:08.803493 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4c454-a0fc-44c2-a9d6-2a3105f12efe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:08.804307 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4c454-a0fc-44c2-a9d6-2a3105f12efe admin admin] RBAC: Adding query filter params (role.id=99835eeda2f64af5bc9173a8370d4568, scope.project.id=16281534bfb145deb85ccb6f132e26eb, user.id=68496879e3b943729b33ca968765ff64) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:08.804616 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4c454-a0fc-44c2-a9d6-2a3105f12efe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:08.806481 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4c454-a0fc-44c2-a9d6-2a3105f12efe admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:08.812766 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 489/973] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:53:08 2021] GET /identity/v3/role_assignments?user.id=68496879e3b943729b33ca968765ff64&scope.project.id=16281534bfb145deb85ccb6f132e26eb&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:10.204009 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c1786-9c42-4520-8b5b-90d981d03fd2 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:10.204530 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c1786-9c42-4520-8b5b-90d981d03fd2 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:10.204622 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c1786-9c42-4520-8b5b-90d981d03fd2 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:10.206331 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 485/974] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:10.212135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233cdee-00c9-4f5e-938a-b8699558e114 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:10.212538 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233cdee-00c9-4f5e-938a-b8699558e114 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:10.212699 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233cdee-00c9-4f5e-938a-b8699558e114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:10.230452 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-9233cdee-00c9-4f5e-938a-b8699558e114 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:10.231656 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-9233cdee-00c9-4f5e-938a-b8699558e114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:10.239961 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 490/975] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:10 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:10.265097 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c1786-9c42-4520-8b5b-90d981d03fd2 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:10.276994 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c1786-9c42-4520-8b5b-90d981d03fd2 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:10.281832 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427da6b-b51f-4ddd-803a-2d85e47dd6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:10.282621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427da6b-b51f-4ddd-803a-2d85e47dd6ef admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:10.282904 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427da6b-b51f-4ddd-803a-2d85e47dd6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:10.283179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427da6b-b51f-4ddd-803a-2d85e47dd6ef admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:10.293050 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427da6b-b51f-4ddd-803a-2d85e47dd6ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:53:10.300812 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-a427da6b-b51f-4ddd-803a-2d85e47dd6ef admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 02:53:10.302118 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 486/976] 10.222.0.39 () {56 vars in 1142 bytes} [Tue Aug 31 02:53:10 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:10.308557 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233cdee-00c9-4f5e-938a-b8699558e114 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:10.317648 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233cdee-00c9-4f5e-938a-b8699558e114 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:10.322102 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e29339-62ff-42e1-8ee2-c521ad4b8265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:10.322751 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e29339-62ff-42e1-8ee2-c521ad4b8265 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:10.323027 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e29339-62ff-42e1-8ee2-c521ad4b8265 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:10.323296 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e29339-62ff-42e1-8ee2-c521ad4b8265 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:10.324055 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e29339-62ff-42e1-8ee2-c521ad4b8265 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:10.324353 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e29339-62ff-42e1-8ee2-c521ad4b8265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:10.325925 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e29339-62ff-42e1-8ee2-c521ad4b8265 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:10.334327 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 491/977] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Aug 31 02:53:10 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:10.340733 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427da6b-b51f-4ddd-803a-2d85e47dd6ef admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:10.351474 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427da6b-b51f-4ddd-803a-2d85e47dd6ef admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:10.355924 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2cb3b-af16-4fbc-b80d-fb7cc3951d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:10.356699 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2cb3b-af16-4fbc-b80d-fb7cc3951d88 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:10.356979 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2cb3b-af16-4fbc-b80d-fb7cc3951d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:10.357249 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2cb3b-af16-4fbc-b80d-fb7cc3951d88 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:10.368218 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2cb3b-af16-4fbc-b80d-fb7cc3951d88 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:10.370050 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2cb3b-af16-4fbc-b80d-fb7cc3951d88 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:10.386490 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-4ec2cb3b-af16-4fbc-b80d-fb7cc3951d88 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:53:10.387612 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 487/978] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:53:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:53:10.394570 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e29339-62ff-42e1-8ee2-c521ad4b8265 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:10.404032 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e29339-62ff-42e1-8ee2-c521ad4b8265 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:10.409081 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa006fa-3589-4e28-8422-0314188b4690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:10.409726 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa006fa-3589-4e28-8422-0314188b4690 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:10.410009 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa006fa-3589-4e28-8422-0314188b4690 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:10.410285 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa006fa-3589-4e28-8422-0314188b4690 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:10.410991 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa006fa-3589-4e28-8422-0314188b4690 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:10.411294 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa006fa-3589-4e28-8422-0314188b4690 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:10.412899 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa006fa-3589-4e28-8422-0314188b4690 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:10.424758 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 492/979] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:53:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:10.431283 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2cb3b-af16-4fbc-b80d-fb7cc3951d88 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:10.441989 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2cb3b-af16-4fbc-b80d-fb7cc3951d88 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:10.447539 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e909bab-31cc-41fa-8e58-8182f0ec47f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:10.448328 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e909bab-31cc-41fa-8e58-8182f0ec47f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:10.448609 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e909bab-31cc-41fa-8e58-8182f0ec47f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:10.448880 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e909bab-31cc-41fa-8e58-8182f0ec47f2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:10.456465 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e909bab-31cc-41fa-8e58-8182f0ec47f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:10.458468 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e909bab-31cc-41fa-8e58-8182f0ec47f2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:10.472251 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-5e909bab-31cc-41fa-8e58-8182f0ec47f2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 02:53:10.473398 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 488/980] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Aug 31 02:53:10 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:10.479819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa006fa-3589-4e28-8422-0314188b4690 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:10.490358 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa006fa-3589-4e28-8422-0314188b4690 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:10.494834 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65774a-a91e-40de-84c2-c8962715c835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:10.495510 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65774a-a91e-40de-84c2-c8962715c835 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:10.495790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65774a-a91e-40de-84c2-c8962715c835 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:10.496060 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65774a-a91e-40de-84c2-c8962715c835 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:10.497133 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65774a-a91e-40de-84c2-c8962715c835 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:10.497434 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65774a-a91e-40de-84c2-c8962715c835 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:10.499554 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65774a-a91e-40de-84c2-c8962715c835 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:10.517341 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 493/981] 10.222.0.39 () {56 vars in 1155 bytes} [Tue Aug 31 02:53:10 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:10.523537 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e909bab-31cc-41fa-8e58-8182f0ec47f2 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:10.533977 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e909bab-31cc-41fa-8e58-8182f0ec47f2 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:10.538430 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476badce-84f6-4317-9475-b47c2f12feaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:10.539059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476badce-84f6-4317-9475-b47c2f12feaa admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:10.539342 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476badce-84f6-4317-9475-b47c2f12feaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:10.539648 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476badce-84f6-4317-9475-b47c2f12feaa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:10.547995 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476badce-84f6-4317-9475-b47c2f12feaa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:10.549722 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476badce-84f6-4317-9475-b47c2f12feaa admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:10.558358 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 489/982] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:53:10 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:53:10.564716 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65774a-a91e-40de-84c2-c8962715c835 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:10.574259 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65774a-a91e-40de-84c2-c8962715c835 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:10.579247 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d6e62-cc5c-412f-b1e3-3fe623515a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:10.580059 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d6e62-cc5c-412f-b1e3-3fe623515a75 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:10.580338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d6e62-cc5c-412f-b1e3-3fe623515a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:10.580610 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d6e62-cc5c-412f-b1e3-3fe623515a75 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:10.590874 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d6e62-cc5c-412f-b1e3-3fe623515a75 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:10.593464 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d6e62-cc5c-412f-b1e3-3fe623515a75 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:10.610010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-9d2d6e62-cc5c-412f-b1e3-3fe623515a75 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:53:10.611164 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 494/983] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:53:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:10.621861 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476badce-84f6-4317-9475-b47c2f12feaa admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:10.630703 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476badce-84f6-4317-9475-b47c2f12feaa admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:10.635207 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab4e59-0324-4dcf-a2f5-e85bb67c38bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:10.635879 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab4e59-0324-4dcf-a2f5-e85bb67c38bf admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:10.636164 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab4e59-0324-4dcf-a2f5-e85bb67c38bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:10.636440 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab4e59-0324-4dcf-a2f5-e85bb67c38bf admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:10.637198 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab4e59-0324-4dcf-a2f5-e85bb67c38bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:10.637456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab4e59-0324-4dcf-a2f5-e85bb67c38bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:10.639592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab4e59-0324-4dcf-a2f5-e85bb67c38bf admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:10.650457 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 490/984] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:53:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:10.656772 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d6e62-cc5c-412f-b1e3-3fe623515a75 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:10.666314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d6e62-cc5c-412f-b1e3-3fe623515a75 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:10.671415 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f52c08-c680-4c12-8ab1-d2c7f9fcb33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:10.672356 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f52c08-c680-4c12-8ab1-d2c7f9fcb33d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:10.672643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f52c08-c680-4c12-8ab1-d2c7f9fcb33d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:10.672916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f52c08-c680-4c12-8ab1-d2c7f9fcb33d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:10.679555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f52c08-c680-4c12-8ab1-d2c7f9fcb33d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:10.681497 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f52c08-c680-4c12-8ab1-d2c7f9fcb33d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:10.694934 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-05f52c08-c680-4c12-8ab1-d2c7f9fcb33d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:53:10.696100 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 495/985] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:53:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:10.702447 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab4e59-0324-4dcf-a2f5-e85bb67c38bf admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:10.711979 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab4e59-0324-4dcf-a2f5-e85bb67c38bf admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:10.716454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648173a-0820-4259-b2ca-ed58d40bee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:10.717204 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648173a-0820-4259-b2ca-ed58d40bee0d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:10.717482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648173a-0820-4259-b2ca-ed58d40bee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:10.717774 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648173a-0820-4259-b2ca-ed58d40bee0d admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:10.718552 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648173a-0820-4259-b2ca-ed58d40bee0d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:10.718969 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648173a-0820-4259-b2ca-ed58d40bee0d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:10.720969 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648173a-0820-4259-b2ca-ed58d40bee0d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:10.733845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 491/986] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:53:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:10.740609 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f52c08-c680-4c12-8ab1-d2c7f9fcb33d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:10.751847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f52c08-c680-4c12-8ab1-d2c7f9fcb33d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:10.756338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4be222-ac1f-4c37-83aa-6a7534735c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:10.756970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4be222-ac1f-4c37-83aa-6a7534735c95 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:10.757251 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4be222-ac1f-4c37-83aa-6a7534735c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:10.757526 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4be222-ac1f-4c37-83aa-6a7534735c95 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:10.758342 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4be222-ac1f-4c37-83aa-6a7534735c95 admin admin] RBAC: Adding query filter params (role.id=0c932d1474bf47918c81da6c0fa7c7ff, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=a6bb852fc4394f88800ec9616cb65416) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:10.758656 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4be222-ac1f-4c37-83aa-6a7534735c95 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:10.760539 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4be222-ac1f-4c37-83aa-6a7534735c95 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:10.766311 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 496/987] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:53:10 2021] GET /identity/v3/role_assignments?user.id=a6bb852fc4394f88800ec9616cb65416&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=0c932d1474bf47918c81da6c0fa7c7ff => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:10.922602 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a716c69-9162-4fe3-bdf5-e8f813082ef6 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:10.922795 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a716c69-9162-4fe3-bdf5-e8f813082ef6 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:10.923067 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a716c69-9162-4fe3-bdf5-e8f813082ef6 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:10.924873 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 492/988] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:10.930893 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed366c86-c13e-49c2-b053-2f44d655c85c None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:10.931177 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed366c86-c13e-49c2-b053-2f44d655c85c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:10.931477 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed366c86-c13e-49c2-b053-2f44d655c85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:10.949649 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-ed366c86-c13e-49c2-b053-2f44d655c85c None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:10.950852 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ed366c86-c13e-49c2-b053-2f44d655c85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:10.958829 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 497/989] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:10 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:10.984264 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a716c69-9162-4fe3-bdf5-e8f813082ef6 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:10.996528 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a716c69-9162-4fe3-bdf5-e8f813082ef6 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:11.001532 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd4249-5ec7-488f-bda7-e87d6db62cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:11.002385 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd4249-5ec7-488f-bda7-e87d6db62cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:11.002664 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd4249-5ec7-488f-bda7-e87d6db62cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:11.002928 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd4249-5ec7-488f-bda7-e87d6db62cd2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:11.013007 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd4249-5ec7-488f-bda7-e87d6db62cd2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:53:11.020120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-d7fd4249-5ec7-488f-bda7-e87d6db62cd2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:53:11.021282 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 493/990] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:53:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:11.028101 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed366c86-c13e-49c2-b053-2f44d655c85c None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:11.038005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed366c86-c13e-49c2-b053-2f44d655c85c None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:11.042545 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f044c7-9f1c-45a4-916c-e96215e68508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:11.043208 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f044c7-9f1c-45a4-916c-e96215e68508 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:11.043614 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f044c7-9f1c-45a4-916c-e96215e68508 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:11.043894 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f044c7-9f1c-45a4-916c-e96215e68508 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:11.044629 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f044c7-9f1c-45a4-916c-e96215e68508 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:11.045691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f044c7-9f1c-45a4-916c-e96215e68508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:11.047213 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f044c7-9f1c-45a4-916c-e96215e68508 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:11.055958 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 498/991] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:53:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:11.062722 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd4249-5ec7-488f-bda7-e87d6db62cd2 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:11.073402 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd4249-5ec7-488f-bda7-e87d6db62cd2 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:11.078001 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28579971-72e5-41fe-898a-01501ae3808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:11.078848 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28579971-72e5-41fe-898a-01501ae3808e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:11.079126 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28579971-72e5-41fe-898a-01501ae3808e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:11.079431 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28579971-72e5-41fe-898a-01501ae3808e admin admin] PATH_INFO: `/v3/users/68496879e3b943729b33ca968765ff64` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:11.080605 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28579971-72e5-41fe-898a-01501ae3808e admin admin] RBAC: Authorizing `identity:get_user(user_id=68496879e3b943729b33ca968765ff64)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:11.082719 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28579971-72e5-41fe-898a-01501ae3808e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:11.084420 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 494/992] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:53:11 2021] GET /identity/v3/users/68496879e3b943729b33ca968765ff64 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:11.090988 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f044c7-9f1c-45a4-916c-e96215e68508 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:11.101220 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f044c7-9f1c-45a4-916c-e96215e68508 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:11.105845 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc82b5-2002-4df4-b39d-8fa544619bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:11.106697 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc82b5-2002-4df4-b39d-8fa544619bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:11.106978 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc82b5-2002-4df4-b39d-8fa544619bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:11.107250 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc82b5-2002-4df4-b39d-8fa544619bf4 admin admin] PATH_INFO: `/v3/projects/16281534bfb145deb85ccb6f132e26eb` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:11.109044 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc82b5-2002-4df4-b39d-8fa544619bf4 admin admin] RBAC: Authorizing `identity:get_project(project_id=16281534bfb145deb85ccb6f132e26eb)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:11.111083 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc82b5-2002-4df4-b39d-8fa544619bf4 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:11.113036 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 499/993] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:53:11 2021] GET /identity/v3/projects/16281534bfb145deb85ccb6f132e26eb => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:11.119688 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28579971-72e5-41fe-898a-01501ae3808e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:11.130162 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28579971-72e5-41fe-898a-01501ae3808e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:11.134748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ab280-b437-4e11-a871-bd717c9f56a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:11.135672 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ab280-b437-4e11-a871-bd717c9f56a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:11.135961 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ab280-b437-4e11-a871-bd717c9f56a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:11.136240 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ab280-b437-4e11-a871-bd717c9f56a9 admin admin] PATH_INFO: `/v3/projects/16281534bfb145deb85ccb6f132e26eb/users/68496879e3b943729b33ca968765ff64/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:11.138287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ab280-b437-4e11-a871-bd717c9f56a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16281534bfb145deb85ccb6f132e26eb, user_id=68496879e3b943729b33ca968765ff64, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:11.141099 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ab280-b437-4e11-a871-bd717c9f56a9 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:11.154134 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 495/994] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:53:11 2021] PUT /identity/v3/projects/16281534bfb145deb85ccb6f132e26eb/users/68496879e3b943729b33ca968765ff64/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:53:13.319740 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d43236-5a38-466e-898c-67426595bcc6 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:13.320262 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d43236-5a38-466e-898c-67426595bcc6 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:13.320262 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d43236-5a38-466e-898c-67426595bcc6 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:13.322040 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 500/995] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:13.327985 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce844aa-e614-414d-a787-0099a0ce2d85 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:13.328404 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce844aa-e614-414d-a787-0099a0ce2d85 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:13.328544 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce844aa-e614-414d-a787-0099a0ce2d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:13.346217 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-4ce844aa-e614-414d-a787-0099a0ce2d85 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:13.347413 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-4ce844aa-e614-414d-a787-0099a0ce2d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:13.401420 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 496/996] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:13 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:13.429718 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d43236-5a38-466e-898c-67426595bcc6 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:13.441988 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d43236-5a38-466e-898c-67426595bcc6 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:13.446271 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b571a-35b0-48f7-88e1-8836e17b227f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:13.447041 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b571a-35b0-48f7-88e1-8836e17b227f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:13.447318 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b571a-35b0-48f7-88e1-8836e17b227f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:13.447618 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b571a-35b0-48f7-88e1-8836e17b227f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:13.458602 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b571a-35b0-48f7-88e1-8836e17b227f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:53:13.465215 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-888b571a-35b0-48f7-88e1-8836e17b227f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:53:13.466337 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 501/997] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:53:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:13.473454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce844aa-e614-414d-a787-0099a0ce2d85 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:13.482183 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce844aa-e614-414d-a787-0099a0ce2d85 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:13.487346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba2efc-fd42-4616-baa2-1fb6bb179a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:13.488014 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba2efc-fd42-4616-baa2-1fb6bb179a50 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:13.488295 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba2efc-fd42-4616-baa2-1fb6bb179a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:13.488570 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba2efc-fd42-4616-baa2-1fb6bb179a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:13.489308 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba2efc-fd42-4616-baa2-1fb6bb179a50 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:13.489613 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba2efc-fd42-4616-baa2-1fb6bb179a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:13.491206 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba2efc-fd42-4616-baa2-1fb6bb179a50 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:13.499733 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 497/998] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:53:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:13.505742 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b571a-35b0-48f7-88e1-8836e17b227f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:13.515083 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b571a-35b0-48f7-88e1-8836e17b227f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:13.519613 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0ad00-c435-4657-b5b2-e8d951354f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:13.520439 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0ad00-c435-4657-b5b2-e8d951354f57 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:13.520724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0ad00-c435-4657-b5b2-e8d951354f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:13.521000 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0ad00-c435-4657-b5b2-e8d951354f57 admin admin] PATH_INFO: `/v3/users/68496879e3b943729b33ca968765ff64` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:13.522180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0ad00-c435-4657-b5b2-e8d951354f57 admin admin] RBAC: Authorizing `identity:get_user(user_id=68496879e3b943729b33ca968765ff64)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:13.524316 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0ad00-c435-4657-b5b2-e8d951354f57 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:13.525858 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 502/999] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:53:13 2021] GET /identity/v3/users/68496879e3b943729b33ca968765ff64 => generated 285 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:13.532250 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba2efc-fd42-4616-baa2-1fb6bb179a50 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:13.541314 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba2efc-fd42-4616-baa2-1fb6bb179a50 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:13.546413 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8928a-eb74-47bc-a6fe-d587c95b3430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:13.547015 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8928a-eb74-47bc-a6fe-d587c95b3430 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:13.547299 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8928a-eb74-47bc-a6fe-d587c95b3430 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:13.547603 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8928a-eb74-47bc-a6fe-d587c95b3430 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:13.555035 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8928a-eb74-47bc-a6fe-d587c95b3430 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:13.556761 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8928a-eb74-47bc-a6fe-d587c95b3430 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:13.565353 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 498/1000] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:53:13 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:53:13.571316 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0ad00-c435-4657-b5b2-e8d951354f57 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:13.581048 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0ad00-c435-4657-b5b2-e8d951354f57 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:13.585517 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad536a09-bc64-49e6-863a-6ff679b37b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:13.586315 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad536a09-bc64-49e6-863a-6ff679b37b07 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:13.586598 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad536a09-bc64-49e6-863a-6ff679b37b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:13.586875 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad536a09-bc64-49e6-863a-6ff679b37b07 admin admin] PATH_INFO: `/v3/projects/16281534bfb145deb85ccb6f132e26eb` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:13.588033 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad536a09-bc64-49e6-863a-6ff679b37b07 admin admin] RBAC: Authorizing `identity:get_project(project_id=16281534bfb145deb85ccb6f132e26eb)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:13.591289 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad536a09-bc64-49e6-863a-6ff679b37b07 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:13.594136 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 503/1001] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:53:13 2021] GET /identity/v3/projects/16281534bfb145deb85ccb6f132e26eb => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:13.600400 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8928a-eb74-47bc-a6fe-d587c95b3430 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:13.608975 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8928a-eb74-47bc-a6fe-d587c95b3430 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:13.613461 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e8e29-5d4f-4869-bff6-8157b5fa27b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:13.614077 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8e29-5d4f-4869-bff6-8157b5fa27b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:13.614358 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8e29-5d4f-4869-bff6-8157b5fa27b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:13.614630 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8e29-5d4f-4869-bff6-8157b5fa27b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:13.615472 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e8e29-5d4f-4869-bff6-8157b5fa27b0 admin admin] RBAC: Adding query filter params (role.id=99835eeda2f64af5bc9173a8370d4568, scope.project.id=16281534bfb145deb85ccb6f132e26eb, user.id=68496879e3b943729b33ca968765ff64) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:13.615783 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e8e29-5d4f-4869-bff6-8157b5fa27b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:13.617583 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e8e29-5d4f-4869-bff6-8157b5fa27b0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:13.623351 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 499/1002] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:53:13 2021] GET /identity/v3/role_assignments?user.id=68496879e3b943729b33ca968765ff64&scope.project.id=16281534bfb145deb85ccb6f132e26eb&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:15.779732 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e96f20-bcd0-47e7-93e3-d2890adde6c9 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:15.780326 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e96f20-bcd0-47e7-93e3-d2890adde6c9 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:15.780480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e96f20-bcd0-47e7-93e3-d2890adde6c9 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:15.782184 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 504/1003] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:15.788250 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b308562-d5ff-4568-8685-8f6378390622 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:15.788659 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b308562-d5ff-4568-8685-8f6378390622 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:15.788802 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b308562-d5ff-4568-8685-8f6378390622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:15.806836 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-9b308562-d5ff-4568-8685-8f6378390622 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:15.808257 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-9b308562-d5ff-4568-8685-8f6378390622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:15.819228 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 500/1004] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:15 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:15.846137 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e96f20-bcd0-47e7-93e3-d2890adde6c9 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:15.858872 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e96f20-bcd0-47e7-93e3-d2890adde6c9 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:15.863149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba2de5-594a-4c65-ae03-2a8cb8493519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:15.863948 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba2de5-594a-4c65-ae03-2a8cb8493519 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:15.864223 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba2de5-594a-4c65-ae03-2a8cb8493519 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:15.864490 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba2de5-594a-4c65-ae03-2a8cb8493519 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:15.865622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba2de5-594a-4c65-ae03-2a8cb8493519 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:15.867275 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba2de5-594a-4c65-ae03-2a8cb8493519 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:15.868834 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 505/1005] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:53:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:15.876030 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b308562-d5ff-4568-8685-8f6378390622 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:15.884680 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b308562-d5ff-4568-8685-8f6378390622 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:15.889203 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01edac-9347-44ed-baf3-70bc17d51e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:15.889851 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01edac-9347-44ed-baf3-70bc17d51e0b admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:15.890126 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01edac-9347-44ed-baf3-70bc17d51e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:15.890392 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01edac-9347-44ed-baf3-70bc17d51e0b admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:15.891074 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01edac-9347-44ed-baf3-70bc17d51e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:15.893001 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01edac-9347-44ed-baf3-70bc17d51e0b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:15.912290 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 501/1006] 10.222.0.39 () {60 vars in 1154 bytes} [Tue Aug 31 02:53:15 2021] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:53:18.093914 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721637b-c06a-4a39-b987-b5c856c96c83 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:18.094455 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721637b-c06a-4a39-b987-b5c856c96c83 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:18.094658 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721637b-c06a-4a39-b987-b5c856c96c83 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:18.096458 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 506/1007] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:18.102653 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9d384-1680-4748-8220-8896112e47a0 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:18.103095 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9d384-1680-4748-8220-8896112e47a0 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:18.103333 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9d384-1680-4748-8220-8896112e47a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:18.121331 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-53d9d384-1680-4748-8220-8896112e47a0 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:18.122790 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-53d9d384-1680-4748-8220-8896112e47a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:18.130486 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 502/1008] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:18 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:18.156785 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721637b-c06a-4a39-b987-b5c856c96c83 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:18.168480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721637b-c06a-4a39-b987-b5c856c96c83 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:18.172832 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83c163-5211-4294-9a50-b1781d999da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:18.173652 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83c163-5211-4294-9a50-b1781d999da4 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:18.173928 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83c163-5211-4294-9a50-b1781d999da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:18.174192 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83c163-5211-4294-9a50-b1781d999da4 admin admin] PATH_INFO: `/v3/roles/22d670400c514449b9734ad179a36f82` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:18.175646 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83c163-5211-4294-9a50-b1781d999da4 admin admin] RBAC: Authorizing `identity:get_role(role_id=22d670400c514449b9734ad179a36f82)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:18.176633 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-7a83c163-5211-4294-9a50-b1781d999da4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:53:18.176633 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 02:53:18.176633 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 02:53:18.177501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83c163-5211-4294-9a50-b1781d999da4 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:18.178777 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 507/1009] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:53:18 2021] GET /identity/v3/roles/22d670400c514449b9734ad179a36f82 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:18.184766 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9d384-1680-4748-8220-8896112e47a0 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:18.193439 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9d384-1680-4748-8220-8896112e47a0 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:18.197881 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa672450-2c9e-4c10-802a-8c0df19241f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:18.198724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa672450-2c9e-4c10-802a-8c0df19241f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:18.199003 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa672450-2c9e-4c10-802a-8c0df19241f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:18.199274 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa672450-2c9e-4c10-802a-8c0df19241f3 admin admin] PATH_INFO: `/v3/users/7412bae655614de299dffc63b1000809` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:18.212619 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa672450-2c9e-4c10-802a-8c0df19241f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=7412bae655614de299dffc63b1000809)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:18.214727 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa672450-2c9e-4c10-802a-8c0df19241f3 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:18.216334 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 503/1010] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:53:18 2021] GET /identity/v3/users/7412bae655614de299dffc63b1000809 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:18.223202 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83c163-5211-4294-9a50-b1781d999da4 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:18.232566 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83c163-5211-4294-9a50-b1781d999da4 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:18.237123 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeaa5e-c1ef-41be-8944-d7e54d1615a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:18.237742 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeaa5e-c1ef-41be-8944-d7e54d1615a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:18.238028 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeaa5e-c1ef-41be-8944-d7e54d1615a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:18.238308 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faeaa5e-c1ef-41be-8944-d7e54d1615a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:18.245803 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faeaa5e-c1ef-41be-8944-d7e54d1615a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:18.247820 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faeaa5e-c1ef-41be-8944-d7e54d1615a1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:18.256472 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 508/1011] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:53:18 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:53:18.262383 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa672450-2c9e-4c10-802a-8c0df19241f3 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:18.272030 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa672450-2c9e-4c10-802a-8c0df19241f3 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:18.276450 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df687d20-8d2c-456f-9612-540b4f7314c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:18.277261 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df687d20-8d2c-456f-9612-540b4f7314c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:18.277541 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df687d20-8d2c-456f-9612-540b4f7314c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:18.277814 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df687d20-8d2c-456f-9612-540b4f7314c6 admin admin] PATH_INFO: `/v3/projects/16281534bfb145deb85ccb6f132e26eb` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:18.278949 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df687d20-8d2c-456f-9612-540b4f7314c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=16281534bfb145deb85ccb6f132e26eb)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:18.281622 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df687d20-8d2c-456f-9612-540b4f7314c6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:18.283215 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 504/1012] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:53:18 2021] GET /identity/v3/projects/16281534bfb145deb85ccb6f132e26eb => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:53:18.289399 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeaa5e-c1ef-41be-8944-d7e54d1615a1 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:18.298117 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faeaa5e-c1ef-41be-8944-d7e54d1615a1 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:18.302634 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff926c35-666b-4144-bcde-66e419623ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:18.303248 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff926c35-666b-4144-bcde-66e419623ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:18.303562 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff926c35-666b-4144-bcde-66e419623ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:18.303841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff926c35-666b-4144-bcde-66e419623ec7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:18.304638 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff926c35-666b-4144-bcde-66e419623ec7 admin admin] RBAC: Adding query filter params (role.id=22d670400c514449b9734ad179a36f82, scope.project.id=16281534bfb145deb85ccb6f132e26eb, user.id=7412bae655614de299dffc63b1000809) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:18.304947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff926c35-666b-4144-bcde-66e419623ec7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:18.306728 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff926c35-666b-4144-bcde-66e419623ec7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:18.311916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 509/1013] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:53:18 2021] GET /identity/v3/role_assignments?user.id=7412bae655614de299dffc63b1000809&scope.project.id=16281534bfb145deb85ccb6f132e26eb&role.id=22d670400c514449b9734ad179a36f82 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:20.406440 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77a36f-4877-4927-acbd-f4865fbd57aa None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:20.406957 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77a36f-4877-4927-acbd-f4865fbd57aa None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:20.406957 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77a36f-4877-4927-acbd-f4865fbd57aa None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:20.408702 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 505/1014] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:53:20.414483 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e81c2-6a12-4214-8dee-a3c82c8647cc None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:20.414900 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e81c2-6a12-4214-8dee-a3c82c8647cc None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:20.415043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e81c2-6a12-4214-8dee-a3c82c8647cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:20.432808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-6d8e81c2-6a12-4214-8dee-a3c82c8647cc None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:20.433981 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-6d8e81c2-6a12-4214-8dee-a3c82c8647cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:20.442298 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 510/1015] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:20 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:20.465599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77a36f-4877-4927-acbd-f4865fbd57aa None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:20.477589 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77a36f-4877-4927-acbd-f4865fbd57aa None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:20.481885 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f7418-6b98-4d72-ad46-b48c7ee896de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:20.483311 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f7418-6b98-4d72-ad46-b48c7ee896de admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:20.483620 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f7418-6b98-4d72-ad46-b48c7ee896de admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:20.483894 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f7418-6b98-4d72-ad46-b48c7ee896de admin admin] PATH_INFO: `/v3/roles/22d670400c514449b9734ad179a36f82` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:20.485330 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f7418-6b98-4d72-ad46-b48c7ee896de admin admin] RBAC: Authorizing `identity:get_role(role_id=22d670400c514449b9734ad179a36f82)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:20.486324 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-871f7418-6b98-4d72-ad46-b48c7ee896de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:53:20.486324 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 02:53:20.486324 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 02:53:20.487191 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f7418-6b98-4d72-ad46-b48c7ee896de admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:20.488697 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 506/1016] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:53:20 2021] GET /identity/v3/roles/22d670400c514449b9734ad179a36f82 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:20.494489 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e81c2-6a12-4214-8dee-a3c82c8647cc None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:20.503981 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e81c2-6a12-4214-8dee-a3c82c8647cc None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:20.508460 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c19fbf-88bc-4c53-b4d5-80dce5d803d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:20.509299 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c19fbf-88bc-4c53-b4d5-80dce5d803d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:20.509579 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c19fbf-88bc-4c53-b4d5-80dce5d803d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:20.509851 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c19fbf-88bc-4c53-b4d5-80dce5d803d4 admin admin] PATH_INFO: `/v3/users/7412bae655614de299dffc63b1000809` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:20.511022 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c19fbf-88bc-4c53-b4d5-80dce5d803d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=7412bae655614de299dffc63b1000809)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:20.513160 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c19fbf-88bc-4c53-b4d5-80dce5d803d4 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:20.515061 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 511/1017] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:53:20 2021] GET /identity/v3/users/7412bae655614de299dffc63b1000809 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:20.520592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f7418-6b98-4d72-ad46-b48c7ee896de admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:20.529925 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f7418-6b98-4d72-ad46-b48c7ee896de admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:20.534324 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab90584-12e0-40e8-8526-fb4265bec86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:20.535123 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab90584-12e0-40e8-8526-fb4265bec86d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:20.535428 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab90584-12e0-40e8-8526-fb4265bec86d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:20.535706 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab90584-12e0-40e8-8526-fb4265bec86d admin admin] PATH_INFO: `/v3/projects/16281534bfb145deb85ccb6f132e26eb` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:20.536838 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab90584-12e0-40e8-8526-fb4265bec86d admin admin] RBAC: Authorizing `identity:get_project(project_id=16281534bfb145deb85ccb6f132e26eb)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:20.538799 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab90584-12e0-40e8-8526-fb4265bec86d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:20.540415 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 507/1018] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:53:20 2021] GET /identity/v3/projects/16281534bfb145deb85ccb6f132e26eb => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:53:20.546950 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c19fbf-88bc-4c53-b4d5-80dce5d803d4 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:20.556213 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c19fbf-88bc-4c53-b4d5-80dce5d803d4 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:20.561230 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e58672-b01d-4268-a9c7-d1c5fc57fcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:20.562075 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e58672-b01d-4268-a9c7-d1c5fc57fcc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:20.562352 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e58672-b01d-4268-a9c7-d1c5fc57fcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:20.562621 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e58672-b01d-4268-a9c7-d1c5fc57fcc4 admin admin] PATH_INFO: `/v3/projects/16281534bfb145deb85ccb6f132e26eb/users/7412bae655614de299dffc63b1000809/roles/22d670400c514449b9734ad179a36f82` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:20.564825 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e58672-b01d-4268-a9c7-d1c5fc57fcc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16281534bfb145deb85ccb6f132e26eb, user_id=7412bae655614de299dffc63b1000809, role_id=22d670400c514449b9734ad179a36f82)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:20.567454 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e58672-b01d-4268-a9c7-d1c5fc57fcc4 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:20.579839 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 512/1019] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:53:20 2021] PUT /identity/v3/projects/16281534bfb145deb85ccb6f132e26eb/users/7412bae655614de299dffc63b1000809/roles/22d670400c514449b9734ad179a36f82 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:53:22.692902 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce333ca1-c798-4a45-866c-12780debf4f3 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:22.693454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce333ca1-c798-4a45-866c-12780debf4f3 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:22.693454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce333ca1-c798-4a45-866c-12780debf4f3 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:22.695238 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 508/1020] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:22.701953 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72792a09-c40d-4028-a169-445729ca1ff3 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:22.702374 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72792a09-c40d-4028-a169-445729ca1ff3 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:22.702484 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72792a09-c40d-4028-a169-445729ca1ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:22.721113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-72792a09-c40d-4028-a169-445729ca1ff3 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:22.722294 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-72792a09-c40d-4028-a169-445729ca1ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:22.777048 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 513/1021] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:22 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:22.801778 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce333ca1-c798-4a45-866c-12780debf4f3 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:22.813780 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce333ca1-c798-4a45-866c-12780debf4f3 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:22.818072 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47242cba-c56d-4ed2-b9ac-9fa24de51f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:22.818898 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47242cba-c56d-4ed2-b9ac-9fa24de51f20 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:22.819180 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47242cba-c56d-4ed2-b9ac-9fa24de51f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:22.819490 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47242cba-c56d-4ed2-b9ac-9fa24de51f20 admin admin] PATH_INFO: `/v3/roles/22d670400c514449b9734ad179a36f82` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:22.820924 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47242cba-c56d-4ed2-b9ac-9fa24de51f20 admin admin] RBAC: Authorizing `identity:get_role(role_id=22d670400c514449b9734ad179a36f82)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:22.822488 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47242cba-c56d-4ed2-b9ac-9fa24de51f20 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:22.823837 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 509/1022] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:53:22 2021] GET /identity/v3/roles/22d670400c514449b9734ad179a36f82 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:22.830543 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72792a09-c40d-4028-a169-445729ca1ff3 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:22.839049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72792a09-c40d-4028-a169-445729ca1ff3 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:22.844255 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5740d28-4a6a-4907-abae-2d6a702122b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:22.845092 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5740d28-4a6a-4907-abae-2d6a702122b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:22.845370 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5740d28-4a6a-4907-abae-2d6a702122b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:22.845643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5740d28-4a6a-4907-abae-2d6a702122b8 admin admin] PATH_INFO: `/v3/users/7412bae655614de299dffc63b1000809` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:22.846806 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5740d28-4a6a-4907-abae-2d6a702122b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=7412bae655614de299dffc63b1000809)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:22.848920 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5740d28-4a6a-4907-abae-2d6a702122b8 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:22.850449 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 514/1023] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:53:22 2021] GET /identity/v3/users/7412bae655614de299dffc63b1000809 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:22.856291 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47242cba-c56d-4ed2-b9ac-9fa24de51f20 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:22.865567 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47242cba-c56d-4ed2-b9ac-9fa24de51f20 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:22.870022 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e911428-0323-475f-90ac-5d45cfd115ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:22.870617 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e911428-0323-475f-90ac-5d45cfd115ed admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:22.870897 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e911428-0323-475f-90ac-5d45cfd115ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:22.871171 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e911428-0323-475f-90ac-5d45cfd115ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:22.878874 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e911428-0323-475f-90ac-5d45cfd115ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:22.880586 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e911428-0323-475f-90ac-5d45cfd115ed admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:22.889601 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 510/1024] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:53:22 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 02:53:22.895553 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5740d28-4a6a-4907-abae-2d6a702122b8 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:22.905052 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5740d28-4a6a-4907-abae-2d6a702122b8 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:22.909590 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0db40-6742-44f0-893d-8498641b9110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:22.910385 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0db40-6742-44f0-893d-8498641b9110 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:22.910662 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0db40-6742-44f0-893d-8498641b9110 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:22.910931 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0db40-6742-44f0-893d-8498641b9110 admin admin] PATH_INFO: `/v3/projects/16281534bfb145deb85ccb6f132e26eb` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:22.912068 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0db40-6742-44f0-893d-8498641b9110 admin admin] RBAC: Authorizing `identity:get_project(project_id=16281534bfb145deb85ccb6f132e26eb)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:22.914036 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0db40-6742-44f0-893d-8498641b9110 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:22.915669 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 515/1025] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:53:22 2021] GET /identity/v3/projects/16281534bfb145deb85ccb6f132e26eb => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:22.922296 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e911428-0323-475f-90ac-5d45cfd115ed admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:22.930599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e911428-0323-475f-90ac-5d45cfd115ed admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:22.935040 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ecce8-53d8-437b-84d4-d58837ad7cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:22.936235 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ecce8-53d8-437b-84d4-d58837ad7cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:22.936512 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ecce8-53d8-437b-84d4-d58837ad7cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:22.936788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ecce8-53d8-437b-84d4-d58837ad7cf5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:22.937584 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ecce8-53d8-437b-84d4-d58837ad7cf5 admin admin] RBAC: Adding query filter params (role.id=22d670400c514449b9734ad179a36f82, scope.project.id=16281534bfb145deb85ccb6f132e26eb, user.id=7412bae655614de299dffc63b1000809) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:22.937894 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ecce8-53d8-437b-84d4-d58837ad7cf5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:22.939693 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ecce8-53d8-437b-84d4-d58837ad7cf5 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:22.945321 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 511/1026] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:53:22 2021] GET /identity/v3/role_assignments?user.id=7412bae655614de299dffc63b1000809&scope.project.id=16281534bfb145deb85ccb6f132e26eb&role.id=22d670400c514449b9734ad179a36f82 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:25.093490 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042a25b-f1e0-4978-9f15-00d49633c8fc None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:25.094021 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042a25b-f1e0-4978-9f15-00d49633c8fc None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:25.094021 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042a25b-f1e0-4978-9f15-00d49633c8fc None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:25.095806 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 516/1027] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:25.101724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5cc0b-12bd-44f7-b641-fdbf39d14ba2 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:25.102094 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5cc0b-12bd-44f7-b641-fdbf39d14ba2 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:25.102287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5cc0b-12bd-44f7-b641-fdbf39d14ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:25.119553 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-92b5cc0b-12bd-44f7-b641-fdbf39d14ba2 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:25.120732 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-92b5cc0b-12bd-44f7-b641-fdbf39d14ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:25.128677 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 512/1028] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:25 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:25.153954 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042a25b-f1e0-4978-9f15-00d49633c8fc None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:25.166239 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042a25b-f1e0-4978-9f15-00d49633c8fc None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:25.170636 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8d6ce-dfcc-4191-ae08-f7cb0780996a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:25.171423 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8d6ce-dfcc-4191-ae08-f7cb0780996a admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:25.171701 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8d6ce-dfcc-4191-ae08-f7cb0780996a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:25.171970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8d6ce-dfcc-4191-ae08-f7cb0780996a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:25.173105 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8d6ce-dfcc-4191-ae08-f7cb0780996a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:25.174761 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee8d6ce-dfcc-4191-ae08-f7cb0780996a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:25.176318 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 517/1029] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:53:25 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:25.182474 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5cc0b-12bd-44f7-b641-fdbf39d14ba2 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:25.191531 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5cc0b-12bd-44f7-b641-fdbf39d14ba2 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:25.195950 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119df906-1a41-4363-9ccb-a1566aa07c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:25.196582 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119df906-1a41-4363-9ccb-a1566aa07c47 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:25.196863 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119df906-1a41-4363-9ccb-a1566aa07c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:25.197134 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119df906-1a41-4363-9ccb-a1566aa07c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:25.197820 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119df906-1a41-4363-9ccb-a1566aa07c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:25.199717 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119df906-1a41-4363-9ccb-a1566aa07c47 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:25.224389 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 513/1030] 10.222.0.39 () {60 vars in 1163 bytes} [Tue Aug 31 02:53:25 2021] POST /identity/v3/projects => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:53:27.410281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db266ac-57cd-47a3-ab96-306543d88683 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:27.410781 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db266ac-57cd-47a3-ab96-306543d88683 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:27.410781 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db266ac-57cd-47a3-ab96-306543d88683 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:27.412536 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 518/1031] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:27.418399 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04a3bc-97e8-4dff-9a74-7f7f5548b752 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:27.418823 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04a3bc-97e8-4dff-9a74-7f7f5548b752 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:27.418966 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04a3bc-97e8-4dff-9a74-7f7f5548b752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:27.437479 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-0c04a3bc-97e8-4dff-9a74-7f7f5548b752 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:27.438954 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0c04a3bc-97e8-4dff-9a74-7f7f5548b752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:27.493944 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 514/1032] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:27 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:27.519798 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db266ac-57cd-47a3-ab96-306543d88683 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:27.532123 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db266ac-57cd-47a3-ab96-306543d88683 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:27.536453 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e56b57-77ab-49eb-befe-0ddc0c832b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:27.537219 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e56b57-77ab-49eb-befe-0ddc0c832b27 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:27.537498 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e56b57-77ab-49eb-befe-0ddc0c832b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:27.537771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e56b57-77ab-49eb-befe-0ddc0c832b27 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:27.538914 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e56b57-77ab-49eb-befe-0ddc0c832b27 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:27.540609 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e56b57-77ab-49eb-befe-0ddc0c832b27 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:27.542146 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 519/1033] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:53:27 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:27.548671 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04a3bc-97e8-4dff-9a74-7f7f5548b752 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:27.557354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04a3bc-97e8-4dff-9a74-7f7f5548b752 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:27.562326 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e40fca-4f1c-4cff-8cac-b46f4ffcb0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:27.562971 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e40fca-4f1c-4cff-8cac-b46f4ffcb0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:27.563255 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e40fca-4f1c-4cff-8cac-b46f4ffcb0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:27.563572 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e40fca-4f1c-4cff-8cac-b46f4ffcb0e7 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:27.564280 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e40fca-4f1c-4cff-8cac-b46f4ffcb0e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:27.566166 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e40fca-4f1c-4cff-8cac-b46f4ffcb0e7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:27.585063 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 515/1034] 10.222.0.39 () {60 vars in 1154 bytes} [Tue Aug 31 02:53:27 2021] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:53:29.804986 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3173d3-fed1-443f-9894-399aff345f36 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:29.805586 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3173d3-fed1-443f-9894-399aff345f36 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:29.805586 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3173d3-fed1-443f-9894-399aff345f36 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:29.807267 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 520/1035] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:29.813903 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865be4c5-a4e7-4dae-ac62-7506e1c2d646 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:29.814331 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865be4c5-a4e7-4dae-ac62-7506e1c2d646 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:29.814456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865be4c5-a4e7-4dae-ac62-7506e1c2d646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:29.832340 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-865be4c5-a4e7-4dae-ac62-7506e1c2d646 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:29.833550 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-865be4c5-a4e7-4dae-ac62-7506e1c2d646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:29.841049 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 516/1036] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:29 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:29.865365 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3173d3-fed1-443f-9894-399aff345f36 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:29.878136 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3173d3-fed1-443f-9894-399aff345f36 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:29.882472 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e688100-a99f-426a-82be-08b4a44a0281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:29.883238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e688100-a99f-426a-82be-08b4a44a0281 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:29.883555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e688100-a99f-426a-82be-08b4a44a0281 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:29.883833 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e688100-a99f-426a-82be-08b4a44a0281 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:29.894279 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e688100-a99f-426a-82be-08b4a44a0281 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:53:29.901032 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-1e688100-a99f-426a-82be-08b4a44a0281 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:53:29.902142 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 521/1037] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:53:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:53:29.908596 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865be4c5-a4e7-4dae-ac62-7506e1c2d646 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:29.917333 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865be4c5-a4e7-4dae-ac62-7506e1c2d646 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:29.921988 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b1798-48b7-44e3-905d-253039db2d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:29.922634 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b1798-48b7-44e3-905d-253039db2d89 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:29.922915 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b1798-48b7-44e3-905d-253039db2d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:29.923187 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b1798-48b7-44e3-905d-253039db2d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:29.923964 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b1798-48b7-44e3-905d-253039db2d89 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:29.924266 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b1798-48b7-44e3-905d-253039db2d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:29.925837 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b1798-48b7-44e3-905d-253039db2d89 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:29.933764 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 517/1038] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:53:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:29.940393 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e688100-a99f-426a-82be-08b4a44a0281 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:29.950144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e688100-a99f-426a-82be-08b4a44a0281 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:29.955324 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df17e4f-c9b2-4952-866c-bb4e9d61e137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:29.956181 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df17e4f-c9b2-4952-866c-bb4e9d61e137 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:29.956459 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df17e4f-c9b2-4952-866c-bb4e9d61e137 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:29.956735 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df17e4f-c9b2-4952-866c-bb4e9d61e137 admin admin] PATH_INFO: `/v3/users/e5f4549b47284153b493a351d674a5d0` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:29.969507 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df17e4f-c9b2-4952-866c-bb4e9d61e137 admin admin] RBAC: Authorizing `identity:get_user(user_id=e5f4549b47284153b493a351d674a5d0)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:29.971635 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df17e4f-c9b2-4952-866c-bb4e9d61e137 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:29.973191 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 522/1039] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:53:29 2021] GET /identity/v3/users/e5f4549b47284153b493a351d674a5d0 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:29.979210 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b1798-48b7-44e3-905d-253039db2d89 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:29.988629 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b1798-48b7-44e3-905d-253039db2d89 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:29.993099 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719ce58-8efd-413c-9e91-8024fdd4b849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:29.993725 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719ce58-8efd-413c-9e91-8024fdd4b849 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:29.994009 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719ce58-8efd-413c-9e91-8024fdd4b849 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:29.994282 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719ce58-8efd-413c-9e91-8024fdd4b849 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:30.002649 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719ce58-8efd-413c-9e91-8024fdd4b849 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:30.004432 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719ce58-8efd-413c-9e91-8024fdd4b849 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:30.013000 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 518/1040] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:53:29 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:53:30.020056 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df17e4f-c9b2-4952-866c-bb4e9d61e137 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:30.029430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df17e4f-c9b2-4952-866c-bb4e9d61e137 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:30.033864 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3412a49-1bb3-4f9d-b7fa-7da08d48f6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:30.034678 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3412a49-1bb3-4f9d-b7fa-7da08d48f6ef admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:30.034956 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3412a49-1bb3-4f9d-b7fa-7da08d48f6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:30.035246 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3412a49-1bb3-4f9d-b7fa-7da08d48f6ef admin admin] PATH_INFO: `/v3/projects/f4cd2fc1595c40a5a8f420862b7a5fab` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:30.036389 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3412a49-1bb3-4f9d-b7fa-7da08d48f6ef admin admin] RBAC: Authorizing `identity:get_project(project_id=f4cd2fc1595c40a5a8f420862b7a5fab)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:30.038395 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3412a49-1bb3-4f9d-b7fa-7da08d48f6ef admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:30.040022 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 523/1041] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:53:30 2021] GET /identity/v3/projects/f4cd2fc1595c40a5a8f420862b7a5fab => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:30.046306 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719ce58-8efd-413c-9e91-8024fdd4b849 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:30.054599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719ce58-8efd-413c-9e91-8024fdd4b849 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:30.059123 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d6804-ad62-49ad-b70c-caecec6468a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:30.059713 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d6804-ad62-49ad-b70c-caecec6468a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:30.059997 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d6804-ad62-49ad-b70c-caecec6468a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:30.060794 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d6804-ad62-49ad-b70c-caecec6468a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:30.061599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d6804-ad62-49ad-b70c-caecec6468a0 admin admin] RBAC: Adding query filter params (role.id=99835eeda2f64af5bc9173a8370d4568, scope.project.id=f4cd2fc1595c40a5a8f420862b7a5fab, user.id=e5f4549b47284153b493a351d674a5d0) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:30.061903 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d6804-ad62-49ad-b70c-caecec6468a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:30.063717 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d6804-ad62-49ad-b70c-caecec6468a0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:30.068897 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 519/1042] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:53:30 2021] GET /identity/v3/role_assignments?user.id=e5f4549b47284153b493a351d674a5d0&scope.project.id=f4cd2fc1595c40a5a8f420862b7a5fab&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:32.218302 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38e802-e73c-4c5d-aca1-4f43c4a3526c None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:32.218846 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38e802-e73c-4c5d-aca1-4f43c4a3526c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:32.218846 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38e802-e73c-4c5d-aca1-4f43c4a3526c None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:32.220643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 524/1043] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:32.226498 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303c010-cbf0-497a-808c-621f8cbe35d9 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:32.226909 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303c010-cbf0-497a-808c-621f8cbe35d9 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:32.227062 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303c010-cbf0-497a-808c-621f8cbe35d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:32.244744 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-8303c010-cbf0-497a-808c-621f8cbe35d9 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:32.245925 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-8303c010-cbf0-497a-808c-621f8cbe35d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:32.254021 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 520/1044] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:32 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:32.278062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38e802-e73c-4c5d-aca1-4f43c4a3526c None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:32.290551 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38e802-e73c-4c5d-aca1-4f43c4a3526c None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:32.295505 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40067083-4384-4c0e-bb00-eb82423bb3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:32.296275 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40067083-4384-4c0e-bb00-eb82423bb3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:32.296554 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40067083-4384-4c0e-bb00-eb82423bb3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:32.296827 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40067083-4384-4c0e-bb00-eb82423bb3f9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:32.306584 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40067083-4384-4c0e-bb00-eb82423bb3f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:53:32.313325 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-40067083-4384-4c0e-bb00-eb82423bb3f9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:53:32.314432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 525/1045] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:53:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:32.320706 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303c010-cbf0-497a-808c-621f8cbe35d9 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:32.329955 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303c010-cbf0-497a-808c-621f8cbe35d9 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:32.334411 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45a9d0-f586-4709-a8b4-113eee64cb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:32.335056 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45a9d0-f586-4709-a8b4-113eee64cb9f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:32.335339 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45a9d0-f586-4709-a8b4-113eee64cb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:32.335643 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45a9d0-f586-4709-a8b4-113eee64cb9f admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:32.336375 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45a9d0-f586-4709-a8b4-113eee64cb9f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:32.336680 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45a9d0-f586-4709-a8b4-113eee64cb9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:32.338261 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45a9d0-f586-4709-a8b4-113eee64cb9f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:32.346794 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 521/1046] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:53:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:32.352765 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40067083-4384-4c0e-bb00-eb82423bb3f9 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:32.362594 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40067083-4384-4c0e-bb00-eb82423bb3f9 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:32.367114 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac3b61-9077-4c4b-8080-0aa56b0dd5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:32.367975 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac3b61-9077-4c4b-8080-0aa56b0dd5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:32.368258 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac3b61-9077-4c4b-8080-0aa56b0dd5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:32.368531 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac3b61-9077-4c4b-8080-0aa56b0dd5f5 admin admin] PATH_INFO: `/v3/users/e5f4549b47284153b493a351d674a5d0` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:32.369697 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac3b61-9077-4c4b-8080-0aa56b0dd5f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=e5f4549b47284153b493a351d674a5d0)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:32.372135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac3b61-9077-4c4b-8080-0aa56b0dd5f5 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:32.373620 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 526/1047] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:53:32 2021] GET /identity/v3/users/e5f4549b47284153b493a351d674a5d0 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:53:32.379512 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45a9d0-f586-4709-a8b4-113eee64cb9f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:32.389221 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45a9d0-f586-4709-a8b4-113eee64cb9f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:32.393657 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96045345-cbe9-4df0-9409-2d0a6c261b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:32.394470 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96045345-cbe9-4df0-9409-2d0a6c261b1f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:32.394757 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96045345-cbe9-4df0-9409-2d0a6c261b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:32.395036 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96045345-cbe9-4df0-9409-2d0a6c261b1f admin admin] PATH_INFO: `/v3/projects/f4cd2fc1595c40a5a8f420862b7a5fab` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:32.396219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96045345-cbe9-4df0-9409-2d0a6c261b1f admin admin] RBAC: Authorizing `identity:get_project(project_id=f4cd2fc1595c40a5a8f420862b7a5fab)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:32.398209 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96045345-cbe9-4df0-9409-2d0a6c261b1f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:32.399962 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 522/1048] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:53:32 2021] GET /identity/v3/projects/f4cd2fc1595c40a5a8f420862b7a5fab => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:32.406504 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac3b61-9077-4c4b-8080-0aa56b0dd5f5 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:32.415577 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac3b61-9077-4c4b-8080-0aa56b0dd5f5 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:32.420482 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a1d4b-2f5d-4ae1-9889-d37f4a84cba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:32.421295 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a1d4b-2f5d-4ae1-9889-d37f4a84cba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:32.421565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a1d4b-2f5d-4ae1-9889-d37f4a84cba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:32.421866 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a1d4b-2f5d-4ae1-9889-d37f4a84cba2 admin admin] PATH_INFO: `/v3/projects/f4cd2fc1595c40a5a8f420862b7a5fab/users/e5f4549b47284153b493a351d674a5d0/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:32.423761 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a1d4b-2f5d-4ae1-9889-d37f4a84cba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4cd2fc1595c40a5a8f420862b7a5fab, user_id=e5f4549b47284153b493a351d674a5d0, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:32.426310 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a1d4b-2f5d-4ae1-9889-d37f4a84cba2 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:32.440216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 527/1049] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:53:32 2021] PUT /identity/v3/projects/f4cd2fc1595c40a5a8f420862b7a5fab/users/e5f4549b47284153b493a351d674a5d0/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:53:34.596947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42160a8-a9f9-4bf5-aad0-966bfb0b5b21 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:34.597552 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42160a8-a9f9-4bf5-aad0-966bfb0b5b21 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:34.597552 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42160a8-a9f9-4bf5-aad0-966bfb0b5b21 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:34.599778 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 523/1050] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:34.605552 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fe4d2-58b3-4a72-8568-f24b4351d425 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:34.605975 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fe4d2-58b3-4a72-8568-f24b4351d425 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:34.606116 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fe4d2-58b3-4a72-8568-f24b4351d425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:34.624583 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-ca4fe4d2-58b3-4a72-8568-f24b4351d425 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:34.625771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ca4fe4d2-58b3-4a72-8568-f24b4351d425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:34.680519 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 528/1051] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:34.705858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42160a8-a9f9-4bf5-aad0-966bfb0b5b21 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:34.718198 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42160a8-a9f9-4bf5-aad0-966bfb0b5b21 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:34.722470 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b3544-54f2-44f7-8122-77eca8a06fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:34.723232 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b3544-54f2-44f7-8122-77eca8a06fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:34.723543 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b3544-54f2-44f7-8122-77eca8a06fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:34.723814 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b3544-54f2-44f7-8122-77eca8a06fe8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:34.733760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b3544-54f2-44f7-8122-77eca8a06fe8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:53:34.740343 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-616b3544-54f2-44f7-8122-77eca8a06fe8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:53:34.741454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 524/1052] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:53:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:34.748345 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fe4d2-58b3-4a72-8568-f24b4351d425 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:34.757186 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fe4d2-58b3-4a72-8568-f24b4351d425 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:34.761670 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53e214-f08c-45db-b557-d35058515644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:34.762319 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53e214-f08c-45db-b557-d35058515644 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:34.762603 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53e214-f08c-45db-b557-d35058515644 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:34.762877 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53e214-f08c-45db-b557-d35058515644 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:34.764392 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53e214-f08c-45db-b557-d35058515644 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:34.764746 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53e214-f08c-45db-b557-d35058515644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:34.766344 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53e214-f08c-45db-b557-d35058515644 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:34.774743 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 529/1053] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:53:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:34.782415 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b3544-54f2-44f7-8122-77eca8a06fe8 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:34.794815 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b3544-54f2-44f7-8122-77eca8a06fe8 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:34.799540 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d443061-38b0-4de8-97f3-d3c7ee8b85ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:34.800388 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d443061-38b0-4de8-97f3-d3c7ee8b85ee admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:34.800667 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d443061-38b0-4de8-97f3-d3c7ee8b85ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:34.800938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d443061-38b0-4de8-97f3-d3c7ee8b85ee admin admin] PATH_INFO: `/v3/users/e5f4549b47284153b493a351d674a5d0` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:34.802128 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d443061-38b0-4de8-97f3-d3c7ee8b85ee admin admin] RBAC: Authorizing `identity:get_user(user_id=e5f4549b47284153b493a351d674a5d0)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:34.804317 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d443061-38b0-4de8-97f3-d3c7ee8b85ee admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:34.805912 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 525/1054] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:53:34 2021] GET /identity/v3/users/e5f4549b47284153b493a351d674a5d0 => generated 286 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:34.812504 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53e214-f08c-45db-b557-d35058515644 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:34.821936 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53e214-f08c-45db-b557-d35058515644 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:34.826955 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48030df4-c4b7-4d07-9232-4264227f2282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:34.827623 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48030df4-c4b7-4d07-9232-4264227f2282 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:34.827904 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48030df4-c4b7-4d07-9232-4264227f2282 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:34.828178 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48030df4-c4b7-4d07-9232-4264227f2282 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:34.835564 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48030df4-c4b7-4d07-9232-4264227f2282 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:34.837283 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48030df4-c4b7-4d07-9232-4264227f2282 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:34.846618 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 530/1055] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:53:34 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:53:34.852820 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d443061-38b0-4de8-97f3-d3c7ee8b85ee admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:34.862197 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d443061-38b0-4de8-97f3-d3c7ee8b85ee admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:34.866612 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f731b98-1d7b-4ec2-93a0-9d975d05e036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:34.867463 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f731b98-1d7b-4ec2-93a0-9d975d05e036 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:34.867746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f731b98-1d7b-4ec2-93a0-9d975d05e036 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:34.868021 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f731b98-1d7b-4ec2-93a0-9d975d05e036 admin admin] PATH_INFO: `/v3/projects/f4cd2fc1595c40a5a8f420862b7a5fab` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:34.869164 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f731b98-1d7b-4ec2-93a0-9d975d05e036 admin admin] RBAC: Authorizing `identity:get_project(project_id=f4cd2fc1595c40a5a8f420862b7a5fab)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:34.871153 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f731b98-1d7b-4ec2-93a0-9d975d05e036 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:34.873102 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 526/1056] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:53:34 2021] GET /identity/v3/projects/f4cd2fc1595c40a5a8f420862b7a5fab => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:34.879357 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48030df4-c4b7-4d07-9232-4264227f2282 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:34.887672 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48030df4-c4b7-4d07-9232-4264227f2282 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:34.892749 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d61f16-9b23-4b8f-811b-3f53f4aed6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:34.893362 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d61f16-9b23-4b8f-811b-3f53f4aed6cd admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:34.893645 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d61f16-9b23-4b8f-811b-3f53f4aed6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:34.893922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d61f16-9b23-4b8f-811b-3f53f4aed6cd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:34.894715 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d61f16-9b23-4b8f-811b-3f53f4aed6cd admin admin] RBAC: Adding query filter params (role.id=99835eeda2f64af5bc9173a8370d4568, scope.project.id=f4cd2fc1595c40a5a8f420862b7a5fab, user.id=e5f4549b47284153b493a351d674a5d0) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:34.895024 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d61f16-9b23-4b8f-811b-3f53f4aed6cd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:34.896847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d61f16-9b23-4b8f-811b-3f53f4aed6cd admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:34.902302 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 531/1057] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:53:34 2021] GET /identity/v3/role_assignments?user.id=e5f4549b47284153b493a351d674a5d0&scope.project.id=f4cd2fc1595c40a5a8f420862b7a5fab&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:53:37.051979 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a86310-e1cb-48fb-b010-68662d6c9b19 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:37.052543 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a86310-e1cb-48fb-b010-68662d6c9b19 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:37.052543 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a86310-e1cb-48fb-b010-68662d6c9b19 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:37.054279 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 527/1058] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:37.060754 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ecbd4-2ef0-430a-beef-bc21fa2b0d0e None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:37.061183 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ecbd4-2ef0-430a-beef-bc21fa2b0d0e None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:37.061596 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ecbd4-2ef0-430a-beef-bc21fa2b0d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:37.078974 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-856ecbd4-2ef0-430a-beef-bc21fa2b0d0e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:37.080167 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-856ecbd4-2ef0-430a-beef-bc21fa2b0d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:37.087583 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 532/1059] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:37 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:37.111592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a86310-e1cb-48fb-b010-68662d6c9b19 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:37.124420 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a86310-e1cb-48fb-b010-68662d6c9b19 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:37.128684 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9489ef-ddfa-4b63-84c9-42084eb2010f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:37.129314 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9489ef-ddfa-4b63-84c9-42084eb2010f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:37.129597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9489ef-ddfa-4b63-84c9-42084eb2010f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:37.129875 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9489ef-ddfa-4b63-84c9-42084eb2010f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:37.137357 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9489ef-ddfa-4b63-84c9-42084eb2010f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:37.139159 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9489ef-ddfa-4b63-84c9-42084eb2010f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:37.147684 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 528/1060] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:53:37 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:53:37.154039 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ecbd4-2ef0-430a-beef-bc21fa2b0d0e None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:37.162763 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ecbd4-2ef0-430a-beef-bc21fa2b0d0e None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:37.167218 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a4b5c-7dea-4d82-a665-fe577f590b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:37.168023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a4b5c-7dea-4d82-a665-fe577f590b20 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:37.168306 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a4b5c-7dea-4d82-a665-fe577f590b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:37.168577 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a4b5c-7dea-4d82-a665-fe577f590b20 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:37.175821 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a4b5c-7dea-4d82-a665-fe577f590b20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:37.177642 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a4b5c-7dea-4d82-a665-fe577f590b20 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:37.192455 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-8f5a4b5c-7dea-4d82-a665-fe577f590b20 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 02:53:37.193555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 533/1061] 10.222.0.39 () {56 vars in 1139 bytes} [Tue Aug 31 02:53:37 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:37.199949 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9489ef-ddfa-4b63-84c9-42084eb2010f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:37.208636 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9489ef-ddfa-4b63-84c9-42084eb2010f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:37.213279 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f6bdf-f9ac-4012-a5d9-6c77172a8937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:37.213913 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f6bdf-f9ac-4012-a5d9-6c77172a8937 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:37.214197 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f6bdf-f9ac-4012-a5d9-6c77172a8937 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:37.214473 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f6bdf-f9ac-4012-a5d9-6c77172a8937 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:37.215177 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f6bdf-f9ac-4012-a5d9-6c77172a8937 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:37.215523 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f6bdf-f9ac-4012-a5d9-6c77172a8937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:37.217799 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f6bdf-f9ac-4012-a5d9-6c77172a8937 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:37.224909 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 529/1062] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Aug 31 02:53:37 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:39.355060 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4add1-249a-4976-8738-e8ae509b28a6 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:39.355708 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4add1-249a-4976-8738-e8ae509b28a6 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:39.355708 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4add1-249a-4976-8738-e8ae509b28a6 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:39.357392 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 534/1063] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:39.363482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d32a4-a4b7-4240-b6ea-172ca56638f2 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:39.363881 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d32a4-a4b7-4240-b6ea-172ca56638f2 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:39.364044 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d32a4-a4b7-4240-b6ea-172ca56638f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:39.381489 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-3e1d32a4-a4b7-4240-b6ea-172ca56638f2 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:39.382613 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-3e1d32a4-a4b7-4240-b6ea-172ca56638f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:39.390632 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 530/1064] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:39 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:39.414794 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4add1-249a-4976-8738-e8ae509b28a6 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:39.427198 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4add1-249a-4976-8738-e8ae509b28a6 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:39.431478 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f76f79-0408-4b6d-9bb9-bc1d80d78ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:39.432114 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f76f79-0408-4b6d-9bb9-bc1d80d78ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:39.432389 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f76f79-0408-4b6d-9bb9-bc1d80d78ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:39.432658 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f76f79-0408-4b6d-9bb9-bc1d80d78ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:39.433384 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f76f79-0408-4b6d-9bb9-bc1d80d78ec7 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:39.434426 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-a0f76f79-0408-4b6d-9bb9-bc1d80d78ec7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 02:53:39.434426 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 02:53:39.434426 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 02:53:39.435874 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f76f79-0408-4b6d-9bb9-bc1d80d78ec7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:39.449640 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 535/1065] 10.222.0.39 () {60 vars in 1160 bytes} [Tue Aug 31 02:53:39 2021] POST /identity/v3/domains => generated 267 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 02:53:41.607257 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8472aae-056d-4221-bbfd-1e0c6795309b None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:41.607850 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8472aae-056d-4221-bbfd-1e0c6795309b None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:41.607850 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8472aae-056d-4221-bbfd-1e0c6795309b None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:41.609612 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 531/1066] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:41.615470 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7a7e0-73e8-4952-b84a-1c7602c13df2 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:41.615895 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7a7e0-73e8-4952-b84a-1c7602c13df2 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:41.616002 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7a7e0-73e8-4952-b84a-1c7602c13df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:41.633523 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-85f7a7e0-73e8-4952-b84a-1c7602c13df2 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:41.634694 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-85f7a7e0-73e8-4952-b84a-1c7602c13df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:41.688990 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 536/1067] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:41 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:41.713863 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8472aae-056d-4221-bbfd-1e0c6795309b None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:41.726636 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8472aae-056d-4221-bbfd-1e0c6795309b None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:41.730951 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3129c-ca00-4f92-b3dd-7a0f3d684433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:41.731843 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3129c-ca00-4f92-b3dd-7a0f3d684433 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:41.732334 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3129c-ca00-4f92-b3dd-7a0f3d684433 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:41.732617 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3129c-ca00-4f92-b3dd-7a0f3d684433 admin admin] PATH_INFO: `/v3/domains/8a24f26005ad4ea8a2ac5726c63af169` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:41.742755 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3129c-ca00-4f92-b3dd-7a0f3d684433 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=8a24f26005ad4ea8a2ac5726c63af169)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:41.744737 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3129c-ca00-4f92-b3dd-7a0f3d684433 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:41.746295 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 532/1068] 10.222.0.39 () {56 vars in 1205 bytes} [Tue Aug 31 02:53:41 2021] GET /identity/v3/domains/8a24f26005ad4ea8a2ac5726c63af169 => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:41.753338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7a7e0-73e8-4952-b84a-1c7602c13df2 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:41.761999 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7a7e0-73e8-4952-b84a-1c7602c13df2 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:41.767110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e457dfe-ffb8-4d4a-adb7-6bbe16821157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:41.767790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e457dfe-ffb8-4d4a-adb7-6bbe16821157 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:41.768074 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e457dfe-ffb8-4d4a-adb7-6bbe16821157 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:41.768348 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e457dfe-ffb8-4d4a-adb7-6bbe16821157 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:41.769051 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e457dfe-ffb8-4d4a-adb7-6bbe16821157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:41.770944 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e457dfe-ffb8-4d4a-adb7-6bbe16821157 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:41.795060 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 537/1069] 10.222.0.39 () {60 vars in 1163 bytes} [Tue Aug 31 02:53:41 2021] POST /identity/v3/projects => generated 361 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:53:43.965508 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27400a45-22bf-4a5d-b662-e620980ae837 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:43.966041 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27400a45-22bf-4a5d-b662-e620980ae837 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:43.966041 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27400a45-22bf-4a5d-b662-e620980ae837 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:43.968471 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 533/1070] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:43.974442 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b69a7-198f-4c29-a31c-ce045328f951 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:43.974888 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b69a7-198f-4c29-a31c-ce045328f951 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:43.974988 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b69a7-198f-4c29-a31c-ce045328f951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:43.993199 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-e58b69a7-198f-4c29-a31c-ce045328f951 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:43.994362 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-e58b69a7-198f-4c29-a31c-ce045328f951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:44.050229 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 538/1071] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:43 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:44.075925 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27400a45-22bf-4a5d-b662-e620980ae837 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:44.087887 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27400a45-22bf-4a5d-b662-e620980ae837 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:44.092994 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8188c-b69c-4d8e-afb4-eaf50400c358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:44.093860 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8188c-b69c-4d8e-afb4-eaf50400c358 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:44.094137 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8188c-b69c-4d8e-afb4-eaf50400c358 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:44.094404 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8188c-b69c-4d8e-afb4-eaf50400c358 admin admin] PATH_INFO: `/v3/domains/8a24f26005ad4ea8a2ac5726c63af169` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:44.095588 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8188c-b69c-4d8e-afb4-eaf50400c358 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=8a24f26005ad4ea8a2ac5726c63af169)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:44.097542 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8188c-b69c-4d8e-afb4-eaf50400c358 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:44.099089 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 534/1072] 10.222.0.39 () {56 vars in 1205 bytes} [Tue Aug 31 02:53:44 2021] GET /identity/v3/domains/8a24f26005ad4ea8a2ac5726c63af169 => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:44.105075 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b69a7-198f-4c29-a31c-ce045328f951 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:44.114614 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b69a7-198f-4c29-a31c-ce045328f951 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:44.119284 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24320f-5432-493f-8cd5-d0f3577b3d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:44.119964 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24320f-5432-493f-8cd5-d0f3577b3d6d admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:44.120668 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24320f-5432-493f-8cd5-d0f3577b3d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:44.120668 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24320f-5432-493f-8cd5-d0f3577b3d6d admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:44.121210 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24320f-5432-493f-8cd5-d0f3577b3d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:44.123584 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24320f-5432-493f-8cd5-d0f3577b3d6d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:44.142888 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 539/1073] 10.222.0.39 () {60 vars in 1154 bytes} [Tue Aug 31 02:53:44 2021] POST /identity/v3/users => generated 311 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 02:53:46.326430 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2883ce-830c-46be-bbbb-40bb884e8ff3 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:46.327010 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2883ce-830c-46be-bbbb-40bb884e8ff3 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:46.327010 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2883ce-830c-46be-bbbb-40bb884e8ff3 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:46.328756 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 535/1074] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:46.334601 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5781a1d-71d6-47f3-9757-32fe04999543 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:46.335017 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5781a1d-71d6-47f3-9757-32fe04999543 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:46.335149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5781a1d-71d6-47f3-9757-32fe04999543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:46.352327 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-f5781a1d-71d6-47f3-9757-32fe04999543 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:46.353486 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f5781a1d-71d6-47f3-9757-32fe04999543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:46.361015 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 540/1075] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:46 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:46.385792 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2883ce-830c-46be-bbbb-40bb884e8ff3 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:46.398111 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2883ce-830c-46be-bbbb-40bb884e8ff3 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:46.402402 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0368289-ed87-4f00-aadc-fc2645765ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:46.403165 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0368289-ed87-4f00-aadc-fc2645765ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:46.403479 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0368289-ed87-4f00-aadc-fc2645765ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:46.403797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0368289-ed87-4f00-aadc-fc2645765ee1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:46.414026 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0368289-ed87-4f00-aadc-fc2645765ee1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:53:46.420729 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-c0368289-ed87-4f00-aadc-fc2645765ee1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:53:46.421839 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 536/1076] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:53:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:46.428153 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5781a1d-71d6-47f3-9757-32fe04999543 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:46.437467 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5781a1d-71d6-47f3-9757-32fe04999543 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:46.441975 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560a960-476e-4734-8cff-23ce90bc7a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:46.442622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560a960-476e-4734-8cff-23ce90bc7a40 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:46.442903 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560a960-476e-4734-8cff-23ce90bc7a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:46.443178 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560a960-476e-4734-8cff-23ce90bc7a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:46.443936 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560a960-476e-4734-8cff-23ce90bc7a40 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:46.444241 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560a960-476e-4734-8cff-23ce90bc7a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:46.445821 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560a960-476e-4734-8cff-23ce90bc7a40 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:46.454452 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 541/1077] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:53:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:46.460329 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0368289-ed87-4f00-aadc-fc2645765ee1 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:46.469516 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0368289-ed87-4f00-aadc-fc2645765ee1 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:46.473927 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a93096-da0d-4e02-a477-84824b954f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:46.474747 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a93096-da0d-4e02-a477-84824b954f93 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:46.475025 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a93096-da0d-4e02-a477-84824b954f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:46.475298 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a93096-da0d-4e02-a477-84824b954f93 admin admin] PATH_INFO: `/v3/users/57ef1ff7d6ce45fd875d7a5130169adb` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:46.488149 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a93096-da0d-4e02-a477-84824b954f93 admin admin] RBAC: Authorizing `identity:get_user(user_id=57ef1ff7d6ce45fd875d7a5130169adb)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:46.490235 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a93096-da0d-4e02-a477-84824b954f93 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:46.491833 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 537/1078] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:53:46 2021] GET /identity/v3/users/57ef1ff7d6ce45fd875d7a5130169adb => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:46.499134 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560a960-476e-4734-8cff-23ce90bc7a40 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:46.512029 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560a960-476e-4734-8cff-23ce90bc7a40 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:46.517612 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668b4fa-e795-432d-9d11-0df73f1d252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:46.518247 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668b4fa-e795-432d-9d11-0df73f1d252e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:46.518533 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668b4fa-e795-432d-9d11-0df73f1d252e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:46.518810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668b4fa-e795-432d-9d11-0df73f1d252e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:46.526364 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668b4fa-e795-432d-9d11-0df73f1d252e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:46.528297 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668b4fa-e795-432d-9d11-0df73f1d252e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:46.536911 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 542/1079] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:53:46 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:53:46.543537 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a93096-da0d-4e02-a477-84824b954f93 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:46.553145 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a93096-da0d-4e02-a477-84824b954f93 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:46.557597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f43af-c1a9-44e8-93ea-fe473d478c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:46.558428 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f43af-c1a9-44e8-93ea-fe473d478c7a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:46.558709 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f43af-c1a9-44e8-93ea-fe473d478c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:46.558985 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f43af-c1a9-44e8-93ea-fe473d478c7a admin admin] PATH_INFO: `/v3/projects/1f3ea0c6d9a844b497078df826fbafcd` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:46.560747 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f43af-c1a9-44e8-93ea-fe473d478c7a admin admin] RBAC: Authorizing `identity:get_project(project_id=1f3ea0c6d9a844b497078df826fbafcd)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:46.562746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f43af-c1a9-44e8-93ea-fe473d478c7a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:46.564405 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 538/1080] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:53:46 2021] GET /identity/v3/projects/1f3ea0c6d9a844b497078df826fbafcd => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:53:46.570498 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668b4fa-e795-432d-9d11-0df73f1d252e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:46.580121 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668b4fa-e795-432d-9d11-0df73f1d252e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:46.584538 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcef1de-2fe8-4922-adef-c2f47a1bb8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:46.585148 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcef1de-2fe8-4922-adef-c2f47a1bb8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:46.585428 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcef1de-2fe8-4922-adef-c2f47a1bb8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:46.585700 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcef1de-2fe8-4922-adef-c2f47a1bb8b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:46.586493 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcef1de-2fe8-4922-adef-c2f47a1bb8b1 admin admin] RBAC: Adding query filter params (role.id=99835eeda2f64af5bc9173a8370d4568, scope.project.id=1f3ea0c6d9a844b497078df826fbafcd, user.id=57ef1ff7d6ce45fd875d7a5130169adb) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:46.586799 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcef1de-2fe8-4922-adef-c2f47a1bb8b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:46.588620 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcef1de-2fe8-4922-adef-c2f47a1bb8b1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:46.595479 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 543/1081] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:53:46 2021] GET /identity/v3/role_assignments?user.id=57ef1ff7d6ce45fd875d7a5130169adb&scope.project.id=1f3ea0c6d9a844b497078df826fbafcd&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:48.739825 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b40b6-b9eb-49b7-b79e-84493394418e None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:48.740358 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b40b6-b9eb-49b7-b79e-84493394418e None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:48.740358 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b40b6-b9eb-49b7-b79e-84493394418e None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:48.742141 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 539/1082] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:48.748682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b342e-2854-476d-b75b-bf3ead2212af None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:48.749113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b342e-2854-476d-b75b-bf3ead2212af None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:48.749238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b342e-2854-476d-b75b-bf3ead2212af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:48.767009 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-477b342e-2854-476d-b75b-bf3ead2212af None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:48.768202 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-477b342e-2854-476d-b75b-bf3ead2212af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:48.775708 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 544/1083] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:48 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:48.799216 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b40b6-b9eb-49b7-b79e-84493394418e None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:48.811784 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b40b6-b9eb-49b7-b79e-84493394418e None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:48.816096 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd049651-4726-405f-8abd-0177aa9bdd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:48.816863 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd049651-4726-405f-8abd-0177aa9bdd1e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:48.817172 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd049651-4726-405f-8abd-0177aa9bdd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:48.817445 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd049651-4726-405f-8abd-0177aa9bdd1e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:48.827947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd049651-4726-405f-8abd-0177aa9bdd1e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:53:48.834665 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-fd049651-4726-405f-8abd-0177aa9bdd1e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:53:48.835826 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 540/1084] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:53:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:48.842301 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b342e-2854-476d-b75b-bf3ead2212af None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:48.851014 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b342e-2854-476d-b75b-bf3ead2212af None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:48.855542 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482802c-b872-4aaf-9705-94faa3d620de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:48.856189 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482802c-b872-4aaf-9705-94faa3d620de admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:48.856471 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482802c-b872-4aaf-9705-94faa3d620de admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:48.856744 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482802c-b872-4aaf-9705-94faa3d620de admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:48.858047 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482802c-b872-4aaf-9705-94faa3d620de admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:48.858348 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482802c-b872-4aaf-9705-94faa3d620de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:48.859969 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482802c-b872-4aaf-9705-94faa3d620de admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:48.867906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 545/1085] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:53:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:48.874855 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd049651-4726-405f-8abd-0177aa9bdd1e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:48.884515 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd049651-4726-405f-8abd-0177aa9bdd1e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:48.889006 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b97f0-c137-4063-bf94-fac1b5709b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:48.889821 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b97f0-c137-4063-bf94-fac1b5709b01 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:48.890095 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b97f0-c137-4063-bf94-fac1b5709b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:48.890364 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b97f0-c137-4063-bf94-fac1b5709b01 admin admin] PATH_INFO: `/v3/users/57ef1ff7d6ce45fd875d7a5130169adb` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:48.891542 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b97f0-c137-4063-bf94-fac1b5709b01 admin admin] RBAC: Authorizing `identity:get_user(user_id=57ef1ff7d6ce45fd875d7a5130169adb)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:48.893624 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b97f0-c137-4063-bf94-fac1b5709b01 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:48.895258 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 541/1086] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:53:48 2021] GET /identity/v3/users/57ef1ff7d6ce45fd875d7a5130169adb => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:53:48.900784 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482802c-b872-4aaf-9705-94faa3d620de admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:48.909895 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482802c-b872-4aaf-9705-94faa3d620de admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:48.914338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfdb65-bdf0-453e-8488-81574c549dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:48.915152 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfdb65-bdf0-453e-8488-81574c549dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:48.915462 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfdb65-bdf0-453e-8488-81574c549dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:48.915740 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfdb65-bdf0-453e-8488-81574c549dc1 admin admin] PATH_INFO: `/v3/projects/1f3ea0c6d9a844b497078df826fbafcd` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:48.916886 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfdb65-bdf0-453e-8488-81574c549dc1 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f3ea0c6d9a844b497078df826fbafcd)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:48.918872 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfdb65-bdf0-453e-8488-81574c549dc1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:48.921169 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 546/1087] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:53:48 2021] GET /identity/v3/projects/1f3ea0c6d9a844b497078df826fbafcd => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:48.927059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b97f0-c137-4063-bf94-fac1b5709b01 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:48.936568 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b97f0-c137-4063-bf94-fac1b5709b01 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:48.940897 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad291f-91fb-41bd-a6a1-7f714d442f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:48.941743 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad291f-91fb-41bd-a6a1-7f714d442f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:48.942019 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad291f-91fb-41bd-a6a1-7f714d442f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:48.942291 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad291f-91fb-41bd-a6a1-7f714d442f36 admin admin] PATH_INFO: `/v3/projects/1f3ea0c6d9a844b497078df826fbafcd/users/57ef1ff7d6ce45fd875d7a5130169adb/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:48.944198 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad291f-91fb-41bd-a6a1-7f714d442f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f3ea0c6d9a844b497078df826fbafcd, user_id=57ef1ff7d6ce45fd875d7a5130169adb, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:48.946749 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad291f-91fb-41bd-a6a1-7f714d442f36 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:48.959451 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 542/1088] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:53:48 2021] PUT /identity/v3/projects/1f3ea0c6d9a844b497078df826fbafcd/users/57ef1ff7d6ce45fd875d7a5130169adb/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 02:53:51.083559 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c0ec9-c645-47f6-82ec-9f78475c8495 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:51.084149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c0ec9-c645-47f6-82ec-9f78475c8495 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:51.084149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c0ec9-c645-47f6-82ec-9f78475c8495 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:51.085884 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 547/1089] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:53:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:53:51.091917 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeafda1-d092-441b-bc8f-1856a1db4c5f None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:51.092304 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeafda1-d092-441b-bc8f-1856a1db4c5f None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:51.092489 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeafda1-d092-441b-bc8f-1856a1db4c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:51.110917 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-6aeafda1-d092-441b-bc8f-1856a1db4c5f None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:53:51.112121 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-6aeafda1-d092-441b-bc8f-1856a1db4c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:53:51.166362 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 543/1090] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:53:51 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:53:51.192121 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c0ec9-c645-47f6-82ec-9f78475c8495 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:51.204006 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c0ec9-c645-47f6-82ec-9f78475c8495 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:51.208375 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba24d6-f3c2-468c-9072-71c23af4a25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:51.209146 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba24d6-f3c2-468c-9072-71c23af4a25d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:51.209429 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba24d6-f3c2-468c-9072-71c23af4a25d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:51.209700 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba24d6-f3c2-468c-9072-71c23af4a25d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:51.219708 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba24d6-f3c2-468c-9072-71c23af4a25d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:53:51.226429 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-c5ba24d6-f3c2-468c-9072-71c23af4a25d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:53:51.227585 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 548/1091] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:53:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:53:51.234521 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeafda1-d092-441b-bc8f-1856a1db4c5f None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:51.243209 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeafda1-d092-441b-bc8f-1856a1db4c5f None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:51.248771 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed7f38-f696-46ea-b521-e19a13ce7603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:51.249458 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed7f38-f696-46ea-b521-e19a13ce7603 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:51.249742 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed7f38-f696-46ea-b521-e19a13ce7603 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:51.250016 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed7f38-f696-46ea-b521-e19a13ce7603 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:51.250757 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed7f38-f696-46ea-b521-e19a13ce7603 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:51.251062 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed7f38-f696-46ea-b521-e19a13ce7603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:51.252687 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed7f38-f696-46ea-b521-e19a13ce7603 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:51.260828 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 544/1092] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:53:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:53:51.267276 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba24d6-f3c2-468c-9072-71c23af4a25d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:51.277376 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba24d6-f3c2-468c-9072-71c23af4a25d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:51.281950 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a880ee5-758b-4951-beb0-a6c9353a16e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:51.282794 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a880ee5-758b-4951-beb0-a6c9353a16e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:51.283079 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a880ee5-758b-4951-beb0-a6c9353a16e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:51.283349 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a880ee5-758b-4951-beb0-a6c9353a16e7 admin admin] PATH_INFO: `/v3/users/57ef1ff7d6ce45fd875d7a5130169adb` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:51.284538 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a880ee5-758b-4951-beb0-a6c9353a16e7 admin admin] RBAC: Authorizing `identity:get_user(user_id=57ef1ff7d6ce45fd875d7a5130169adb)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:51.286650 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a880ee5-758b-4951-beb0-a6c9353a16e7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:51.288246 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 549/1093] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:53:51 2021] GET /identity/v3/users/57ef1ff7d6ce45fd875d7a5130169adb => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:51.294161 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed7f38-f696-46ea-b521-e19a13ce7603 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:51.303944 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed7f38-f696-46ea-b521-e19a13ce7603 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:51.308345 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbddcd-5d08-45ed-a257-bd5cc7ae2e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:51.308962 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbddcd-5d08-45ed-a257-bd5cc7ae2e29 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:51.309240 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbddcd-5d08-45ed-a257-bd5cc7ae2e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:51.309509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbddcd-5d08-45ed-a257-bd5cc7ae2e29 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:51.317442 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbddcd-5d08-45ed-a257-bd5cc7ae2e29 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:51.319134 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbddcd-5d08-45ed-a257-bd5cc7ae2e29 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:51.327660 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 545/1094] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:53:51 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:53:51.333906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a880ee5-758b-4951-beb0-a6c9353a16e7 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:51.343146 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a880ee5-758b-4951-beb0-a6c9353a16e7 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:51.347691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed31c1c9-cc08-4b84-a2c7-e6cc5026bdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:51.348503 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31c1c9-cc08-4b84-a2c7-e6cc5026bdb0 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:51.348785 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31c1c9-cc08-4b84-a2c7-e6cc5026bdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:51.349062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31c1c9-cc08-4b84-a2c7-e6cc5026bdb0 admin admin] PATH_INFO: `/v3/projects/1f3ea0c6d9a844b497078df826fbafcd` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:51.350205 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31c1c9-cc08-4b84-a2c7-e6cc5026bdb0 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f3ea0c6d9a844b497078df826fbafcd)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:51.352240 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed31c1c9-cc08-4b84-a2c7-e6cc5026bdb0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:51.353832 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 550/1095] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:53:51 2021] GET /identity/v3/projects/1f3ea0c6d9a844b497078df826fbafcd => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:53:51.360618 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbddcd-5d08-45ed-a257-bd5cc7ae2e29 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:53:51.369042 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbddcd-5d08-45ed-a257-bd5cc7ae2e29 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:53:51.374449 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8799ae0-2aa0-4d99-8c8a-259c0f2466d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:53:51.375052 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8799ae0-2aa0-4d99-8c8a-259c0f2466d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:53:51.375335 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8799ae0-2aa0-4d99-8c8a-259c0f2466d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:53:51.375639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8799ae0-2aa0-4d99-8c8a-259c0f2466d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:53:51.376441 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8799ae0-2aa0-4d99-8c8a-259c0f2466d1 admin admin] RBAC: Adding query filter params (role.id=99835eeda2f64af5bc9173a8370d4568, scope.project.id=1f3ea0c6d9a844b497078df826fbafcd, user.id=57ef1ff7d6ce45fd875d7a5130169adb) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:53:51.376748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8799ae0-2aa0-4d99-8c8a-259c0f2466d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:53:51.378529 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8799ae0-2aa0-4d99-8c8a-259c0f2466d1 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:53:51.384029 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 546/1096] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:53:51 2021] GET /identity/v3/role_assignments?user.id=57ef1ff7d6ce45fd875d7a5130169adb&scope.project.id=1f3ea0c6d9a844b497078df826fbafcd&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:54:46.613486 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f53ca-d225-4757-b598-254bcae9aa46 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:46.614107 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f53ca-d225-4757-b598-254bcae9aa46 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:46.614107 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f53ca-d225-4757-b598-254bcae9aa46 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:46.615909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 551/1097] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:54:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:54:46.624038 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c7f64-918c-496b-b9ee-3fcb1f212c6c None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:46.624627 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c7f64-918c-496b-b9ee-3fcb1f212c6c None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:46.624731 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c7f64-918c-496b-b9ee-3fcb1f212c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:46.643751 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-d44c7f64-918c-496b-b9ee-3fcb1f212c6c None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:54:46.644976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d44c7f64-918c-496b-b9ee-3fcb1f212c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:54:46.663593 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 547/1098] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:54:46 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:54:46.681624 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f53ca-d225-4757-b598-254bcae9aa46 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:46.703100 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f53ca-d225-4757-b598-254bcae9aa46 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:46.712471 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68e309-d29c-4042-9d4b-2120b537ecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:46.713498 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68e309-d29c-4042-9d4b-2120b537ecad admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:46.713778 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68e309-d29c-4042-9d4b-2120b537ecad admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:46.714171 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68e309-d29c-4042-9d4b-2120b537ecad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:46.728243 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68e309-d29c-4042-9d4b-2120b537ecad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:46.730493 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68e309-d29c-4042-9d4b-2120b537ecad admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:46.752205 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-ce68e309-d29c-4042-9d4b-2120b537ecad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:54:46.753558 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 552/1099] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:54:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:54:46.760717 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c7f64-918c-496b-b9ee-3fcb1f212c6c None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:46.770525 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c7f64-918c-496b-b9ee-3fcb1f212c6c None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:46.776373 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5edadc-ee74-4fe2-9790-b55dc88de547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:46.777138 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5edadc-ee74-4fe2-9790-b55dc88de547 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:46.777604 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5edadc-ee74-4fe2-9790-b55dc88de547 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:46.778529 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5edadc-ee74-4fe2-9790-b55dc88de547 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:46.779722 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5edadc-ee74-4fe2-9790-b55dc88de547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:46.780105 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5edadc-ee74-4fe2-9790-b55dc88de547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:46.781955 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5edadc-ee74-4fe2-9790-b55dc88de547 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:46.803450 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 548/1100] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:54:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:54:46.806599 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68e309-d29c-4042-9d4b-2120b537ecad admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:46.825771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68e309-d29c-4042-9d4b-2120b537ecad admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:46.839219 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35849f-a162-4154-a6d2-44ac5a03e12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:46.840376 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35849f-a162-4154-a6d2-44ac5a03e12b admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:46.840924 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35849f-a162-4154-a6d2-44ac5a03e12b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:46.841442 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35849f-a162-4154-a6d2-44ac5a03e12b admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:46.842678 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35849f-a162-4154-a6d2-44ac5a03e12b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:46.845647 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35849f-a162-4154-a6d2-44ac5a03e12b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:46.883497 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 553/1101] 10.222.0.39 () {60 vars in 1154 bytes} [Tue Aug 31 02:54:46 2021] POST /identity/v3/users => generated 251 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:54:49.632562 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaf16c-ddbe-499a-84fc-3107ee8f4142 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:49.633118 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaf16c-ddbe-499a-84fc-3107ee8f4142 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:49.633118 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaf16c-ddbe-499a-84fc-3107ee8f4142 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:49.634897 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 549/1102] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:54:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:54:49.641345 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bbb2f-609f-49d1-9be4-87ee80116aa1 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:49.642771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bbb2f-609f-49d1-9be4-87ee80116aa1 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:49.642771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bbb2f-609f-49d1-9be4-87ee80116aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:49.662178 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-902bbb2f-609f-49d1-9be4-87ee80116aa1 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:54:49.663402 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-902bbb2f-609f-49d1-9be4-87ee80116aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:54:49.672419 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 554/1103] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:54:49 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:54:49.700374 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaf16c-ddbe-499a-84fc-3107ee8f4142 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:49.713575 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaf16c-ddbe-499a-84fc-3107ee8f4142 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:49.723454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede23a34-cfd6-4a5f-8169-2003e0c15073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:49.724418 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede23a34-cfd6-4a5f-8169-2003e0c15073 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:49.724723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede23a34-cfd6-4a5f-8169-2003e0c15073 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:49.725065 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede23a34-cfd6-4a5f-8169-2003e0c15073 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:49.737477 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede23a34-cfd6-4a5f-8169-2003e0c15073 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:54:49.745509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-ede23a34-cfd6-4a5f-8169-2003e0c15073 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:54:49.746956 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 550/1104] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:54:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:54:49.754475 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bbb2f-609f-49d1-9be4-87ee80116aa1 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:49.765091 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bbb2f-609f-49d1-9be4-87ee80116aa1 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:49.770199 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2d16c-5f7f-4033-9809-0faf7487e7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:49.771415 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2d16c-5f7f-4033-9809-0faf7487e7fa admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:49.771415 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2d16c-5f7f-4033-9809-0faf7487e7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:49.771608 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2d16c-5f7f-4033-9809-0faf7487e7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:49.772518 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2d16c-5f7f-4033-9809-0faf7487e7fa admin admin] RBAC: Adding query filter params (name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:49.772865 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2d16c-5f7f-4033-9809-0faf7487e7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:49.774690 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2d16c-5f7f-4033-9809-0faf7487e7fa admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:49.785051 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 555/1105] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:54:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:54:49.791325 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede23a34-cfd6-4a5f-8169-2003e0c15073 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:49.804700 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede23a34-cfd6-4a5f-8169-2003e0c15073 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:49.809840 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee50920-525d-4b82-8d63-bc03469c19ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:49.810664 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee50920-525d-4b82-8d63-bc03469c19ee admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:49.810949 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee50920-525d-4b82-8d63-bc03469c19ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:49.811317 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee50920-525d-4b82-8d63-bc03469c19ee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:49.822516 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee50920-525d-4b82-8d63-bc03469c19ee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:49.825610 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee50920-525d-4b82-8d63-bc03469c19ee admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:49.844995 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-fee50920-525d-4b82-8d63-bc03469c19ee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:54:49.846247 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 551/1106] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:54:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:54:49.852956 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2d16c-5f7f-4033-9809-0faf7487e7fa admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:49.864690 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2d16c-5f7f-4033-9809-0faf7487e7fa admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:49.872197 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b33e8a-2e8f-4e6d-9cc2-001e1aa1a034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:49.873708 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b33e8a-2e8f-4e6d-9cc2-001e1aa1a034 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:49.874023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b33e8a-2e8f-4e6d-9cc2-001e1aa1a034 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:49.874339 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b33e8a-2e8f-4e6d-9cc2-001e1aa1a034 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:49.875060 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b33e8a-2e8f-4e6d-9cc2-001e1aa1a034 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:49.875391 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b33e8a-2e8f-4e6d-9cc2-001e1aa1a034 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:49.876997 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b33e8a-2e8f-4e6d-9cc2-001e1aa1a034 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:49.892407 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 556/1107] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:54:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:54:49.899198 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee50920-525d-4b82-8d63-bc03469c19ee admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:49.910013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee50920-525d-4b82-8d63-bc03469c19ee admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:49.915093 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d848ab-08e9-4d03-96ae-1bd5c80244a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:49.915924 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d848ab-08e9-4d03-96ae-1bd5c80244a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:49.916205 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d848ab-08e9-4d03-96ae-1bd5c80244a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:49.916480 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d848ab-08e9-4d03-96ae-1bd5c80244a4 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:49.925572 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d848ab-08e9-4d03-96ae-1bd5c80244a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:49.927760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d848ab-08e9-4d03-96ae-1bd5c80244a4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:49.942823 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-e8d848ab-08e9-4d03-96ae-1bd5c80244a4 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 02:54:49.949100 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 552/1108] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:54:49 2021] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:54:49.951251 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b33e8a-2e8f-4e6d-9cc2-001e1aa1a034 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:49.961555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b33e8a-2e8f-4e6d-9cc2-001e1aa1a034 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:49.967763 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad7d33-f160-4b04-9785-6c331ef5a226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:49.968599 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad7d33-f160-4b04-9785-6c331ef5a226 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:49.968984 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad7d33-f160-4b04-9785-6c331ef5a226 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:49.969241 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad7d33-f160-4b04-9785-6c331ef5a226 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:49.970148 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad7d33-f160-4b04-9785-6c331ef5a226 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:49.970460 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad7d33-f160-4b04-9785-6c331ef5a226 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:49.972461 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad7d33-f160-4b04-9785-6c331ef5a226 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:49.992186 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 557/1109] 10.222.0.39 () {56 vars in 1165 bytes} [Tue Aug 31 02:54:49 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:54:49.999785 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d848ab-08e9-4d03-96ae-1bd5c80244a4 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:50.011864 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d848ab-08e9-4d03-96ae-1bd5c80244a4 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:50.018023 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b527a-c596-4eef-b013-c8b15f6553e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:50.018696 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b527a-c596-4eef-b013-c8b15f6553e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:50.019013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b527a-c596-4eef-b013-c8b15f6553e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:50.019315 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b527a-c596-4eef-b013-c8b15f6553e9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:50.028501 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b527a-c596-4eef-b013-c8b15f6553e9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:50.030506 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b527a-c596-4eef-b013-c8b15f6553e9 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:50.041411 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 553/1110] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:54:49 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:54:50.048586 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad7d33-f160-4b04-9785-6c331ef5a226 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:50.058909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad7d33-f160-4b04-9785-6c331ef5a226 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:50.064906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2824b0-acb5-45f6-9272-e120c684a686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:50.065768 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2824b0-acb5-45f6-9272-e120c684a686 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:50.066056 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2824b0-acb5-45f6-9272-e120c684a686 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:50.066335 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2824b0-acb5-45f6-9272-e120c684a686 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:50.077348 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2824b0-acb5-45f6-9272-e120c684a686 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:50.079696 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2824b0-acb5-45f6-9272-e120c684a686 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:50.098994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-0f2824b0-acb5-45f6-9272-e120c684a686 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:54:50.100189 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 558/1111] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:54:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:54:50.107738 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b527a-c596-4eef-b013-c8b15f6553e9 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:50.117217 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b527a-c596-4eef-b013-c8b15f6553e9 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:50.123416 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bc09c-6a3c-409b-a63e-ce78efc93649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:50.124330 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bc09c-6a3c-409b-a63e-ce78efc93649 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:50.124857 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bc09c-6a3c-409b-a63e-ce78efc93649 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:50.125959 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bc09c-6a3c-409b-a63e-ce78efc93649 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:50.126673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bc09c-6a3c-409b-a63e-ce78efc93649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:50.126996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bc09c-6a3c-409b-a63e-ce78efc93649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:50.128644 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bc09c-6a3c-409b-a63e-ce78efc93649 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:50.140296 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 554/1112] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:54:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:54:50.147151 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2824b0-acb5-45f6-9272-e120c684a686 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:50.157341 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2824b0-acb5-45f6-9272-e120c684a686 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:50.162463 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ad1ee-d0a0-4c4d-90af-5ff24861cbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:50.163493 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ad1ee-d0a0-4c4d-90af-5ff24861cbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:50.163939 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ad1ee-d0a0-4c4d-90af-5ff24861cbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:50.164355 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ad1ee-d0a0-4c4d-90af-5ff24861cbf3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:50.172554 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ad1ee-d0a0-4c4d-90af-5ff24861cbf3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:50.174714 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ad1ee-d0a0-4c4d-90af-5ff24861cbf3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:50.190115 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-911ad1ee-d0a0-4c4d-90af-5ff24861cbf3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:54:50.191567 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 559/1113] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:54:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:54:50.198868 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bc09c-6a3c-409b-a63e-ce78efc93649 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:50.210113 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bc09c-6a3c-409b-a63e-ce78efc93649 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:50.214855 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2b238-ab53-4384-8180-e7f1a353029c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:50.216166 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2b238-ab53-4384-8180-e7f1a353029c admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:50.216523 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2b238-ab53-4384-8180-e7f1a353029c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:50.216869 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2b238-ab53-4384-8180-e7f1a353029c admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:50.217691 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2b238-ab53-4384-8180-e7f1a353029c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:50.218007 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2b238-ab53-4384-8180-e7f1a353029c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:50.219880 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2b238-ab53-4384-8180-e7f1a353029c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:50.232920 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 555/1114] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:54:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:54:50.239788 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ad1ee-d0a0-4c4d-90af-5ff24861cbf3 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:50.255082 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ad1ee-d0a0-4c4d-90af-5ff24861cbf3 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:50.261017 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7782e8-ba21-411d-ac92-6999e6d03bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:50.262970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7782e8-ba21-411d-ac92-6999e6d03bed admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:50.263758 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7782e8-ba21-411d-ac92-6999e6d03bed admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:50.264284 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7782e8-ba21-411d-ac92-6999e6d03bed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:50.265190 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7782e8-ba21-411d-ac92-6999e6d03bed admin admin] RBAC: Adding query filter params (role.id=ee8894ccdace402484c35b0cb5292526, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=bbcf0359f8bc4f55be3307f235f8aac5) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:50.265506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7782e8-ba21-411d-ac92-6999e6d03bed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:50.268481 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7782e8-ba21-411d-ac92-6999e6d03bed admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:50.283399 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 560/1115] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:54:50 2021] GET /identity/v3/role_assignments?user.id=bbcf0359f8bc4f55be3307f235f8aac5&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=ee8894ccdace402484c35b0cb5292526 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:54:52.535145 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0320e39-ae78-4092-8697-d1ba11a3b767 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:52.535755 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0320e39-ae78-4092-8697-d1ba11a3b767 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:52.535755 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0320e39-ae78-4092-8697-d1ba11a3b767 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:52.537765 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 556/1116] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:54:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:54:52.544365 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084267d7-f85f-4fc5-8604-1f167a75adfb None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:52.544787 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084267d7-f85f-4fc5-8604-1f167a75adfb None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:52.544928 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084267d7-f85f-4fc5-8604-1f167a75adfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:52.563480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-084267d7-f85f-4fc5-8604-1f167a75adfb None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:54:52.564674 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-084267d7-f85f-4fc5-8604-1f167a75adfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:54:52.572246 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 561/1117] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:54:52 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:54:52.599532 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0320e39-ae78-4092-8697-d1ba11a3b767 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:52.614974 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0320e39-ae78-4092-8697-d1ba11a3b767 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:52.620413 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648d4e9-06e1-4f74-bf49-f8ee0316655c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:52.621270 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648d4e9-06e1-4f74-bf49-f8ee0316655c admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:52.621626 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648d4e9-06e1-4f74-bf49-f8ee0316655c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:52.621894 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648d4e9-06e1-4f74-bf49-f8ee0316655c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:52.632850 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648d4e9-06e1-4f74-bf49-f8ee0316655c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:54:52.640205 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-e648d4e9-06e1-4f74-bf49-f8ee0316655c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:54:52.641387 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 557/1118] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:54:52 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:54:52.648171 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084267d7-f85f-4fc5-8604-1f167a75adfb None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:52.658618 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084267d7-f85f-4fc5-8604-1f167a75adfb None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:52.663607 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de041e3-b79c-440f-b79f-9c6e121b66d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:52.664400 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de041e3-b79c-440f-b79f-9c6e121b66d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:52.664683 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de041e3-b79c-440f-b79f-9c6e121b66d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:52.664954 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de041e3-b79c-440f-b79f-9c6e121b66d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:52.665691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de041e3-b79c-440f-b79f-9c6e121b66d7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:52.665990 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de041e3-b79c-440f-b79f-9c6e121b66d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:52.668441 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de041e3-b79c-440f-b79f-9c6e121b66d7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:52.676845 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 562/1119] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:54:52 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:54:52.683463 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648d4e9-06e1-4f74-bf49-f8ee0316655c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:52.694219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648d4e9-06e1-4f74-bf49-f8ee0316655c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:52.699461 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e17359-cfd1-4100-b472-6a646ba6de17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:52.701034 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e17359-cfd1-4100-b472-6a646ba6de17 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:52.701318 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e17359-cfd1-4100-b472-6a646ba6de17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:52.701590 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e17359-cfd1-4100-b472-6a646ba6de17 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:52.716300 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e17359-cfd1-4100-b472-6a646ba6de17 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:52.718432 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e17359-cfd1-4100-b472-6a646ba6de17 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:52.737038 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-b4e17359-cfd1-4100-b472-6a646ba6de17 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:54:52.738338 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 558/1120] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:54:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:54:52.744804 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de041e3-b79c-440f-b79f-9c6e121b66d7 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:52.756469 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de041e3-b79c-440f-b79f-9c6e121b66d7 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:52.761260 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c19a5d-11cf-4683-a9c2-9ea3202155c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:52.761984 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c19a5d-11cf-4683-a9c2-9ea3202155c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:52.762933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c19a5d-11cf-4683-a9c2-9ea3202155c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:52.763340 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c19a5d-11cf-4683-a9c2-9ea3202155c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:52.764106 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c19a5d-11cf-4683-a9c2-9ea3202155c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:52.764440 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c19a5d-11cf-4683-a9c2-9ea3202155c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:52.766280 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c19a5d-11cf-4683-a9c2-9ea3202155c6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:52.785555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 563/1121] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:54:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:54:52.788497 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e17359-cfd1-4100-b472-6a646ba6de17 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:52.798526 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e17359-cfd1-4100-b472-6a646ba6de17 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:52.802958 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d757700-af1b-406c-899a-ba05e7d6f87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:52.803811 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d757700-af1b-406c-899a-ba05e7d6f87c admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:52.804087 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d757700-af1b-406c-899a-ba05e7d6f87c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:52.804355 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d757700-af1b-406c-899a-ba05e7d6f87c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:52.812048 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d757700-af1b-406c-899a-ba05e7d6f87c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:52.814056 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d757700-af1b-406c-899a-ba05e7d6f87c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:52.830367 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-1d757700-af1b-406c-899a-ba05e7d6f87c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 02:54:52.831644 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 559/1122] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:54:52 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:54:52.838022 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c19a5d-11cf-4683-a9c2-9ea3202155c6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:52.848224 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c19a5d-11cf-4683-a9c2-9ea3202155c6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:52.852861 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aa2a2-96d3-435c-9d5f-8aa56cb35fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:52.853521 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aa2a2-96d3-435c-9d5f-8aa56cb35fca admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:52.853809 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aa2a2-96d3-435c-9d5f-8aa56cb35fca admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:52.854076 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aa2a2-96d3-435c-9d5f-8aa56cb35fca admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:52.854896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1aa2a2-96d3-435c-9d5f-8aa56cb35fca admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:52.855200 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1aa2a2-96d3-435c-9d5f-8aa56cb35fca admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:52.857316 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1aa2a2-96d3-435c-9d5f-8aa56cb35fca admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:52.875256 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 564/1123] 10.222.0.39 () {56 vars in 1165 bytes} [Tue Aug 31 02:54:52 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:54:52.881796 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d757700-af1b-406c-899a-ba05e7d6f87c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:52.893034 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d757700-af1b-406c-899a-ba05e7d6f87c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:52.898017 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f3b80-b8e4-4854-8a47-2d7aebadf1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:52.898893 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f3b80-b8e4-4854-8a47-2d7aebadf1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:52.899201 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f3b80-b8e4-4854-8a47-2d7aebadf1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:52.899566 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f3b80-b8e4-4854-8a47-2d7aebadf1b0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:52.910949 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f3b80-b8e4-4854-8a47-2d7aebadf1b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:52.912939 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f3b80-b8e4-4854-8a47-2d7aebadf1b0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:52.930848 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-f89f3b80-b8e4-4854-8a47-2d7aebadf1b0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:54:52.932060 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 560/1124] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:54:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:54:52.939279 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aa2a2-96d3-435c-9d5f-8aa56cb35fca admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:52.950377 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aa2a2-96d3-435c-9d5f-8aa56cb35fca admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:52.955650 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74da74a-5ea9-4ffb-8736-d11fc5e76d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:52.956368 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74da74a-5ea9-4ffb-8736-d11fc5e76d10 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:52.956652 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74da74a-5ea9-4ffb-8736-d11fc5e76d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:52.956933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74da74a-5ea9-4ffb-8736-d11fc5e76d10 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:52.957664 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74da74a-5ea9-4ffb-8736-d11fc5e76d10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:52.957968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74da74a-5ea9-4ffb-8736-d11fc5e76d10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:52.959677 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74da74a-5ea9-4ffb-8736-d11fc5e76d10 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:52.972138 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 565/1125] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:54:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:54:52.978746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f3b80-b8e4-4854-8a47-2d7aebadf1b0 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:52.989618 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f3b80-b8e4-4854-8a47-2d7aebadf1b0 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:52.994763 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9e513-bb91-405c-b87d-bfb19a996093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:52.995577 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9e513-bb91-405c-b87d-bfb19a996093 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:52.995849 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9e513-bb91-405c-b87d-bfb19a996093 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:52.996119 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9e513-bb91-405c-b87d-bfb19a996093 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:53.003265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9e513-bb91-405c-b87d-bfb19a996093 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:53.005328 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9e513-bb91-405c-b87d-bfb19a996093 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:53.018685 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-a5b9e513-bb91-405c-b87d-bfb19a996093 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:54:53.019885 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 561/1126] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:54:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:54:53.026767 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74da74a-5ea9-4ffb-8736-d11fc5e76d10 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:53.038659 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74da74a-5ea9-4ffb-8736-d11fc5e76d10 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:53.043996 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55461880-2900-4dfd-8782-4201498d55e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:53.044676 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55461880-2900-4dfd-8782-4201498d55e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:53.044956 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55461880-2900-4dfd-8782-4201498d55e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:53.045231 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55461880-2900-4dfd-8782-4201498d55e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:53.046009 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55461880-2900-4dfd-8782-4201498d55e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:53.046314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55461880-2900-4dfd-8782-4201498d55e3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:53.048221 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55461880-2900-4dfd-8782-4201498d55e3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:53.060527 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 566/1127] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:54:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:54:53.067357 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9e513-bb91-405c-b87d-bfb19a996093 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:53.078424 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9e513-bb91-405c-b87d-bfb19a996093 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:53.083507 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bee04-8aa5-454f-98e4-e2b8012255c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:53.084780 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bee04-8aa5-454f-98e4-e2b8012255c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:53.085127 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bee04-8aa5-454f-98e4-e2b8012255c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:53.085561 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bee04-8aa5-454f-98e4-e2b8012255c0 admin admin] PATH_INFO: `/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/bbcf0359f8bc4f55be3307f235f8aac5/roles/ee8894ccdace402484c35b0cb5292526` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:53.102603 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bee04-8aa5-454f-98e4-e2b8012255c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011ec8d2410644a3b7d51a90f803b441, user_id=bbcf0359f8bc4f55be3307f235f8aac5, role_id=ee8894ccdace402484c35b0cb5292526)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:53.105664 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bee04-8aa5-454f-98e4-e2b8012255c0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:53.120847 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 562/1128] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:54:53 2021] PUT /identity/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/bbcf0359f8bc4f55be3307f235f8aac5/roles/ee8894ccdace402484c35b0cb5292526 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:54:55.785138 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d0beb-c68d-4f6d-a40e-7c7f4e67b841 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:55.786019 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d0beb-c68d-4f6d-a40e-7c7f4e67b841 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:55.786019 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d0beb-c68d-4f6d-a40e-7c7f4e67b841 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:55.787425 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 567/1129] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:54:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:54:55.793702 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363a062-4014-4168-a7df-c5a29ca491d8 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:55.794242 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363a062-4014-4168-a7df-c5a29ca491d8 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:55.794242 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363a062-4014-4168-a7df-c5a29ca491d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:55.815572 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-0363a062-4014-4168-a7df-c5a29ca491d8 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:54:55.816804 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0363a062-4014-4168-a7df-c5a29ca491d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:54:55.876968 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 563/1130] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:54:55 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:54:55.902128 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d0beb-c68d-4f6d-a40e-7c7f4e67b841 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:55.914563 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d0beb-c68d-4f6d-a40e-7c7f4e67b841 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:55.919286 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939df91-930a-439d-b047-7c1016417602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:55.920127 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939df91-930a-439d-b047-7c1016417602 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:55.920411 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939df91-930a-439d-b047-7c1016417602 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:55.920689 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939df91-930a-439d-b047-7c1016417602 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:55.931130 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939df91-930a-439d-b047-7c1016417602 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:54:55.938549 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-8939df91-930a-439d-b047-7c1016417602 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 02:54:55.939755 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 568/1131] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Aug 31 02:54:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:54:55.946439 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363a062-4014-4168-a7df-c5a29ca491d8 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:55.955899 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363a062-4014-4168-a7df-c5a29ca491d8 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:55.961140 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a059aff-cc20-4a30-b882-600290b7fd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:55.961928 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a059aff-cc20-4a30-b882-600290b7fd50 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:55.962210 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a059aff-cc20-4a30-b882-600290b7fd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:55.962615 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a059aff-cc20-4a30-b882-600290b7fd50 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:55.963560 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a059aff-cc20-4a30-b882-600290b7fd50 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:55.963911 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a059aff-cc20-4a30-b882-600290b7fd50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:55.965527 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a059aff-cc20-4a30-b882-600290b7fd50 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:55.975057 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 564/1132] 10.222.0.39 () {56 vars in 1125 bytes} [Tue Aug 31 02:54:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:54:55.981454 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939df91-930a-439d-b047-7c1016417602 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:55.991852 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939df91-930a-439d-b047-7c1016417602 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:55.997050 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe2d0d-b720-4a70-86f6-3f89f9b26d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:55.997903 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe2d0d-b720-4a70-86f6-3f89f9b26d93 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:55.998440 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe2d0d-b720-4a70-86f6-3f89f9b26d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:55.998714 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe2d0d-b720-4a70-86f6-3f89f9b26d93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:56.009814 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe2d0d-b720-4a70-86f6-3f89f9b26d93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:56.011681 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe2d0d-b720-4a70-86f6-3f89f9b26d93 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:56.029261 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-1cfe2d0d-b720-4a70-86f6-3f89f9b26d93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:54:56.030458 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 569/1133] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:54:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:54:56.036938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a059aff-cc20-4a30-b882-600290b7fd50 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:56.049272 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a059aff-cc20-4a30-b882-600290b7fd50 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:56.053987 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7056d54-743c-41b6-b989-2841e2db0c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:56.054626 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7056d54-743c-41b6-b989-2841e2db0c61 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:56.054902 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7056d54-743c-41b6-b989-2841e2db0c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:56.055172 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7056d54-743c-41b6-b989-2841e2db0c61 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:56.055910 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7056d54-743c-41b6-b989-2841e2db0c61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:56.056208 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7056d54-743c-41b6-b989-2841e2db0c61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:56.057775 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7056d54-743c-41b6-b989-2841e2db0c61 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:56.072304 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 565/1134] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:54:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:54:56.079027 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe2d0d-b720-4a70-86f6-3f89f9b26d93 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:56.090025 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe2d0d-b720-4a70-86f6-3f89f9b26d93 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:56.094719 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e84deb-3ad6-4b10-831c-240c4404de00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:56.095540 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e84deb-3ad6-4b10-831c-240c4404de00 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:56.095822 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e84deb-3ad6-4b10-831c-240c4404de00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:56.096094 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e84deb-3ad6-4b10-831c-240c4404de00 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:56.104801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e84deb-3ad6-4b10-831c-240c4404de00 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:56.107376 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e84deb-3ad6-4b10-831c-240c4404de00 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:56.124692 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-51e84deb-3ad6-4b10-831c-240c4404de00 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 02:54:56.126253 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 570/1135] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:54:56 2021] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:54:56.134385 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7056d54-743c-41b6-b989-2841e2db0c61 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:56.146998 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7056d54-743c-41b6-b989-2841e2db0c61 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:56.152946 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606ef62-3506-48d0-b790-813a889d4edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:56.153770 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606ef62-3506-48d0-b790-813a889d4edd admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:56.154053 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606ef62-3506-48d0-b790-813a889d4edd admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:56.154324 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606ef62-3506-48d0-b790-813a889d4edd admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:56.155488 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606ef62-3506-48d0-b790-813a889d4edd admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:56.155830 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606ef62-3506-48d0-b790-813a889d4edd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:56.157832 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606ef62-3506-48d0-b790-813a889d4edd admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:56.177334 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 566/1136] 10.222.0.39 () {56 vars in 1165 bytes} [Tue Aug 31 02:54:56 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:54:56.186360 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e84deb-3ad6-4b10-831c-240c4404de00 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:56.198189 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e84deb-3ad6-4b10-831c-240c4404de00 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:56.202871 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d657c3e-d685-4920-accc-ddcba0e1e245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:56.203540 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d657c3e-d685-4920-accc-ddcba0e1e245 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:56.203817 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d657c3e-d685-4920-accc-ddcba0e1e245 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:56.204086 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d657c3e-d685-4920-accc-ddcba0e1e245 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:56.212104 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d657c3e-d685-4920-accc-ddcba0e1e245 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:56.214150 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d657c3e-d685-4920-accc-ddcba0e1e245 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:56.225506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 571/1137] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:54:56 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:54:56.233944 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606ef62-3506-48d0-b790-813a889d4edd admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:56.243797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606ef62-3506-48d0-b790-813a889d4edd admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:56.249583 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05927b-c0be-4a91-93b5-ed276c5c4266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:56.250362 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05927b-c0be-4a91-93b5-ed276c5c4266 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:56.250648 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05927b-c0be-4a91-93b5-ed276c5c4266 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:56.250926 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05927b-c0be-4a91-93b5-ed276c5c4266 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:56.261839 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05927b-c0be-4a91-93b5-ed276c5c4266 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:56.264040 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05927b-c0be-4a91-93b5-ed276c5c4266 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:56.281515 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-ec05927b-c0be-4a91-93b5-ed276c5c4266 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:54:56.282702 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 567/1138] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:54:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:54:56.290544 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d657c3e-d685-4920-accc-ddcba0e1e245 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:56.301440 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d657c3e-d685-4920-accc-ddcba0e1e245 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:56.306149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cd36f-a790-45ae-bbe7-2f3b0c7324c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:56.306799 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cd36f-a790-45ae-bbe7-2f3b0c7324c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:56.307081 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cd36f-a790-45ae-bbe7-2f3b0c7324c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:56.307357 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cd36f-a790-45ae-bbe7-2f3b0c7324c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:56.308376 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cd36f-a790-45ae-bbe7-2f3b0c7324c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:56.308716 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cd36f-a790-45ae-bbe7-2f3b0c7324c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:56.310886 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cd36f-a790-45ae-bbe7-2f3b0c7324c3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:56.323796 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 572/1139] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:54:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:54:56.330623 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05927b-c0be-4a91-93b5-ed276c5c4266 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:56.340240 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05927b-c0be-4a91-93b5-ed276c5c4266 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:56.345172 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a299a-1b76-4766-8a16-2e2f8bab8647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:56.346008 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a299a-1b76-4766-8a16-2e2f8bab8647 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:56.346290 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a299a-1b76-4766-8a16-2e2f8bab8647 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:56.346566 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a299a-1b76-4766-8a16-2e2f8bab8647 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:56.353535 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a299a-1b76-4766-8a16-2e2f8bab8647 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:56.355511 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a299a-1b76-4766-8a16-2e2f8bab8647 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:56.368923 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-0d7a299a-1b76-4766-8a16-2e2f8bab8647 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:54:56.370079 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 568/1140] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:54:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:54:56.377677 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cd36f-a790-45ae-bbe7-2f3b0c7324c3 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:56.387495 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cd36f-a790-45ae-bbe7-2f3b0c7324c3 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:56.392106 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aebe48-2cd7-4443-b5ea-33f9e32bb99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:56.392750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aebe48-2cd7-4443-b5ea-33f9e32bb99f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:56.393033 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aebe48-2cd7-4443-b5ea-33f9e32bb99f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:56.393308 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aebe48-2cd7-4443-b5ea-33f9e32bb99f admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:56.394095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aebe48-2cd7-4443-b5ea-33f9e32bb99f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:56.394386 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aebe48-2cd7-4443-b5ea-33f9e32bb99f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:56.396320 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aebe48-2cd7-4443-b5ea-33f9e32bb99f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:56.409377 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 573/1141] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:54:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:54:56.416413 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a299a-1b76-4766-8a16-2e2f8bab8647 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:56.428281 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a299a-1b76-4766-8a16-2e2f8bab8647 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:56.433673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2370d-ce7f-479f-90ce-43cc11ebbde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:56.434433 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2370d-ce7f-479f-90ce-43cc11ebbde0 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:56.434719 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2370d-ce7f-479f-90ce-43cc11ebbde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:56.434992 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2370d-ce7f-479f-90ce-43cc11ebbde0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:56.435841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2370d-ce7f-479f-90ce-43cc11ebbde0 admin admin] RBAC: Adding query filter params (role.id=ee8894ccdace402484c35b0cb5292526, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=bbcf0359f8bc4f55be3307f235f8aac5) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:56.436158 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2370d-ce7f-479f-90ce-43cc11ebbde0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:56.437970 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2370d-ce7f-479f-90ce-43cc11ebbde0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:56.443814 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 569/1142] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:54:56 2021] GET /identity/v3/role_assignments?user.id=bbcf0359f8bc4f55be3307f235f8aac5&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=ee8894ccdace402484c35b0cb5292526 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:54:58.722668 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb38c25-59a4-4c59-8033-0c589f120935 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:58.723267 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb38c25-59a4-4c59-8033-0c589f120935 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:58.723396 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb38c25-59a4-4c59-8033-0c589f120935 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:58.725734 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 574/1143] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:54:58 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:54:58.732431 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a72095-cfcc-4d25-9572-f76d114f9f05 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:58.732950 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a72095-cfcc-4d25-9572-f76d114f9f05 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:58.733059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a72095-cfcc-4d25-9572-f76d114f9f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:58.753726 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-f7a72095-cfcc-4d25-9572-f76d114f9f05 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:54:58.755564 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f7a72095-cfcc-4d25-9572-f76d114f9f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:54:58.765507 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 570/1144] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:54:58 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:54:58.791726 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb38c25-59a4-4c59-8033-0c589f120935 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:58.806813 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb38c25-59a4-4c59-8033-0c589f120935 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:58.816748 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6561818-89b0-4ab0-8d26-27a8328a2811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:58.817548 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6561818-89b0-4ab0-8d26-27a8328a2811 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:58.817873 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6561818-89b0-4ab0-8d26-27a8328a2811 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:58.818188 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6561818-89b0-4ab0-8d26-27a8328a2811 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:58.831274 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6561818-89b0-4ab0-8d26-27a8328a2811 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:54:58.838791 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-b6561818-89b0-4ab0-8d26-27a8328a2811 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:54:58.840168 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 575/1145] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:54:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:54:58.847506 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a72095-cfcc-4d25-9572-f76d114f9f05 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:58.857891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a72095-cfcc-4d25-9572-f76d114f9f05 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:58.862615 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969dca49-87e3-4b03-9aec-e75ca3621bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:58.863664 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969dca49-87e3-4b03-9aec-e75ca3621bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:58.863945 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969dca49-87e3-4b03-9aec-e75ca3621bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:58.864219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969dca49-87e3-4b03-9aec-e75ca3621bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:58.864963 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969dca49-87e3-4b03-9aec-e75ca3621bc6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:58.865266 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969dca49-87e3-4b03-9aec-e75ca3621bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:58.866865 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969dca49-87e3-4b03-9aec-e75ca3621bc6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:58.876749 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 571/1146] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:54:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:54:58.883347 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6561818-89b0-4ab0-8d26-27a8328a2811 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:58.895077 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6561818-89b0-4ab0-8d26-27a8328a2811 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:58.899994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f5715-df18-4216-a453-3d265dc912e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:58.900779 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f5715-df18-4216-a453-3d265dc912e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:58.901062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f5715-df18-4216-a453-3d265dc912e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:58.901333 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f5715-df18-4216-a453-3d265dc912e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:58.914806 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f5715-df18-4216-a453-3d265dc912e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:58.917949 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f5715-df18-4216-a453-3d265dc912e6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:58.944164 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-035f5715-df18-4216-a453-3d265dc912e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:54:58.945404 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 576/1147] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:54:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:54:58.953133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969dca49-87e3-4b03-9aec-e75ca3621bc6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:58.964402 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969dca49-87e3-4b03-9aec-e75ca3621bc6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:58.973494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5c40e-6337-4b0b-93ab-55ea2d5c29a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:58.974152 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5c40e-6337-4b0b-93ab-55ea2d5c29a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:58.974524 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5c40e-6337-4b0b-93ab-55ea2d5c29a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:58.974798 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5c40e-6337-4b0b-93ab-55ea2d5c29a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:58.975785 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5c40e-6337-4b0b-93ab-55ea2d5c29a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:58.976141 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5c40e-6337-4b0b-93ab-55ea2d5c29a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:58.977914 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5c40e-6337-4b0b-93ab-55ea2d5c29a8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:58.992221 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 572/1148] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:54:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:54:59.001494 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f5715-df18-4216-a453-3d265dc912e6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:59.014327 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f5715-df18-4216-a453-3d265dc912e6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:59.023570 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f275b-1e1c-4573-b5ba-6d367f76b4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:59.025716 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f275b-1e1c-4573-b5ba-6d367f76b4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:59.026003 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f275b-1e1c-4573-b5ba-6d367f76b4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:59.026285 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f275b-1e1c-4573-b5ba-6d367f76b4f8 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:59.036861 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f275b-1e1c-4573-b5ba-6d367f76b4f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:59.039244 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f275b-1e1c-4573-b5ba-6d367f76b4f8 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:59.057573 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-568f275b-1e1c-4573-b5ba-6d367f76b4f8 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 02:54:59.060006 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 577/1149] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:54:59 2021] GET /identity/v3/users/placement => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:54:59.066997 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5c40e-6337-4b0b-93ab-55ea2d5c29a8 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:59.077249 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5c40e-6337-4b0b-93ab-55ea2d5c29a8 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:59.082140 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f619916-dd7d-4c06-86d3-77998d3f0153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:59.082816 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f619916-dd7d-4c06-86d3-77998d3f0153 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:59.083107 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f619916-dd7d-4c06-86d3-77998d3f0153 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:59.083400 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f619916-dd7d-4c06-86d3-77998d3f0153 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:59.084284 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f619916-dd7d-4c06-86d3-77998d3f0153 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:59.084591 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f619916-dd7d-4c06-86d3-77998d3f0153 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:59.086742 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f619916-dd7d-4c06-86d3-77998d3f0153 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:59.111940 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 573/1150] 10.222.0.39 () {56 vars in 1165 bytes} [Tue Aug 31 02:54:59 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:54:59.121015 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f275b-1e1c-4573-b5ba-6d367f76b4f8 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:59.137633 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f275b-1e1c-4573-b5ba-6d367f76b4f8 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:59.142413 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb502225-7f9f-4694-9ead-f1493a1f8a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:59.143091 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb502225-7f9f-4694-9ead-f1493a1f8a40 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:59.143384 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb502225-7f9f-4694-9ead-f1493a1f8a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:59.143675 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb502225-7f9f-4694-9ead-f1493a1f8a40 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:59.152160 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb502225-7f9f-4694-9ead-f1493a1f8a40 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:59.154287 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb502225-7f9f-4694-9ead-f1493a1f8a40 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:59.168176 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 578/1151] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:54:59 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:54:59.176337 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f619916-dd7d-4c06-86d3-77998d3f0153 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:59.192309 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f619916-dd7d-4c06-86d3-77998d3f0153 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:59.203915 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d2a58-47e6-468c-a1ea-a9e43c884dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:59.204816 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d2a58-47e6-468c-a1ea-a9e43c884dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:59.205106 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d2a58-47e6-468c-a1ea-a9e43c884dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:59.205418 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d2a58-47e6-468c-a1ea-a9e43c884dc6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:59.217139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d2a58-47e6-468c-a1ea-a9e43c884dc6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:59.218968 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d2a58-47e6-468c-a1ea-a9e43c884dc6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:59.237038 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-547d2a58-47e6-468c-a1ea-a9e43c884dc6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:54:59.238154 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 574/1152] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:54:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:54:59.244913 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb502225-7f9f-4694-9ead-f1493a1f8a40 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:59.255727 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb502225-7f9f-4694-9ead-f1493a1f8a40 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:59.260986 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968c441-0fe5-4524-96c4-8cdabb073019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:59.261755 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968c441-0fe5-4524-96c4-8cdabb073019 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:59.262356 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968c441-0fe5-4524-96c4-8cdabb073019 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:59.262556 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968c441-0fe5-4524-96c4-8cdabb073019 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:59.263395 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968c441-0fe5-4524-96c4-8cdabb073019 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:59.263712 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968c441-0fe5-4524-96c4-8cdabb073019 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:59.265418 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968c441-0fe5-4524-96c4-8cdabb073019 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:59.277119 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 579/1153] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:54:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:54:59.283964 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d2a58-47e6-468c-a1ea-a9e43c884dc6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:59.294387 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d2a58-47e6-468c-a1ea-a9e43c884dc6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:59.299015 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83912436-317c-4c07-a72e-4de0ac0841c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:59.299911 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83912436-317c-4c07-a72e-4de0ac0841c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:59.300289 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83912436-317c-4c07-a72e-4de0ac0841c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:59.300551 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83912436-317c-4c07-a72e-4de0ac0841c2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:59.307850 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83912436-317c-4c07-a72e-4de0ac0841c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:59.310591 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83912436-317c-4c07-a72e-4de0ac0841c2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:59.324799 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-83912436-317c-4c07-a72e-4de0ac0841c2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:54:59.325976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 575/1154] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:54:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:54:59.333307 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968c441-0fe5-4524-96c4-8cdabb073019 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:59.343256 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968c441-0fe5-4524-96c4-8cdabb073019 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:59.347880 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3807680-ba69-4693-86e4-a88a403706cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:59.348527 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3807680-ba69-4693-86e4-a88a403706cc admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:59.348811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3807680-ba69-4693-86e4-a88a403706cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:59.349085 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3807680-ba69-4693-86e4-a88a403706cc admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:59.349854 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3807680-ba69-4693-86e4-a88a403706cc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:59.350158 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3807680-ba69-4693-86e4-a88a403706cc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:59.352015 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3807680-ba69-4693-86e4-a88a403706cc admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:59.365293 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 580/1155] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:54:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:54:59.372972 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83912436-317c-4c07-a72e-4de0ac0841c2 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:54:59.383737 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83912436-317c-4c07-a72e-4de0ac0841c2 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:54:59.388383 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e9cb0-dae4-4833-b8d3-7269f3ceb555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:54:59.389025 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e9cb0-dae4-4833-b8d3-7269f3ceb555 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:54:59.389309 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e9cb0-dae4-4833-b8d3-7269f3ceb555 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:54:59.389589 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e9cb0-dae4-4833-b8d3-7269f3ceb555 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:54:59.390496 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e9cb0-dae4-4833-b8d3-7269f3ceb555 admin admin] RBAC: Adding query filter params (role.id=99835eeda2f64af5bc9173a8370d4568, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=bbcf0359f8bc4f55be3307f235f8aac5) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:54:59.390808 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e9cb0-dae4-4833-b8d3-7269f3ceb555 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:54:59.392808 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e9cb0-dae4-4833-b8d3-7269f3ceb555 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:54:59.398926 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 576/1156] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:54:59 2021] GET /identity/v3/role_assignments?user.id=bbcf0359f8bc4f55be3307f235f8aac5&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:55:01.692900 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d3429-9a5b-4982-8624-b7fee3268cce None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:01.693500 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d3429-9a5b-4982-8624-b7fee3268cce None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:01.693855 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d3429-9a5b-4982-8624-b7fee3268cce None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:01.695814 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 581/1157] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:55:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:55:01.702549 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519b8c7-5df6-4a84-809a-e551b76552c4 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:01.703109 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519b8c7-5df6-4a84-809a-e551b76552c4 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:01.703109 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519b8c7-5df6-4a84-809a-e551b76552c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:01.724390 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-a519b8c7-5df6-4a84-809a-e551b76552c4 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:55:01.725664 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a519b8c7-5df6-4a84-809a-e551b76552c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:55:01.735314 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 577/1158] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:55:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:55:01.765431 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d3429-9a5b-4982-8624-b7fee3268cce None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:01.779047 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d3429-9a5b-4982-8624-b7fee3268cce None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:01.784143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7f17f-2765-42de-94da-78392124a695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:01.784931 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7f17f-2765-42de-94da-78392124a695 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:01.785212 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7f17f-2765-42de-94da-78392124a695 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:01.785483 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7f17f-2765-42de-94da-78392124a695 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:01.796203 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7f17f-2765-42de-94da-78392124a695 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:55:01.803152 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-9fb7f17f-2765-42de-94da-78392124a695 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:55:01.804384 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 582/1159] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:55:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:55:01.812536 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519b8c7-5df6-4a84-809a-e551b76552c4 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:01.822050 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519b8c7-5df6-4a84-809a-e551b76552c4 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:01.828549 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969dbae-d215-413e-91c0-4ab4ca5ff3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:01.829212 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969dbae-d215-413e-91c0-4ab4ca5ff3cc admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:01.829492 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969dbae-d215-413e-91c0-4ab4ca5ff3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:01.829765 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969dbae-d215-413e-91c0-4ab4ca5ff3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:01.830496 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969dbae-d215-413e-91c0-4ab4ca5ff3cc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:55:01.830797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969dbae-d215-413e-91c0-4ab4ca5ff3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:01.832721 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969dbae-d215-413e-91c0-4ab4ca5ff3cc admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:01.842426 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 578/1160] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:55:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:55:01.848747 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7f17f-2765-42de-94da-78392124a695 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:01.858617 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7f17f-2765-42de-94da-78392124a695 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:01.863229 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b07640-9179-4b9e-880d-1e59af156552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:01.864055 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b07640-9179-4b9e-880d-1e59af156552 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:01.864342 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b07640-9179-4b9e-880d-1e59af156552 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:01.864621 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b07640-9179-4b9e-880d-1e59af156552 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:01.876226 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b07640-9179-4b9e-880d-1e59af156552 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:01.878066 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b07640-9179-4b9e-880d-1e59af156552 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:01.894842 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-e1b07640-9179-4b9e-880d-1e59af156552 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:55:01.896053 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 583/1161] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:55:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:55:01.902880 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969dbae-d215-413e-91c0-4ab4ca5ff3cc admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:01.912608 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969dbae-d215-413e-91c0-4ab4ca5ff3cc admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:01.918499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf2836-5ec3-46f8-af05-6e8040914625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:01.919293 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf2836-5ec3-46f8-af05-6e8040914625 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:01.919609 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf2836-5ec3-46f8-af05-6e8040914625 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:01.919888 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf2836-5ec3-46f8-af05-6e8040914625 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:01.920606 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf2836-5ec3-46f8-af05-6e8040914625 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:55:01.920915 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf2836-5ec3-46f8-af05-6e8040914625 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:01.922520 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf2836-5ec3-46f8-af05-6e8040914625 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:01.936360 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 579/1162] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:55:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:55:01.943015 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b07640-9179-4b9e-880d-1e59af156552 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:01.953993 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b07640-9179-4b9e-880d-1e59af156552 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:01.958928 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe947233-5ebc-4cee-9747-f246b69c7cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:01.959764 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe947233-5ebc-4cee-9747-f246b69c7cff admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:01.960057 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe947233-5ebc-4cee-9747-f246b69c7cff admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:01.960332 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe947233-5ebc-4cee-9747-f246b69c7cff admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:01.968460 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe947233-5ebc-4cee-9747-f246b69c7cff admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:01.970493 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe947233-5ebc-4cee-9747-f246b69c7cff admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:01.984154 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-fe947233-5ebc-4cee-9747-f246b69c7cff admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 02:55:01.985330 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 584/1163] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:55:01 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:55:01.992024 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf2836-5ec3-46f8-af05-6e8040914625 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:02.003772 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf2836-5ec3-46f8-af05-6e8040914625 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:02.008966 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf6524-d5cd-444f-a1eb-f86429299153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:02.009688 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf6524-d5cd-444f-a1eb-f86429299153 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:02.010025 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf6524-d5cd-444f-a1eb-f86429299153 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:02.010394 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf6524-d5cd-444f-a1eb-f86429299153 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:02.011281 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf6524-d5cd-444f-a1eb-f86429299153 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:55:02.011618 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf6524-d5cd-444f-a1eb-f86429299153 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:02.014184 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf6524-d5cd-444f-a1eb-f86429299153 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:02.035268 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 580/1164] 10.222.0.39 () {56 vars in 1165 bytes} [Tue Aug 31 02:55:01 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:55:02.041595 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe947233-5ebc-4cee-9747-f246b69c7cff admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:02.051845 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe947233-5ebc-4cee-9747-f246b69c7cff admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:02.058224 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b5fcb-4f6c-4604-b11c-c2a5529eb22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:02.059723 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b5fcb-4f6c-4604-b11c-c2a5529eb22e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:02.060011 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b5fcb-4f6c-4604-b11c-c2a5529eb22e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:02.060314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b5fcb-4f6c-4604-b11c-c2a5529eb22e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:02.071113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b5fcb-4f6c-4604-b11c-c2a5529eb22e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:02.072997 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b5fcb-4f6c-4604-b11c-c2a5529eb22e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:02.089393 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-b16b5fcb-4f6c-4604-b11c-c2a5529eb22e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:55:02.090810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 585/1165] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:55:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:55:02.097579 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf6524-d5cd-444f-a1eb-f86429299153 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:02.109053 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf6524-d5cd-444f-a1eb-f86429299153 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:02.113875 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383ce6b-ba18-442c-adc1-99502db5e1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:02.114559 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383ce6b-ba18-442c-adc1-99502db5e1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:02.114851 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383ce6b-ba18-442c-adc1-99502db5e1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:02.119410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383ce6b-ba18-442c-adc1-99502db5e1b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:02.119410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383ce6b-ba18-442c-adc1-99502db5e1b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:55:02.119410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383ce6b-ba18-442c-adc1-99502db5e1b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:02.119788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383ce6b-ba18-442c-adc1-99502db5e1b9 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:02.139541 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 581/1166] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:55:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:55:02.140883 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b5fcb-4f6c-4604-b11c-c2a5529eb22e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:02.150866 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b5fcb-4f6c-4604-b11c-c2a5529eb22e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:02.155565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a4c4e-cd53-4ed7-b55d-c3cce48b2222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:02.156376 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a4c4e-cd53-4ed7-b55d-c3cce48b2222 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:02.156657 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a4c4e-cd53-4ed7-b55d-c3cce48b2222 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:02.156928 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a4c4e-cd53-4ed7-b55d-c3cce48b2222 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:02.164425 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a4c4e-cd53-4ed7-b55d-c3cce48b2222 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:02.166407 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a4c4e-cd53-4ed7-b55d-c3cce48b2222 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:02.181409 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-265a4c4e-cd53-4ed7-b55d-c3cce48b2222 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:55:02.182665 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 586/1167] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:55:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:55:02.189832 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383ce6b-ba18-442c-adc1-99502db5e1b9 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:02.199988 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383ce6b-ba18-442c-adc1-99502db5e1b9 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:02.204616 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2e3bd-4554-4c11-8dde-5d12a59fd5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:02.205297 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2e3bd-4554-4c11-8dde-5d12a59fd5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:02.205589 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2e3bd-4554-4c11-8dde-5d12a59fd5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:02.205868 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2e3bd-4554-4c11-8dde-5d12a59fd5d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:02.206668 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2e3bd-4554-4c11-8dde-5d12a59fd5d7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:55:02.206982 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2e3bd-4554-4c11-8dde-5d12a59fd5d7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:02.208899 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2e3bd-4554-4c11-8dde-5d12a59fd5d7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:02.222652 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 582/1168] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:55:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:55:02.229825 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a4c4e-cd53-4ed7-b55d-c3cce48b2222 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:02.241598 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a4c4e-cd53-4ed7-b55d-c3cce48b2222 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:02.247156 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e84d6c-ecb7-4934-810d-56e8f0396152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:02.248447 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e84d6c-ecb7-4934-810d-56e8f0396152 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:02.248731 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e84d6c-ecb7-4934-810d-56e8f0396152 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:02.249005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e84d6c-ecb7-4934-810d-56e8f0396152 admin admin] PATH_INFO: `/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/bbcf0359f8bc4f55be3307f235f8aac5/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:02.251070 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e84d6c-ecb7-4934-810d-56e8f0396152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011ec8d2410644a3b7d51a90f803b441, user_id=bbcf0359f8bc4f55be3307f235f8aac5, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:02.253779 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e84d6c-ecb7-4934-810d-56e8f0396152 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:02.267604 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 587/1169] 10.222.0.39 () {58 vars in 1461 bytes} [Tue Aug 31 02:55:02 2021] PUT /identity/v3/projects/011ec8d2410644a3b7d51a90f803b441/users/bbcf0359f8bc4f55be3307f235f8aac5/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 02:55:04.521974 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893c886-100e-4323-b7e2-117b159cb479 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:04.522507 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893c886-100e-4323-b7e2-117b159cb479 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:04.522602 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893c886-100e-4323-b7e2-117b159cb479 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:04.524356 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 583/1170] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:55:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:55:04.530252 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd2fc2-6917-46c0-be9a-72dbbb3b766c None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:04.530653 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd2fc2-6917-46c0-be9a-72dbbb3b766c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:04.530810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd2fc2-6917-46c0-be9a-72dbbb3b766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:04.548718 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-bfbd2fc2-6917-46c0-be9a-72dbbb3b766c None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:55:04.549909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-bfbd2fc2-6917-46c0-be9a-72dbbb3b766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:55:04.605236 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 588/1171] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:55:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:55:04.631481 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893c886-100e-4323-b7e2-117b159cb479 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:04.644281 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893c886-100e-4323-b7e2-117b159cb479 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:04.648786 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e14d4-35d1-49f3-baf2-af5cfa0c5693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:04.649559 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e14d4-35d1-49f3-baf2-af5cfa0c5693 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:04.649844 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e14d4-35d1-49f3-baf2-af5cfa0c5693 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:04.650116 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e14d4-35d1-49f3-baf2-af5cfa0c5693 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:04.660857 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e14d4-35d1-49f3-baf2-af5cfa0c5693 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 02:55:04.667598 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-9a9e14d4-35d1-49f3-baf2-af5cfa0c5693 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 02:55:04.669576 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 584/1172] 10.222.0.39 () {56 vars in 1118 bytes} [Tue Aug 31 02:55:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:55:04.676155 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd2fc2-6917-46c0-be9a-72dbbb3b766c None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:04.685218 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd2fc2-6917-46c0-be9a-72dbbb3b766c None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:04.689708 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c4035-9cdc-48e0-8d24-cb910335b395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:04.690360 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c4035-9cdc-48e0-8d24-cb910335b395 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:04.690643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c4035-9cdc-48e0-8d24-cb910335b395 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:04.690916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c4035-9cdc-48e0-8d24-cb910335b395 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:04.691701 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c4035-9cdc-48e0-8d24-cb910335b395 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:55:04.692007 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c4035-9cdc-48e0-8d24-cb910335b395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:04.693600 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c4035-9cdc-48e0-8d24-cb910335b395 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:04.702376 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 589/1173] 10.222.0.39 () {56 vars in 1121 bytes} [Tue Aug 31 02:55:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:55:04.708906 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e14d4-35d1-49f3-baf2-af5cfa0c5693 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:04.720558 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e14d4-35d1-49f3-baf2-af5cfa0c5693 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:04.725197 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1832a-d147-40a6-9f51-cc7b31ae0479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:04.725957 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1832a-d147-40a6-9f51-cc7b31ae0479 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:04.726234 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1832a-d147-40a6-9f51-cc7b31ae0479 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:04.726502 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1832a-d147-40a6-9f51-cc7b31ae0479 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:04.737579 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1832a-d147-40a6-9f51-cc7b31ae0479 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:04.739397 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1832a-d147-40a6-9f51-cc7b31ae0479 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:04.758133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-71a1832a-d147-40a6-9f51-cc7b31ae0479 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:55:04.759266 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 585/1174] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:55:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:55:04.765730 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c4035-9cdc-48e0-8d24-cb910335b395 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:04.775276 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c4035-9cdc-48e0-8d24-cb910335b395 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:04.780489 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12344e0e-a1ad-4469-ba02-f695092fc96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:04.781133 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12344e0e-a1ad-4469-ba02-f695092fc96e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:04.781416 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12344e0e-a1ad-4469-ba02-f695092fc96e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:04.781691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12344e0e-a1ad-4469-ba02-f695092fc96e admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:04.782399 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12344e0e-a1ad-4469-ba02-f695092fc96e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:55:04.782705 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12344e0e-a1ad-4469-ba02-f695092fc96e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:04.784311 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12344e0e-a1ad-4469-ba02-f695092fc96e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:04.796537 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 590/1175] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:55:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:55:04.802455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1832a-d147-40a6-9f51-cc7b31ae0479 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:04.812128 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1832a-d147-40a6-9f51-cc7b31ae0479 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:04.816682 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2e107-3835-4972-b6be-50ebc73e2daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:04.817454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2e107-3835-4972-b6be-50ebc73e2daf admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:04.817736 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2e107-3835-4972-b6be-50ebc73e2daf admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:04.818006 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2e107-3835-4972-b6be-50ebc73e2daf admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:04.825176 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2e107-3835-4972-b6be-50ebc73e2daf admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:04.827163 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2e107-3835-4972-b6be-50ebc73e2daf admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:04.841306 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-5be2e107-3835-4972-b6be-50ebc73e2daf admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 02:55:04.842409 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 586/1176] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:55:04 2021] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:55:04.848429 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12344e0e-a1ad-4469-ba02-f695092fc96e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:04.858314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12344e0e-a1ad-4469-ba02-f695092fc96e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:04.862790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa2646-d44f-4685-a39d-0111bde41555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:04.863476 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa2646-d44f-4685-a39d-0111bde41555 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:04.863760 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa2646-d44f-4685-a39d-0111bde41555 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:04.864033 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa2646-d44f-4685-a39d-0111bde41555 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:04.864852 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa2646-d44f-4685-a39d-0111bde41555 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:55:04.865155 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa2646-d44f-4685-a39d-0111bde41555 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:04.866968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa2646-d44f-4685-a39d-0111bde41555 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:04.883719 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 591/1177] 10.222.0.39 () {56 vars in 1165 bytes} [Tue Aug 31 02:55:04 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:55:04.889749 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2e107-3835-4972-b6be-50ebc73e2daf admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:04.899023 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2e107-3835-4972-b6be-50ebc73e2daf admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:04.904182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c261e1-0aba-42d5-9525-6d0224b14aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:04.904799 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c261e1-0aba-42d5-9525-6d0224b14aab admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:04.905083 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c261e1-0aba-42d5-9525-6d0224b14aab admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:04.905361 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c261e1-0aba-42d5-9525-6d0224b14aab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:04.912866 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c261e1-0aba-42d5-9525-6d0224b14aab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:04.914579 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c261e1-0aba-42d5-9525-6d0224b14aab admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:04.923906 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 587/1178] 10.222.0.39 () {58 vars in 1325 bytes} [Tue Aug 31 02:55:04 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:55:04.929765 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa2646-d44f-4685-a39d-0111bde41555 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:04.939210 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa2646-d44f-4685-a39d-0111bde41555 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:04.943724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd8207-0159-421f-a5f3-672095c79280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:04.944491 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd8207-0159-421f-a5f3-672095c79280 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:04.944774 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd8207-0159-421f-a5f3-672095c79280 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:04.945049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd8207-0159-421f-a5f3-672095c79280 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:04.954995 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd8207-0159-421f-a5f3-672095c79280 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:04.956840 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd8207-0159-421f-a5f3-672095c79280 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:04.973283 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-6cdd8207-0159-421f-a5f3-672095c79280 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 02:55:04.974375 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 592/1179] 10.222.0.39 () {56 vars in 1130 bytes} [Tue Aug 31 02:55:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:55:04.980161 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c261e1-0aba-42d5-9525-6d0224b14aab admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:04.989526 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c261e1-0aba-42d5-9525-6d0224b14aab admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:04.994067 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147f000-01e8-406d-976d-5a6b77002fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:04.994697 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147f000-01e8-406d-976d-5a6b77002fde admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:04.994980 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147f000-01e8-406d-976d-5a6b77002fde admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:04.995256 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147f000-01e8-406d-976d-5a6b77002fde admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:04.995992 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147f000-01e8-406d-976d-5a6b77002fde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:55:04.996318 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147f000-01e8-406d-976d-5a6b77002fde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:04.998415 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147f000-01e8-406d-976d-5a6b77002fde admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:05.009236 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 588/1180] 10.222.0.39 () {56 vars in 1131 bytes} [Tue Aug 31 02:55:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:55:05.015470 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd8207-0159-421f-a5f3-672095c79280 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:05.024733 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd8207-0159-421f-a5f3-672095c79280 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:05.029931 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9d05b-fe11-47ec-91e3-5abd859d1a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:05.030625 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9d05b-fe11-47ec-91e3-5abd859d1a5c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:05.030906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9d05b-fe11-47ec-91e3-5abd859d1a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:05.031180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9d05b-fe11-47ec-91e3-5abd859d1a5c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:05.037760 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9d05b-fe11-47ec-91e3-5abd859d1a5c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:05.039711 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9d05b-fe11-47ec-91e3-5abd859d1a5c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:05.052301 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING keystone.server.flask.application [None req-3ce9d05b-fe11-47ec-91e3-5abd859d1a5c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 02:55:05.053385 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 593/1181] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Aug 31 02:55:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:55:05.059340 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147f000-01e8-406d-976d-5a6b77002fde admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:05.068595 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147f000-01e8-406d-976d-5a6b77002fde admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:05.073054 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba710ce-80fd-40a7-9d1c-be9da80a8a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:05.073682 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba710ce-80fd-40a7-9d1c-be9da80a8a2d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:05.073965 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba710ce-80fd-40a7-9d1c-be9da80a8a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:05.074241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba710ce-80fd-40a7-9d1c-be9da80a8a2d admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:05.075537 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba710ce-80fd-40a7-9d1c-be9da80a8a2d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:55:05.075844 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba710ce-80fd-40a7-9d1c-be9da80a8a2d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:05.077649 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba710ce-80fd-40a7-9d1c-be9da80a8a2d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:05.089175 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 589/1182] 10.222.0.39 () {56 vars in 1170 bytes} [Tue Aug 31 02:55:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:55:05.096020 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9d05b-fe11-47ec-91e3-5abd859d1a5c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:05.105844 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9d05b-fe11-47ec-91e3-5abd859d1a5c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:05.110281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e256e-b805-44d5-892c-e5bf2349565e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:05.110905 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e256e-b805-44d5-892c-e5bf2349565e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:05.111180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e256e-b805-44d5-892c-e5bf2349565e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:05.111481 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e256e-b805-44d5-892c-e5bf2349565e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:05.112285 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e256e-b805-44d5-892c-e5bf2349565e admin admin] RBAC: Adding query filter params (role.id=99835eeda2f64af5bc9173a8370d4568, scope.project.id=011ec8d2410644a3b7d51a90f803b441, user.id=bbcf0359f8bc4f55be3307f235f8aac5) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:55:05.112588 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e256e-b805-44d5-892c-e5bf2349565e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:05.114401 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e256e-b805-44d5-892c-e5bf2349565e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:05.120681 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 594/1183] 10.222.0.39 () {56 vars in 1396 bytes} [Tue Aug 31 02:55:05 2021] GET /identity/v3/role_assignments?user.id=bbcf0359f8bc4f55be3307f235f8aac5&scope.project.id=011ec8d2410644a3b7d51a90f803b441&role.id=99835eeda2f64af5bc9173a8370d4568 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:55:07.266145 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748297e-0cba-4c46-9d27-7399bec90c08 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:07.266642 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748297e-0cba-4c46-9d27-7399bec90c08 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:07.266729 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748297e-0cba-4c46-9d27-7399bec90c08 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:07.268576 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 590/1184] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:55:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:55:07.274828 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fd6c9-e904-4b23-a058-676c41b0f334 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:07.275249 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fd6c9-e904-4b23-a058-676c41b0f334 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:07.275410 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fd6c9-e904-4b23-a058-676c41b0f334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:07.292282 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-080fd6c9-e904-4b23-a058-676c41b0f334 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:55:07.293920 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-080fd6c9-e904-4b23-a058-676c41b0f334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:55:07.301497 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 595/1185] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:55:07 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:55:07.325961 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748297e-0cba-4c46-9d27-7399bec90c08 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:07.337952 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748297e-0cba-4c46-9d27-7399bec90c08 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:07.342448 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e58269-8ffb-4b12-a46a-8e6f9577c615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:07.343223 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e58269-8ffb-4b12-a46a-8e6f9577c615 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:07.343537 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e58269-8ffb-4b12-a46a-8e6f9577c615 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:07.343805 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e58269-8ffb-4b12-a46a-8e6f9577c615 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:07.344438 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e58269-8ffb-4b12-a46a-8e6f9577c615 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:07.346002 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e58269-8ffb-4b12-a46a-8e6f9577c615 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:07.357370 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-49e58269-8ffb-4b12-a46a-8e6f9577c615 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 02:55:07.358463 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 591/1186] 10.222.0.39 () {56 vars in 1139 bytes} [Tue Aug 31 02:55:07 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:55:07.364878 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fd6c9-e904-4b23-a058-676c41b0f334 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:07.374692 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fd6c9-e904-4b23-a058-676c41b0f334 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:07.379175 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdf088-b9e8-430f-a34f-0f9c099ffc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:07.379856 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdf088-b9e8-430f-a34f-0f9c099ffc98 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:07.380142 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdf088-b9e8-430f-a34f-0f9c099ffc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:07.380421 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdf088-b9e8-430f-a34f-0f9c099ffc98 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:07.381118 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bdf088-b9e8-430f-a34f-0f9c099ffc98 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:55:07.381424 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bdf088-b9e8-430f-a34f-0f9c099ffc98 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:07.382993 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bdf088-b9e8-430f-a34f-0f9c099ffc98 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:07.387899 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 596/1187] 10.222.0.39 () {56 vars in 1138 bytes} [Tue Aug 31 02:55:07 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:55:07.393634 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e58269-8ffb-4b12-a46a-8e6f9577c615 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:07.402675 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e58269-8ffb-4b12-a46a-8e6f9577c615 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:07.407035 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff66897-6e0b-4086-9cc6-450037026a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:07.407682 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff66897-6e0b-4086-9cc6-450037026a77 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:07.407963 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff66897-6e0b-4086-9cc6-450037026a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:07.408236 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff66897-6e0b-4086-9cc6-450037026a77 admin admin] PATH_INFO: `/v3/services` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:07.408911 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff66897-6e0b-4086-9cc6-450037026a77 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:55:07.409213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff66897-6e0b-4086-9cc6-450037026a77 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:07.410740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff66897-6e0b-4086-9cc6-450037026a77 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:07.414860 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 592/1188] 10.222.0.39 () {56 vars in 1138 bytes} [Tue Aug 31 02:55:07 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:55:09.567215 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3402a-1a87-4b57-86e4-efb03a997aa2 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:09.567800 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3402a-1a87-4b57-86e4-efb03a997aa2 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:09.567800 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3402a-1a87-4b57-86e4-efb03a997aa2 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:09.569561 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 597/1189] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:55:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:55:09.575823 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785edd9f-709f-4a30-8112-8db1838d1652 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:09.576233 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785edd9f-709f-4a30-8112-8db1838d1652 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:09.576378 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785edd9f-709f-4a30-8112-8db1838d1652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:09.593504 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-785edd9f-709f-4a30-8112-8db1838d1652 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:55:09.594677 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-785edd9f-709f-4a30-8112-8db1838d1652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:55:09.603089 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 593/1190] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:55:09 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:55:09.631057 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3402a-1a87-4b57-86e4-efb03a997aa2 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:09.647022 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3402a-1a87-4b57-86e4-efb03a997aa2 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:09.653090 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccddf5-ea9d-439a-8041-1d95a9eb96a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:09.654038 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccddf5-ea9d-439a-8041-1d95a9eb96a7 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:09.654425 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccddf5-ea9d-439a-8041-1d95a9eb96a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:09.654787 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccddf5-ea9d-439a-8041-1d95a9eb96a7 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:09.656015 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccddf5-ea9d-439a-8041-1d95a9eb96a7 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:09.658265 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccddf5-ea9d-439a-8041-1d95a9eb96a7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:09.673726 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 598/1191] 10.222.0.39 () {60 vars in 1163 bytes} [Tue Aug 31 02:55:09 2021] POST /identity/v3/services => generated 246 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:55:11.801089 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac3098-3b3b-4790-b08c-fc9d7de104e3 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:11.801622 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac3098-3b3b-4790-b08c-fc9d7de104e3 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:11.801622 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac3098-3b3b-4790-b08c-fc9d7de104e3 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:11.803398 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 594/1192] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:55:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:55:11.809737 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c0445-efcd-4bdd-931c-1a011aa1eaf5 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:11.810133 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c0445-efcd-4bdd-931c-1a011aa1eaf5 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:11.810287 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c0445-efcd-4bdd-931c-1a011aa1eaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:11.828004 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-f19c0445-efcd-4bdd-931c-1a011aa1eaf5 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:55:11.829194 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f19c0445-efcd-4bdd-931c-1a011aa1eaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:55:11.847109 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 599/1193] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:55:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:55:11.870859 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac3098-3b3b-4790-b08c-fc9d7de104e3 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:11.883099 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac3098-3b3b-4790-b08c-fc9d7de104e3 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:11.888231 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c2a75-5e2c-42d2-92d1-8fbb6a8350ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:11.888999 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c2a75-5e2c-42d2-92d1-8fbb6a8350ad admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:11.889277 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c2a75-5e2c-42d2-92d1-8fbb6a8350ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:11.889547 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c2a75-5e2c-42d2-92d1-8fbb6a8350ad admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:11.890184 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c2a75-5e2c-42d2-92d1-8fbb6a8350ad admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:11.891795 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c2a75-5e2c-42d2-92d1-8fbb6a8350ad admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:11.902321 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-506c2a75-5e2c-42d2-92d1-8fbb6a8350ad admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 02:55:11.904262 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 595/1194] 10.222.0.39 () {56 vars in 1139 bytes} [Tue Aug 31 02:55:11 2021] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 02:55:11.910716 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c0445-efcd-4bdd-931c-1a011aa1eaf5 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:11.919935 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c0445-efcd-4bdd-931c-1a011aa1eaf5 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:11.924430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae810ca-c5e1-43ff-afe1-d2fe164a39fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:11.925104 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae810ca-c5e1-43ff-afe1-d2fe164a39fb admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:11.925389 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae810ca-c5e1-43ff-afe1-d2fe164a39fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:11.925668 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae810ca-c5e1-43ff-afe1-d2fe164a39fb admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:11.926365 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae810ca-c5e1-43ff-afe1-d2fe164a39fb admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:55:11.926671 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae810ca-c5e1-43ff-afe1-d2fe164a39fb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:11.928305 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae810ca-c5e1-43ff-afe1-d2fe164a39fb admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:11.933308 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 600/1195] 10.222.0.39 () {56 vars in 1138 bytes} [Tue Aug 31 02:55:11 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:55:11.940205 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c2a75-5e2c-42d2-92d1-8fbb6a8350ad admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:11.949490 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c2a75-5e2c-42d2-92d1-8fbb6a8350ad admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:11.954300 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8e25b-b095-4782-8263-d8a8a707e115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:11.954909 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8e25b-b095-4782-8263-d8a8a707e115 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:11.955190 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8e25b-b095-4782-8263-d8a8a707e115 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:11.955498 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8e25b-b095-4782-8263-d8a8a707e115 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:11.956268 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8e25b-b095-4782-8263-d8a8a707e115 admin admin] RBAC: Adding query filter params (interface=public, service_id=693be992edb54bf0951f83ee8f54cd4f, region_id=RegionOne) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:55:11.956574 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8e25b-b095-4782-8263-d8a8a707e115 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:11.958099 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8e25b-b095-4782-8263-d8a8a707e115 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:11.962805 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 596/1196] 10.222.0.39 () {56 vars in 1273 bytes} [Tue Aug 31 02:55:11 2021] GET /identity/v3/endpoints?service_id=693be992edb54bf0951f83ee8f54cd4f&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:55:11.968553 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae810ca-c5e1-43ff-afe1-d2fe164a39fb admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:11.977597 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae810ca-c5e1-43ff-afe1-d2fe164a39fb admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:11.982808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c4d95-e2a2-49db-8987-c985c8e90a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:11.983461 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c4d95-e2a2-49db-8987-c985c8e90a6e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:11.983749 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c4d95-e2a2-49db-8987-c985c8e90a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:11.984027 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c4d95-e2a2-49db-8987-c985c8e90a6e admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:11.984682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c4d95-e2a2-49db-8987-c985c8e90a6e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:11.986220 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c4d95-e2a2-49db-8987-c985c8e90a6e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:11.992795 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 601/1197] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Aug 31 02:55:11 2021] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 02:55:14.135443 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1587f-f689-4b89-9e39-17ec41e70ef7 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:14.135853 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1587f-f689-4b89-9e39-17ec41e70ef7 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:14.135994 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1587f-f689-4b89-9e39-17ec41e70ef7 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:14.137908 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 597/1198] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:55:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:55:14.143878 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ece13e-bf77-421b-a7fd-e6c70c42ca3e None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:14.144268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ece13e-bf77-421b-a7fd-e6c70c42ca3e None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:14.144428 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ece13e-bf77-421b-a7fd-e6c70c42ca3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:14.162371 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-81ece13e-bf77-421b-a7fd-e6c70c42ca3e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:55:14.163589 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-81ece13e-bf77-421b-a7fd-e6c70c42ca3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:55:14.172061 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 602/1199] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:55:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:55:14.196372 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1587f-f689-4b89-9e39-17ec41e70ef7 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:14.208206 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1587f-f689-4b89-9e39-17ec41e70ef7 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:14.212588 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a65ea-5015-482e-b32a-82e4845294fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:14.213350 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a65ea-5015-482e-b32a-82e4845294fe admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:14.213626 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a65ea-5015-482e-b32a-82e4845294fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:14.213894 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a65ea-5015-482e-b32a-82e4845294fe admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:14.214520 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a65ea-5015-482e-b32a-82e4845294fe admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:14.216362 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a65ea-5015-482e-b32a-82e4845294fe admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:14.226849 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING keystone.server.flask.application [None req-4e5a65ea-5015-482e-b32a-82e4845294fe admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 02:55:14.227986 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 598/1200] 10.222.0.39 () {56 vars in 1139 bytes} [Tue Aug 31 02:55:14 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 02:55:14.234853 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ece13e-bf77-421b-a7fd-e6c70c42ca3e None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:14.243616 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ece13e-bf77-421b-a7fd-e6c70c42ca3e None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:14.249041 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f856093-37fc-4964-89dd-ba4308d583b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:14.249680 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f856093-37fc-4964-89dd-ba4308d583b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:14.249961 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f856093-37fc-4964-89dd-ba4308d583b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:14.250235 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f856093-37fc-4964-89dd-ba4308d583b3 admin admin] PATH_INFO: `/v3/services` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:14.250927 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f856093-37fc-4964-89dd-ba4308d583b3 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:55:14.251233 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f856093-37fc-4964-89dd-ba4308d583b3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:14.252836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f856093-37fc-4964-89dd-ba4308d583b3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:14.257766 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 603/1201] 10.222.0.39 () {56 vars in 1138 bytes} [Tue Aug 31 02:55:14 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:55:14.264088 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a65ea-5015-482e-b32a-82e4845294fe admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:55:14.273771 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a65ea-5015-482e-b32a-82e4845294fe admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:55:14.278378 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1597daf-75fc-4a0f-8c7f-bf910da3ce8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:55:14.278993 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1597daf-75fc-4a0f-8c7f-bf910da3ce8c admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:55:14.279273 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1597daf-75fc-4a0f-8c7f-bf910da3ce8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:55:14.279569 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1597daf-75fc-4a0f-8c7f-bf910da3ce8c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:55:14.280292 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1597daf-75fc-4a0f-8c7f-bf910da3ce8c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:55:14.281832 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1597daf-75fc-4a0f-8c7f-bf910da3ce8c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:55:14.300791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 599/1202] 10.222.0.39 () {60 vars in 1166 bytes} [Tue Aug 31 02:55:14 2021] POST /identity/v3/endpoints => generated 331 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 02:56:17.679120 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c609d-5fb6-4694-98ab-3b047e530c4c None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:17.680197 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c609d-5fb6-4694-98ab-3b047e530c4c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:17.680719 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c609d-5fb6-4694-98ab-3b047e530c4c None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:17.687267 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 604/1203] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:56:17 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:56:17.689655 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d5bc6-0756-4450-8916-fd50aed16033 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:17.690156 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d5bc6-0756-4450-8916-fd50aed16033 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:17.690605 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d5bc6-0756-4450-8916-fd50aed16033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:17.832117 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-8c6d5bc6-0756-4450-8916-fd50aed16033 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:56:17.834938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-8c6d5bc6-0756-4450-8916-fd50aed16033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:17.979740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 600/1204] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:56:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:56:18.004486 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c609d-5fb6-4694-98ab-3b047e530c4c None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:56:18.006502 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-918c609d-5fb6-4694-98ab-3b047e530c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:18.152192 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c609d-5fb6-4694-98ab-3b047e530c4c None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:56:18.253984 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17966ab9-dab9-4e81-ba58-de2af5dcf57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:56:18.254814 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17966ab9-dab9-4e81-ba58-de2af5dcf57c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:18.255191 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17966ab9-dab9-4e81-ba58-de2af5dcf57c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:18.255579 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17966ab9-dab9-4e81-ba58-de2af5dcf57c admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:18.256402 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17966ab9-dab9-4e81-ba58-de2af5dcf57c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:56:18.258354 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17966ab9-dab9-4e81-ba58-de2af5dcf57c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:56:18.294188 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 605/1205] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Aug 31 02:56:18 2021] GET /identity/v3/projects => generated 2553 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 02:56:20.523564 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c76eb0-e98d-40c3-aaf3-a81064a1537e None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:20.524087 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c76eb0-e98d-40c3-aaf3-a81064a1537e None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:20.524087 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c76eb0-e98d-40c3-aaf3-a81064a1537e None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:20.525889 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 601/1206] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:56:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:56:20.533020 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b6869-80b5-4845-80f0-73f8df97deb5 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:20.533441 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b6869-80b5-4845-80f0-73f8df97deb5 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:20.533648 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b6869-80b5-4845-80f0-73f8df97deb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:20.603782 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-b62b6869-80b5-4845-80f0-73f8df97deb5 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:56:20.604985 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b62b6869-80b5-4845-80f0-73f8df97deb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:20.699664 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 606/1207] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:56:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:56:20.753544 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa688af-9df7-4612-8a43-87cfc0241c99 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:20.753836 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa688af-9df7-4612-8a43-87cfc0241c99 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:20.754116 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa688af-9df7-4612-8a43-87cfc0241c99 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:20.755914 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 602/1208] 10.222.0.39 () {54 vars in 964 bytes} [Tue Aug 31 02:56:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:56:20.762703 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824f2cc-bbbb-4d65-8774-dad90b7d7557 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:20.762987 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824f2cc-bbbb-4d65-8774-dad90b7d7557 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:20.763259 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824f2cc-bbbb-4d65-8774-dad90b7d7557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:20.832595 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-9824f2cc-bbbb-4d65-8774-dad90b7d7557 None None] MFA Rules not processed for user `18b73b8e7244410b8f701b2ab43c5979`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:56:20.833799 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-9824f2cc-bbbb-4d65-8774-dad90b7d7557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:20.906638 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 607/1209] 10.222.0.39 () {58 vars in 1062 bytes} [Tue Aug 31 02:56:20 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:56:20.915797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa688af-9df7-4612-8a43-87cfc0241c99 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:56:20.917285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-faa688af-9df7-4612-8a43-87cfc0241c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:21.015788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa688af-9df7-4612-8a43-87cfc0241c99 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:56:21.084717 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a98fce-e626-4667-8441-1c7184896c99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:56:21.085346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98fce-e626-4667-8441-1c7184896c99 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:21.085626 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98fce-e626-4667-8441-1c7184896c99 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:21.085897 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98fce-e626-4667-8441-1c7184896c99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:21.087520 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-85a98fce-e626-4667-8441-1c7184896c99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:21.191795 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a98fce-e626-4667-8441-1c7184896c99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:56:21.193238 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a98fce-e626-4667-8441-1c7184896c99 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:56:21.210845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 603/1210] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:56:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:56:23.669223 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0ef4c-58b4-45ab-bf34-031de13a8225 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:23.669752 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0ef4c-58b4-45ab-bf34-031de13a8225 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:23.669752 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0ef4c-58b4-45ab-bf34-031de13a8225 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:23.671574 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 608/1211] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:56:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:56:23.677387 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05ca6d-0f50-4d04-96bb-fd1cddef9ccc None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:23.677758 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05ca6d-0f50-4d04-96bb-fd1cddef9ccc None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:23.677951 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05ca6d-0f50-4d04-96bb-fd1cddef9ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:23.741861 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-7a05ca6d-0f50-4d04-96bb-fd1cddef9ccc None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:56:23.743079 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-7a05ca6d-0f50-4d04-96bb-fd1cddef9ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:23.834160 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 604/1212] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:56:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:56:23.876724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0ef4c-58b4-45ab-bf34-031de13a8225 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:56:23.878224 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ffd0ef4c-58b4-45ab-bf34-031de13a8225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:23.976679 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0ef4c-58b4-45ab-bf34-031de13a8225 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:56:24.046230 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacd285-88fa-4887-93b3-1b5b6a964be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:56:24.046865 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacd285-88fa-4887-93b3-1b5b6a964be1 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:24.047144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacd285-88fa-4887-93b3-1b5b6a964be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:24.047439 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacd285-88fa-4887-93b3-1b5b6a964be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:24.049013 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-bcacd285-88fa-4887-93b3-1b5b6a964be1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:24.153420 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacd285-88fa-4887-93b3-1b5b6a964be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:56:24.154839 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacd285-88fa-4887-93b3-1b5b6a964be1 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:56:24.173005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 609/1213] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:56:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:56:26.625014 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1a5c6-5ca3-47ef-b0d4-955b62ddcb40 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:26.625542 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1a5c6-5ca3-47ef-b0d4-955b62ddcb40 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:26.625542 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1a5c6-5ca3-47ef-b0d4-955b62ddcb40 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:26.627321 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 605/1214] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:56:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:56:26.633073 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c05470-12e4-409c-ae48-46edfdd4c8ff None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:26.633454 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c05470-12e4-409c-ae48-46edfdd4c8ff None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:26.633630 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c05470-12e4-409c-ae48-46edfdd4c8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:26.697115 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-c0c05470-12e4-409c-ae48-46edfdd4c8ff None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:56:26.698318 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c0c05470-12e4-409c-ae48-46edfdd4c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:26.791542 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 610/1215] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:56:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:56:26.829639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1a5c6-5ca3-47ef-b0d4-955b62ddcb40 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:56:26.831121 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-bdb1a5c6-5ca3-47ef-b0d4-955b62ddcb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:26.951078 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1a5c6-5ca3-47ef-b0d4-955b62ddcb40 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:56:27.039349 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce998e0-e431-4195-a2c4-2fdca3919836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:56:27.040216 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce998e0-e431-4195-a2c4-2fdca3919836 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:27.040490 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce998e0-e431-4195-a2c4-2fdca3919836 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:27.040755 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce998e0-e431-4195-a2c4-2fdca3919836 admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:27.050905 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce998e0-e431-4195-a2c4-2fdca3919836 admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:56:27.052977 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce998e0-e431-4195-a2c4-2fdca3919836 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:56:27.054623 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 606/1216] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:56:26 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:56:27.067734 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c05470-12e4-409c-ae48-46edfdd4c8ff None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:56:27.068960 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c0c05470-12e4-409c-ae48-46edfdd4c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:27.154863 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c05470-12e4-409c-ae48-46edfdd4c8ff None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:56:27.223822 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969d863-a0dd-4cf9-bdaf-51c88819fc85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:56:27.224411 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969d863-a0dd-4cf9-bdaf-51c88819fc85 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:27.224687 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969d863-a0dd-4cf9-bdaf-51c88819fc85 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:27.224955 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969d863-a0dd-4cf9-bdaf-51c88819fc85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:27.226553 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-1969d863-a0dd-4cf9-bdaf-51c88819fc85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:27.330094 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969d863-a0dd-4cf9-bdaf-51c88819fc85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:56:27.331549 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969d863-a0dd-4cf9-bdaf-51c88819fc85 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:56:27.349038 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 611/1217] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:56:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:56:30.016137 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6a9cd-be2a-430a-a2f7-70d748af367f None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:30.016703 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6a9cd-be2a-430a-a2f7-70d748af367f None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:30.016703 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6a9cd-be2a-430a-a2f7-70d748af367f None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:30.018438 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 607/1218] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:56:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:56:30.024534 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b73355-98f8-45b3-a232-bf59548edcfb None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:30.024937 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b73355-98f8-45b3-a232-bf59548edcfb None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:30.025090 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b73355-98f8-45b3-a232-bf59548edcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:30.087240 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-77b73355-98f8-45b3-a232-bf59548edcfb None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:56:30.088609 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-77b73355-98f8-45b3-a232-bf59548edcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:30.186691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 612/1219] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:56:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:56:30.221649 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6a9cd-be2a-430a-a2f7-70d748af367f None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:56:30.223148 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1bf6a9cd-be2a-430a-a2f7-70d748af367f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:30.342501 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6a9cd-be2a-430a-a2f7-70d748af367f None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:56:30.431729 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bfff6-166e-4e87-81c3-40a419114fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:56:30.432563 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bfff6-166e-4e87-81c3-40a419114fad admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:30.432840 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bfff6-166e-4e87-81c3-40a419114fad admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:30.433109 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bfff6-166e-4e87-81c3-40a419114fad admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:30.442424 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bfff6-166e-4e87-81c3-40a419114fad admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:56:30.444475 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bfff6-166e-4e87-81c3-40a419114fad admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:56:30.446157 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 608/1220] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:56:30 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:56:30.458528 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b73355-98f8-45b3-a232-bf59548edcfb None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:56:30.459755 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-77b73355-98f8-45b3-a232-bf59548edcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:30.557801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b73355-98f8-45b3-a232-bf59548edcfb None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:56:30.632673 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba506303-eda1-47c0-9551-4466ae234465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:56:30.633254 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba506303-eda1-47c0-9551-4466ae234465 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:30.633524 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba506303-eda1-47c0-9551-4466ae234465 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:30.633915 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba506303-eda1-47c0-9551-4466ae234465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:30.635551 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ba506303-eda1-47c0-9551-4466ae234465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:30.739728 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba506303-eda1-47c0-9551-4466ae234465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:56:30.741157 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba506303-eda1-47c0-9551-4466ae234465 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:56:30.758774 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 613/1221] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:56:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:56:33.553976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a2085-cf42-4798-a053-12787c02c03c None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:33.554555 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a2085-cf42-4798-a053-12787c02c03c None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:33.554555 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a2085-cf42-4798-a053-12787c02c03c None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:33.556458 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 609/1222] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:56:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:56:33.562477 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12115fac-c688-4aad-964d-8f70e7e07b87 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:33.562937 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12115fac-c688-4aad-964d-8f70e7e07b87 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:33.563038 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12115fac-c688-4aad-964d-8f70e7e07b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:33.627355 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-12115fac-c688-4aad-964d-8f70e7e07b87 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:56:33.628619 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-12115fac-c688-4aad-964d-8f70e7e07b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:33.730246 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 614/1223] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:56:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:56:33.782921 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0813f-ed5d-43dc-9d4e-fa6461968f7a None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:33.783236 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0813f-ed5d-43dc-9d4e-fa6461968f7a None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:33.783550 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0813f-ed5d-43dc-9d4e-fa6461968f7a None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:33.785330 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 610/1224] 10.222.0.39 () {54 vars in 964 bytes} [Tue Aug 31 02:56:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:56:33.791566 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e19c3-0460-4ab0-a5ca-71afe3f97abd None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:33.792279 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e19c3-0460-4ab0-a5ca-71afe3f97abd None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:33.792366 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e19c3-0460-4ab0-a5ca-71afe3f97abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:33.870025 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-c26e19c3-0460-4ab0-a5ca-71afe3f97abd None None] MFA Rules not processed for user `18b73b8e7244410b8f701b2ab43c5979`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:56:33.871233 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c26e19c3-0460-4ab0-a5ca-71afe3f97abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:33.949726 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 615/1225] 10.222.0.39 () {58 vars in 1062 bytes} [Tue Aug 31 02:56:33 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:56:33.958806 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0813f-ed5d-43dc-9d4e-fa6461968f7a None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:56:33.960376 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-ace0813f-ed5d-43dc-9d4e-fa6461968f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:34.059439 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0813f-ed5d-43dc-9d4e-fa6461968f7a None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:56:34.130081 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26435a0-9c59-4106-9aa2-dfa7b681a9c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:56:34.130720 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26435a0-9c59-4106-9aa2-dfa7b681a9c3 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:34.130998 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26435a0-9c59-4106-9aa2-dfa7b681a9c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:34.131265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26435a0-9c59-4106-9aa2-dfa7b681a9c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:34.132864 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a26435a0-9c59-4106-9aa2-dfa7b681a9c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:34.240324 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26435a0-9c59-4106-9aa2-dfa7b681a9c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:56:34.241735 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26435a0-9c59-4106-9aa2-dfa7b681a9c3 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:56:34.259282 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 611/1226] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:56:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:56:36.736543 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ef64b-1a27-492e-bd47-ed9e51a56e6d None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:36.737103 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ef64b-1a27-492e-bd47-ed9e51a56e6d None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:36.737103 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ef64b-1a27-492e-bd47-ed9e51a56e6d None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:36.738872 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 616/1227] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:56:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:56:36.744766 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e6501-2623-4649-b445-7e6b20d4059a None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:36.745203 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e6501-2623-4649-b445-7e6b20d4059a None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:36.745328 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e6501-2623-4649-b445-7e6b20d4059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:36.808538 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-965e6501-2623-4649-b445-7e6b20d4059a None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:56:36.810314 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-965e6501-2623-4649-b445-7e6b20d4059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:36.906759 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 612/1228] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:56:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:56:36.948565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ef64b-1a27-492e-bd47-ed9e51a56e6d None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:56:36.950364 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-657ef64b-1a27-492e-bd47-ed9e51a56e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:37.052075 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ef64b-1a27-492e-bd47-ed9e51a56e6d None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:56:37.124180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42922d-861b-4cbe-bf80-431308bfcefc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:56:37.125097 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42922d-861b-4cbe-bf80-431308bfcefc service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:37.125379 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42922d-861b-4cbe-bf80-431308bfcefc service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:37.125652 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42922d-861b-4cbe-bf80-431308bfcefc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:37.127258 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-0e42922d-861b-4cbe-bf80-431308bfcefc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:37.232193 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42922d-861b-4cbe-bf80-431308bfcefc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:56:37.233631 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42922d-861b-4cbe-bf80-431308bfcefc service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:56:37.251244 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 617/1229] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:56:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 02:56:39.499214 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dd405-9f45-4dbd-a2ba-6c2b27967d54 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:39.500047 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dd405-9f45-4dbd-a2ba-6c2b27967d54 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:39.500213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dd405-9f45-4dbd-a2ba-6c2b27967d54 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:39.501992 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 613/1230] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:56:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:56:39.507906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224df034-6d7b-4236-a46e-4d002697c7c0 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:39.508353 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224df034-6d7b-4236-a46e-4d002697c7c0 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:39.508598 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224df034-6d7b-4236-a46e-4d002697c7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:39.570321 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-224df034-6d7b-4236-a46e-4d002697c7c0 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:56:39.571558 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-224df034-6d7b-4236-a46e-4d002697c7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:39.663488 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 618/1231] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:56:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:56:39.697821 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dd405-9f45-4dbd-a2ba-6c2b27967d54 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:56:39.699415 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-312dd405-9f45-4dbd-a2ba-6c2b27967d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:39.819391 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dd405-9f45-4dbd-a2ba-6c2b27967d54 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:56:39.934722 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df669c-b0f4-45b7-af04-28fba53c11cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:56:39.935626 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df669c-b0f4-45b7-af04-28fba53c11cc admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:39.935912 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df669c-b0f4-45b7-af04-28fba53c11cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:39.936188 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df669c-b0f4-45b7-af04-28fba53c11cc admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:39.946583 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df669c-b0f4-45b7-af04-28fba53c11cc admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:56:39.948746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df669c-b0f4-45b7-af04-28fba53c11cc admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:56:39.950639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 614/1232] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:56:39 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:56:39.962933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224df034-6d7b-4236-a46e-4d002697c7c0 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:56:39.964641 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-224df034-6d7b-4236-a46e-4d002697c7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:40.052561 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224df034-6d7b-4236-a46e-4d002697c7c0 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:56:40.127185 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e79c4c-f8a1-44aa-b6ca-4b82766fd298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:56:40.127923 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e79c4c-f8a1-44aa-b6ca-4b82766fd298 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:40.128200 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e79c4c-f8a1-44aa-b6ca-4b82766fd298 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:40.128471 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e79c4c-f8a1-44aa-b6ca-4b82766fd298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:40.130055 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-d8e79c4c-f8a1-44aa-b6ca-4b82766fd298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:40.242235 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e79c4c-f8a1-44aa-b6ca-4b82766fd298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:56:40.243714 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e79c4c-f8a1-44aa-b6ca-4b82766fd298 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:56:40.261482 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 619/1233] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:56:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:56:42.819152 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d5b12-7fe9-407c-9866-4dfaadec46fe None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:42.819739 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d5b12-7fe9-407c-9866-4dfaadec46fe None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:42.819739 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d5b12-7fe9-407c-9866-4dfaadec46fe None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:42.821499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 615/1234] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:56:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:56:42.827644 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c61411-6b2b-40c4-954b-bbd72a0d13cb None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:42.828042 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c61411-6b2b-40c4-954b-bbd72a0d13cb None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:42.828204 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c61411-6b2b-40c4-954b-bbd72a0d13cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:42.890669 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-97c61411-6b2b-40c4-954b-bbd72a0d13cb None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:56:42.891878 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-97c61411-6b2b-40c4-954b-bbd72a0d13cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:42.982642 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 620/1235] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:56:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:56:43.018911 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d5b12-7fe9-407c-9866-4dfaadec46fe None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:56:43.020483 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-169d5b12-7fe9-407c-9866-4dfaadec46fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:43.119803 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d5b12-7fe9-407c-9866-4dfaadec46fe None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:56:43.188862 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57614bf0-af4e-4627-9412-46bde647a61f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:56:43.189509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57614bf0-af4e-4627-9412-46bde647a61f service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:43.189793 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57614bf0-af4e-4627-9412-46bde647a61f service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:43.190069 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57614bf0-af4e-4627-9412-46bde647a61f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:43.191705 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-57614bf0-af4e-4627-9412-46bde647a61f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:43.300174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57614bf0-af4e-4627-9412-46bde647a61f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:56:43.301620 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57614bf0-af4e-4627-9412-46bde647a61f service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:56:43.319108 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 616/1236] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:56:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:56:45.486520 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb67528-53fe-4c76-b8ee-48e581347a11 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:45.487038 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb67528-53fe-4c76-b8ee-48e581347a11 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:45.487038 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb67528-53fe-4c76-b8ee-48e581347a11 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:45.488797 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 621/1237] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:56:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:56:45.494690 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ed1e7-f5f7-468e-ac04-26fbf9a1be0b None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:45.495124 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ed1e7-f5f7-468e-ac04-26fbf9a1be0b None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:45.495242 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ed1e7-f5f7-468e-ac04-26fbf9a1be0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:45.556713 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-359ed1e7-f5f7-468e-ac04-26fbf9a1be0b None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:56:45.557884 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-359ed1e7-f5f7-468e-ac04-26fbf9a1be0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:45.655663 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 617/1238] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:56:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:56:45.697509 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb67528-53fe-4c76-b8ee-48e581347a11 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:56:45.699029 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-2cb67528-53fe-4c76-b8ee-48e581347a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:45.798899 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb67528-53fe-4c76-b8ee-48e581347a11 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:56:45.868649 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f481f0-c20a-4072-b656-1128cb01ebd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:56:45.869287 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f481f0-c20a-4072-b656-1128cb01ebd0 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:45.869572 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f481f0-c20a-4072-b656-1128cb01ebd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:45.869848 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f481f0-c20a-4072-b656-1128cb01ebd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:45.872089 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-73f481f0-c20a-4072-b656-1128cb01ebd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:45.974808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f481f0-c20a-4072-b656-1128cb01ebd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:56:45.976314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f481f0-c20a-4072-b656-1128cb01ebd0 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:56:45.995154 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 622/1239] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:56:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:56:48.663845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533fa4d-f4da-444f-a8ab-2339618beb80 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:48.664381 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533fa4d-f4da-444f-a8ab-2339618beb80 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:48.664381 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533fa4d-f4da-444f-a8ab-2339618beb80 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:48.666138 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 618/1240] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:56:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:56:48.672606 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e356c0-a627-4315-ba85-5a3999e63ac0 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:48.672995 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e356c0-a627-4315-ba85-5a3999e63ac0 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:48.673166 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e356c0-a627-4315-ba85-5a3999e63ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:48.742931 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-16e356c0-a627-4315-ba85-5a3999e63ac0 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:56:48.744156 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-16e356c0-a627-4315-ba85-5a3999e63ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:48.844484 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 623/1241] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:56:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:56:48.882354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533fa4d-f4da-444f-a8ab-2339618beb80 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:56:48.884478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-e533fa4d-f4da-444f-a8ab-2339618beb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:48.975337 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533fa4d-f4da-444f-a8ab-2339618beb80 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:56:48.978791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1c13c-c7c7-4fdf-bad5-e3cb8f07e0d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:56:48.979452 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1c13c-c7c7-4fdf-bad5-e3cb8f07e0d0 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:48.979739 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1c13c-c7c7-4fdf-bad5-e3cb8f07e0d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:48.980017 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1c13c-c7c7-4fdf-bad5-e3cb8f07e0d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:48.989383 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1c13c-c7c7-4fdf-bad5-e3cb8f07e0d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:56:48.990807 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1c13c-c7c7-4fdf-bad5-e3cb8f07e0d0 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:56:49.000167 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 619/1242] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:56:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:56:53.097753 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5ae25-ded7-4d6e-9210-9155ba3f470a None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:53.098304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5ae25-ded7-4d6e-9210-9155ba3f470a None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:53.098304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5ae25-ded7-4d6e-9210-9155ba3f470a None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:53.100134 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 624/1243] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:56:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:56:53.106144 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fe2b1-8dcc-4197-affc-d275cf2dec84 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:53.106597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fe2b1-8dcc-4197-affc-d275cf2dec84 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:53.106696 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fe2b1-8dcc-4197-affc-d275cf2dec84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:53.125796 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-bb8fe2b1-8dcc-4197-affc-d275cf2dec84 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:56:53.127028 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-bb8fe2b1-8dcc-4197-affc-d275cf2dec84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:53.135191 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 620/1244] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:56:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:56:53.175175 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5ae25-ded7-4d6e-9210-9155ba3f470a None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:56:53.177056 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-0fd5ae25-ded7-4d6e-9210-9155ba3f470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:53.189815 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5ae25-ded7-4d6e-9210-9155ba3f470a None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:56:53.193550 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94014182-e772-48bf-b4e1-b55c87a56711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:56:53.194223 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94014182-e772-48bf-b4e1-b55c87a56711 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:53.194598 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94014182-e772-48bf-b4e1-b55c87a56711 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:53.194879 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94014182-e772-48bf-b4e1-b55c87a56711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:53.204097 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94014182-e772-48bf-b4e1-b55c87a56711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:56:53.205514 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94014182-e772-48bf-b4e1-b55c87a56711 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:56:53.215508 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 625/1245] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:56:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:56:56.128525 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6576b6-e10a-4b2c-a5c7-42b61c83612f None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:56.128984 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6576b6-e10a-4b2c-a5c7-42b61c83612f None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:56.129093 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6576b6-e10a-4b2c-a5c7-42b61c83612f None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:56.131562 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 621/1246] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:56:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:56:56.138123 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7468a-cef5-4cad-9090-2a8979f81d06 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:56.138544 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7468a-cef5-4cad-9090-2a8979f81d06 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:56.138750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7468a-cef5-4cad-9090-2a8979f81d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:56.156474 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-e3a7468a-cef5-4cad-9090-2a8979f81d06 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:56:56.157677 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-e3a7468a-cef5-4cad-9090-2a8979f81d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:56:56.165403 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 626/1247] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:56:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:56:56.204259 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6576b6-e10a-4b2c-a5c7-42b61c83612f None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:56:56.214567 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6576b6-e10a-4b2c-a5c7-42b61c83612f None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:56:56.218446 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bc63f-af46-4217-bca5-4ebb103596b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:56:56.219076 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bc63f-af46-4217-bca5-4ebb103596b8 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:56:56.219354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bc63f-af46-4217-bca5-4ebb103596b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:56:56.219650 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bc63f-af46-4217-bca5-4ebb103596b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:56:56.228421 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bc63f-af46-4217-bca5-4ebb103596b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:56:56.229831 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bc63f-af46-4217-bca5-4ebb103596b8 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:56:56.239700 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 622/1248] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:56:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:57:00.630714 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb568f8-55ba-4996-b366-05f3616b7669 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:00.631229 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb568f8-55ba-4996-b366-05f3616b7669 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:00.631335 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb568f8-55ba-4996-b366-05f3616b7669 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:00.633150 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 627/1249] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:57:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:00.639338 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f17a4e-ede8-4783-a5db-03e38d061b20 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:00.639852 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f17a4e-ede8-4783-a5db-03e38d061b20 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:00.639976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f17a4e-ede8-4783-a5db-03e38d061b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:00.659561 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-b0f17a4e-ede8-4783-a5db-03e38d061b20 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:00.660808 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b0f17a4e-ede8-4783-a5db-03e38d061b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:00.672983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 623/1250] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:57:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:00.723106 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb568f8-55ba-4996-b366-05f3616b7669 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:00.735276 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb568f8-55ba-4996-b366-05f3616b7669 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:00.740005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced88fee-bf6e-448f-9714-a0e5369b231c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:00.740648 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced88fee-bf6e-448f-9714-a0e5369b231c service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:00.740927 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced88fee-bf6e-448f-9714-a0e5369b231c service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:00.741198 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced88fee-bf6e-448f-9714-a0e5369b231c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:00.752448 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced88fee-bf6e-448f-9714-a0e5369b231c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:00.753890 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced88fee-bf6e-448f-9714-a0e5369b231c service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:00.765412 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 628/1251] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:57:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:57:05.892742 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09502dde-d4e8-4df1-a767-c9b8e4e9c264 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:05.893555 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09502dde-d4e8-4df1-a767-c9b8e4e9c264 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:05.893555 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09502dde-d4e8-4df1-a767-c9b8e4e9c264 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:05.895073 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 624/1252] 10.222.0.39 () {54 vars in 921 bytes} [Tue Aug 31 02:57:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:05.905268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fc219-fd7a-485f-b8ed-489dcca0444f None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:05.905751 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fc219-fd7a-485f-b8ed-489dcca0444f None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:05.905919 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fc219-fd7a-485f-b8ed-489dcca0444f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:06.038331 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-f91fc219-fd7a-485f-b8ed-489dcca0444f None None] MFA Rules not processed for user `bbcf0359f8bc4f55be3307f235f8aac5`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:06.039953 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f91fc219-fd7a-485f-b8ed-489dcca0444f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:06.127448 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 629/1253] 10.222.0.39 () {58 vars in 1019 bytes} [Tue Aug 31 02:57:05 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:57:10.514643 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365921a3-48fe-4ade-8d01-9a3872cd7a8f None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:10.515534 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365921a3-48fe-4ade-8d01-9a3872cd7a8f None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:10.515827 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365921a3-48fe-4ade-8d01-9a3872cd7a8f None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:10.517613 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 625/1254] 10.222.0.39 () {54 vars in 921 bytes} [Tue Aug 31 02:57:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:10.523237 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cef0a5-211f-469b-a92e-01f78177b0f4 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:10.523761 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cef0a5-211f-469b-a92e-01f78177b0f4 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:10.524029 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cef0a5-211f-469b-a92e-01f78177b0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:10.544340 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-e0cef0a5-211f-469b-a92e-01f78177b0f4 None None] MFA Rules not processed for user `bbcf0359f8bc4f55be3307f235f8aac5`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:10.545682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-e0cef0a5-211f-469b-a92e-01f78177b0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:10.554706 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 630/1255] 10.222.0.39 () {58 vars in 1019 bytes} [Tue Aug 31 02:57:10 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:12.003188 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe99b0-e502-44ca-916b-ce8ce3f5e302 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:12.003715 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe99b0-e502-44ca-916b-ce8ce3f5e302 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:12.003806 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe99b0-e502-44ca-916b-ce8ce3f5e302 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:12.005680 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 626/1256] 10.222.0.39 () {54 vars in 921 bytes} [Tue Aug 31 02:57:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:12.010971 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106489d-5f15-4ddc-82c6-e150aabe3e28 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:12.011950 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106489d-5f15-4ddc-82c6-e150aabe3e28 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:12.012769 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106489d-5f15-4ddc-82c6-e150aabe3e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:12.033371 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-2106489d-5f15-4ddc-82c6-e150aabe3e28 None None] MFA Rules not processed for user `bbcf0359f8bc4f55be3307f235f8aac5`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:12.034967 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-2106489d-5f15-4ddc-82c6-e150aabe3e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:12.045231 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 631/1257] 10.222.0.39 () {58 vars in 1019 bytes} [Tue Aug 31 02:57:12 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:15.814453 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1646733-4dda-4300-a838-5b6b921e13c1 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:15.814970 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1646733-4dda-4300-a838-5b6b921e13c1 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:15.815149 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1646733-4dda-4300-a838-5b6b921e13c1 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:15.817194 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 627/1258] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:57:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:15.822759 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f18cf-b707-4ff7-98c2-6a5ca8c99d9f None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:15.823144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f18cf-b707-4ff7-98c2-6a5ca8c99d9f None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:15.823302 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f18cf-b707-4ff7-98c2-6a5ca8c99d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:15.841810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-e91f18cf-b707-4ff7-98c2-6a5ca8c99d9f None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:15.843140 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-e91f18cf-b707-4ff7-98c2-6a5ca8c99d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:15.851532 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 632/1259] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:57:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:15.904855 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1e69b-dbc5-45e9-a979-79cef9078709 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:15.905139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1e69b-dbc5-45e9-a979-79cef9078709 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:15.905489 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1e69b-dbc5-45e9-a979-79cef9078709 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:15.907325 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 628/1260] 10.222.0.39 () {54 vars in 961 bytes} [Tue Aug 31 02:57:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:15.913211 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0dd68-9969-4cd4-b899-09e7794fe8fc None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:15.913594 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0dd68-9969-4cd4-b899-09e7794fe8fc None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:15.914083 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0dd68-9969-4cd4-b899-09e7794fe8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:15.961412 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-ede0dd68-9969-4cd4-b899-09e7794fe8fc None None] MFA Rules not processed for user `a6bb852fc4394f88800ec9616cb65416`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:15.962707 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ede0dd68-9969-4cd4-b899-09e7794fe8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:16.042294 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 633/1261] 10.222.0.39 () {58 vars in 1059 bytes} [Tue Aug 31 02:57:15 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:16.051512 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1e69b-dbc5-45e9-a979-79cef9078709 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:16.067037 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1e69b-dbc5-45e9-a979-79cef9078709 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:16.073422 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d4846-2fc3-42e9-8689-a76d5b781533 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:16.074404 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d4846-2fc3-42e9-8689-a76d5b781533 service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:16.074903 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d4846-2fc3-42e9-8689-a76d5b781533 service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:16.075418 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d4846-2fc3-42e9-8689-a76d5b781533 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:16.083691 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d4846-2fc3-42e9-8689-a76d5b781533 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:16.085489 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d4846-2fc3-42e9-8689-a76d5b781533 service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:16.095575 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 629/1262] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:57:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:57:18.498286 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd05199-61f5-4abc-bc94-9458899ba7a7 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:18.498852 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd05199-61f5-4abc-bc94-9458899ba7a7 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:18.498852 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd05199-61f5-4abc-bc94-9458899ba7a7 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:18.501255 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 634/1263] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:57:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:18.508008 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb0ec9-0632-4f0e-be56-64d6a3b23302 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:18.508609 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb0ec9-0632-4f0e-be56-64d6a3b23302 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:18.508609 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb0ec9-0632-4f0e-be56-64d6a3b23302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:18.528844 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-84fb0ec9-0632-4f0e-be56-64d6a3b23302 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:18.530077 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-84fb0ec9-0632-4f0e-be56-64d6a3b23302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:18.537977 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 630/1264] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:57:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:18.584789 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd05199-61f5-4abc-bc94-9458899ba7a7 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:18.599423 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd05199-61f5-4abc-bc94-9458899ba7a7 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:18.605798 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aac1d0-cfc0-49cc-89d3-42677949e49e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:18.606537 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aac1d0-cfc0-49cc-89d3-42677949e49e service nova] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:18.606919 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aac1d0-cfc0-49cc-89d3-42677949e49e service nova] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:18.607289 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aac1d0-cfc0-49cc-89d3-42677949e49e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:18.616180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aac1d0-cfc0-49cc-89d3-42677949e49e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:18.618042 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aac1d0-cfc0-49cc-89d3-42677949e49e service nova] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:18.630351 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 635/1265] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:57:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:57:21.089261 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6daac5-9874-4dae-9f73-c697a3d5fa62 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:21.089760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6daac5-9874-4dae-9f73-c697a3d5fa62 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:21.089760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6daac5-9874-4dae-9f73-c697a3d5fa62 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:21.091589 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 631/1266] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:57:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:21.097644 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227384f9-c582-4763-8c1d-a11b1b0af683 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:21.098045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227384f9-c582-4763-8c1d-a11b1b0af683 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:21.098201 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227384f9-c582-4763-8c1d-a11b1b0af683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:21.116484 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-227384f9-c582-4763-8c1d-a11b1b0af683 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:21.117676 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-227384f9-c582-4763-8c1d-a11b1b0af683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:21.126754 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 636/1267] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:57:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:21.173998 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581100c-5e21-4a26-b54e-a0d6617751a2 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:21.174290 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581100c-5e21-4a26-b54e-a0d6617751a2 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:21.174580 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581100c-5e21-4a26-b54e-a0d6617751a2 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:21.176355 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 632/1268] 10.222.0.39 () {54 vars in 961 bytes} [Tue Aug 31 02:57:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:21.182055 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566d90d-37c2-46be-aa3d-b133d65cbd9f None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:21.182344 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566d90d-37c2-46be-aa3d-b133d65cbd9f None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:21.182617 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566d90d-37c2-46be-aa3d-b133d65cbd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:21.200782 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-8566d90d-37c2-46be-aa3d-b133d65cbd9f None None] MFA Rules not processed for user `a6bb852fc4394f88800ec9616cb65416`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:21.201951 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-8566d90d-37c2-46be-aa3d-b133d65cbd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:21.211059 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 637/1269] 10.222.0.39 () {58 vars in 1059 bytes} [Tue Aug 31 02:57:21 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:57:21.219550 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581100c-5e21-4a26-b54e-a0d6617751a2 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:21.234953 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581100c-5e21-4a26-b54e-a0d6617751a2 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:21.240412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc3d43-56ff-4b37-ba8c-cc92f88984dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:21.241048 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc3d43-56ff-4b37-ba8c-cc92f88984dd service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:21.241333 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc3d43-56ff-4b37-ba8c-cc92f88984dd service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:21.241606 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc3d43-56ff-4b37-ba8c-cc92f88984dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:21.250027 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc3d43-56ff-4b37-ba8c-cc92f88984dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:21.251905 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc3d43-56ff-4b37-ba8c-cc92f88984dd service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:21.261269 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 633/1270] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:57:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:57:23.519887 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1afa37-c40c-43c1-b3e1-ebf54109b6e9 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:23.520491 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1afa37-c40c-43c1-b3e1-ebf54109b6e9 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:23.520491 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1afa37-c40c-43c1-b3e1-ebf54109b6e9 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:23.522210 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 638/1271] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:57:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:23.528893 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c445355-a71a-45d7-94f1-34d9bef3d7f6 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:23.529317 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c445355-a71a-45d7-94f1-34d9bef3d7f6 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:23.529456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c445355-a71a-45d7-94f1-34d9bef3d7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:23.547903 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-3c445355-a71a-45d7-94f1-34d9bef3d7f6 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:23.549106 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-3c445355-a71a-45d7-94f1-34d9bef3d7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:23.557114 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 634/1272] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:57:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:23.606570 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1afa37-c40c-43c1-b3e1-ebf54109b6e9 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:23.621407 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1afa37-c40c-43c1-b3e1-ebf54109b6e9 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:23.627923 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373bda3-820d-4538-96fe-0ff61a371b6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:23.628786 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373bda3-820d-4538-96fe-0ff61a371b6d service nova] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:23.629254 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373bda3-820d-4538-96fe-0ff61a371b6d service nova] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:23.629710 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373bda3-820d-4538-96fe-0ff61a371b6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:23.639222 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373bda3-820d-4538-96fe-0ff61a371b6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:23.641129 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373bda3-820d-4538-96fe-0ff61a371b6d service nova] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:23.651201 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 639/1273] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:57:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:57:23.670136 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83ad54-f94d-4e0b-b15e-20274c77d01f None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:23.670457 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83ad54-f94d-4e0b-b15e-20274c77d01f None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:23.671072 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83ad54-f94d-4e0b-b15e-20274c77d01f None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:23.673134 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 635/1274] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:57:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:23.679337 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39449c83-309c-469b-858c-8eedc0a11bf8 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:23.679659 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39449c83-309c-469b-858c-8eedc0a11bf8 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:23.679936 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39449c83-309c-469b-858c-8eedc0a11bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:23.707705 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-39449c83-309c-469b-858c-8eedc0a11bf8 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:23.709042 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-39449c83-309c-469b-858c-8eedc0a11bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:23.718937 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 640/1275] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:57:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:57:23.779400 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9260e4-b2cb-464a-ad83-2fadfb7b686c None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:23.779981 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9260e4-b2cb-464a-ad83-2fadfb7b686c None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:23.780398 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9260e4-b2cb-464a-ad83-2fadfb7b686c None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:23.782424 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 636/1276] 10.222.0.39 () {54 vars in 966 bytes} [Tue Aug 31 02:57:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:57:23.788793 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe112b-afc7-4a48-b98a-e336bcc3c938 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:23.789143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe112b-afc7-4a48-b98a-e336bcc3c938 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:23.789538 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe112b-afc7-4a48-b98a-e336bcc3c938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:23.849958 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-0dbe112b-afc7-4a48-b98a-e336bcc3c938 None None] MFA Rules not processed for user `2e701dd89a844fe9aa21c3b5e1fc59cf`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:23.852018 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-0dbe112b-afc7-4a48-b98a-e336bcc3c938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:23.926281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 641/1277] 10.222.0.39 () {58 vars in 1064 bytes} [Tue Aug 31 02:57:23 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:23.935666 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9260e4-b2cb-464a-ad83-2fadfb7b686c None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:23.946766 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9260e4-b2cb-464a-ad83-2fadfb7b686c None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:23.950922 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe9213-7030-4dd7-8e85-7c833572a1c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:23.951939 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe9213-7030-4dd7-8e85-7c833572a1c1 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:23.952458 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe9213-7030-4dd7-8e85-7c833572a1c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:23.953100 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe9213-7030-4dd7-8e85-7c833572a1c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:23.962498 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe9213-7030-4dd7-8e85-7c833572a1c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:23.964545 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe9213-7030-4dd7-8e85-7c833572a1c1 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:23.975215 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 637/1278] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:57:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:57:25.878836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e812e68-400f-499a-ab13-f445eba62446 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:25.879321 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e812e68-400f-499a-ab13-f445eba62446 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:25.879508 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e812e68-400f-499a-ab13-f445eba62446 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:25.881278 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 642/1279] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:57:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:25.888100 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775573f0-bd08-42bb-9c84-063e5434c424 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:25.888538 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775573f0-bd08-42bb-9c84-063e5434c424 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:25.888660 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775573f0-bd08-42bb-9c84-063e5434c424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:25.906736 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-775573f0-bd08-42bb-9c84-063e5434c424 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:25.907989 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-775573f0-bd08-42bb-9c84-063e5434c424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:25.922530 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 638/1280] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:57:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:25.968944 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e812e68-400f-499a-ab13-f445eba62446 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:25.983825 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e812e68-400f-499a-ab13-f445eba62446 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:25.989771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5716ad3-6bd7-4ab2-b47e-01b367418716 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:25.990421 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5716ad3-6bd7-4ab2-b47e-01b367418716 service nova] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:25.990825 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5716ad3-6bd7-4ab2-b47e-01b367418716 service nova] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:25.991101 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5716ad3-6bd7-4ab2-b47e-01b367418716 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:26.003388 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5716ad3-6bd7-4ab2-b47e-01b367418716 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:26.003388 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5716ad3-6bd7-4ab2-b47e-01b367418716 service nova] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:26.012636 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 643/1281] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:57:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:57:28.265817 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30712a-b81f-4dd3-825b-3ee72a7ce4fd None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:28.266330 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30712a-b81f-4dd3-825b-3ee72a7ce4fd None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:28.266411 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30712a-b81f-4dd3-825b-3ee72a7ce4fd None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:28.268119 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 639/1282] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:57:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:28.274180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc6b9d-1af6-49f5-b19d-7044038a930b None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:28.274584 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc6b9d-1af6-49f5-b19d-7044038a930b None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:28.274738 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc6b9d-1af6-49f5-b19d-7044038a930b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:28.292357 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-dadc6b9d-1af6-49f5-b19d-7044038a930b None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:28.294175 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-dadc6b9d-1af6-49f5-b19d-7044038a930b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:28.301979 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 644/1283] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:57:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:28.348687 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30712a-b81f-4dd3-825b-3ee72a7ce4fd None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:28.364179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30712a-b81f-4dd3-825b-3ee72a7ce4fd None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:28.369863 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3cd75-fdc4-4c56-b582-8352dd711848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:28.370494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3cd75-fdc4-4c56-b582-8352dd711848 service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:28.371462 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3cd75-fdc4-4c56-b582-8352dd711848 service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:28.371882 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3cd75-fdc4-4c56-b582-8352dd711848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:28.380417 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3cd75-fdc4-4c56-b582-8352dd711848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:28.381981 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3cd75-fdc4-4c56-b582-8352dd711848 service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:28.391339 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 640/1284] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:57:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:57:30.634290 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7145d86-4477-412f-8a9c-f5cf0b8c2a7a None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:30.634843 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7145d86-4477-412f-8a9c-f5cf0b8c2a7a None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:30.634843 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7145d86-4477-412f-8a9c-f5cf0b8c2a7a None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:30.637223 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 645/1285] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:57:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:30.643151 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af4a1f-bad7-4582-84a8-b6ff60843118 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:30.643584 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af4a1f-bad7-4582-84a8-b6ff60843118 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:30.643740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af4a1f-bad7-4582-84a8-b6ff60843118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:30.662828 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-34af4a1f-bad7-4582-84a8-b6ff60843118 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:30.664041 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-34af4a1f-bad7-4582-84a8-b6ff60843118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:30.671937 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 641/1286] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:57:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:30.715640 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7145d86-4477-412f-8a9c-f5cf0b8c2a7a None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:30.729515 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7145d86-4477-412f-8a9c-f5cf0b8c2a7a None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:30.735506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aed32b-419f-4b6d-93dc-e0b6bd20a7e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:30.736225 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aed32b-419f-4b6d-93dc-e0b6bd20a7e7 service nova] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:30.736728 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aed32b-419f-4b6d-93dc-e0b6bd20a7e7 service nova] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:30.737070 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aed32b-419f-4b6d-93dc-e0b6bd20a7e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:30.746663 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aed32b-419f-4b6d-93dc-e0b6bd20a7e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:30.748806 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aed32b-419f-4b6d-93dc-e0b6bd20a7e7 service nova] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:30.759244 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 646/1287] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:57:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:57:33.538667 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463ce90-0ca9-4dc1-ab5a-012db5b32889 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:33.539450 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463ce90-0ca9-4dc1-ab5a-012db5b32889 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:33.539450 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463ce90-0ca9-4dc1-ab5a-012db5b32889 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:33.541181 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 642/1288] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:57:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:33.548043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f53bf5-58b4-4d02-bc9c-80befb265177 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:33.548620 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f53bf5-58b4-4d02-bc9c-80befb265177 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:33.548743 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f53bf5-58b4-4d02-bc9c-80befb265177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:33.570135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-58f53bf5-58b4-4d02-bc9c-80befb265177 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:33.571626 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-58f53bf5-58b4-4d02-bc9c-80befb265177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:33.582117 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 647/1289] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:57:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:33.632469 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463ce90-0ca9-4dc1-ab5a-012db5b32889 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:33.648070 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463ce90-0ca9-4dc1-ab5a-012db5b32889 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:33.654448 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47519499-360c-4661-a562-eb6b6f150c83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:33.655123 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47519499-360c-4661-a562-eb6b6f150c83 service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:33.655453 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47519499-360c-4661-a562-eb6b6f150c83 service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:33.655757 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47519499-360c-4661-a562-eb6b6f150c83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:33.664447 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47519499-360c-4661-a562-eb6b6f150c83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:33.666112 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47519499-360c-4661-a562-eb6b6f150c83 service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:33.676293 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 643/1290] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:57:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:57:36.101257 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443e289-6d6d-4ff2-9c85-d2905dbccf20 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:36.101826 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443e289-6d6d-4ff2-9c85-d2905dbccf20 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:36.101826 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443e289-6d6d-4ff2-9c85-d2905dbccf20 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:36.103667 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 648/1291] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:57:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:36.110686 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3db2b1-07ec-49ad-ae44-c52c1f883291 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:36.111327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3db2b1-07ec-49ad-ae44-c52c1f883291 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:36.111327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3db2b1-07ec-49ad-ae44-c52c1f883291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:36.130128 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-bd3db2b1-07ec-49ad-ae44-c52c1f883291 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:36.131325 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-bd3db2b1-07ec-49ad-ae44-c52c1f883291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:36.139265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 644/1292] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:57:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:57:36.187581 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443e289-6d6d-4ff2-9c85-d2905dbccf20 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:36.204932 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443e289-6d6d-4ff2-9c85-d2905dbccf20 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:36.211796 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e2687-f6ad-40d4-95fa-adcf54c31226 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:36.212560 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e2687-f6ad-40d4-95fa-adcf54c31226 service nova] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:36.212903 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e2687-f6ad-40d4-95fa-adcf54c31226 service nova] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:36.213252 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e2687-f6ad-40d4-95fa-adcf54c31226 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:36.224418 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e2687-f6ad-40d4-95fa-adcf54c31226 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:36.226411 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e2687-f6ad-40d4-95fa-adcf54c31226 service nova] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:36.238891 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 649/1293] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:57:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:57:38.507712 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7948f6-5144-45ee-909f-e8ff5c15144c None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:38.508280 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7948f6-5144-45ee-909f-e8ff5c15144c None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:38.508280 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7948f6-5144-45ee-909f-e8ff5c15144c None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:38.510073 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 645/1294] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:57:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:38.516947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e7ae3-8818-4a9a-b935-726cdcf8fbc3 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:38.517422 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e7ae3-8818-4a9a-b935-726cdcf8fbc3 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:38.517576 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e7ae3-8818-4a9a-b935-726cdcf8fbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:38.535724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-3b7e7ae3-8818-4a9a-b935-726cdcf8fbc3 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:38.536906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-3b7e7ae3-8818-4a9a-b935-726cdcf8fbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:38.545132 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 650/1295] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:57:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:38.590984 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7948f6-5144-45ee-909f-e8ff5c15144c None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:38.605734 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7948f6-5144-45ee-909f-e8ff5c15144c None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:38.611142 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50a1f0-0446-4a76-80c0-1d1dd21d7411 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:38.611798 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50a1f0-0446-4a76-80c0-1d1dd21d7411 service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:38.612083 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50a1f0-0446-4a76-80c0-1d1dd21d7411 service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:38.612358 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50a1f0-0446-4a76-80c0-1d1dd21d7411 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:38.620784 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50a1f0-0446-4a76-80c0-1d1dd21d7411 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:38.622571 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50a1f0-0446-4a76-80c0-1d1dd21d7411 service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:38.633014 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 646/1296] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:57:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 02:57:38.726661 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e883352-312e-402d-aa59-428f1d82e56b None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:38.726950 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e883352-312e-402d-aa59-428f1d82e56b None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:38.727240 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e883352-312e-402d-aa59-428f1d82e56b None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:38.729125 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 651/1297] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:57:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:57:38.736932 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabcdba-1063-4c71-bb94-177c7c4737db None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:38.737312 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabcdba-1063-4c71-bb94-177c7c4737db None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:38.737653 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabcdba-1063-4c71-bb94-177c7c4737db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:38.757362 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-9aabcdba-1063-4c71-bb94-177c7c4737db None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:38.758653 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-9aabcdba-1063-4c71-bb94-177c7c4737db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:38.767568 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 647/1298] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:57:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:38.829309 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb859c-b94c-4397-93f6-f1353e0265f6 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:38.829598 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb859c-b94c-4397-93f6-f1353e0265f6 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:38.829879 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb859c-b94c-4397-93f6-f1353e0265f6 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:38.831733 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 652/1299] 10.222.0.39 () {54 vars in 966 bytes} [Tue Aug 31 02:57:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:38.837661 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7214cbf-61a8-4b07-a7cd-1d6cbfe513a9 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:38.838035 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7214cbf-61a8-4b07-a7cd-1d6cbfe513a9 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:38.838383 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7214cbf-61a8-4b07-a7cd-1d6cbfe513a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:38.889250 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-f7214cbf-61a8-4b07-a7cd-1d6cbfe513a9 None None] MFA Rules not processed for user `0d763da11c58473c9c2cf981b02835f3`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:38.890442 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f7214cbf-61a8-4b07-a7cd-1d6cbfe513a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:38.952524 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 648/1300] 10.222.0.39 () {58 vars in 1064 bytes} [Tue Aug 31 02:57:38 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:38.960611 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb859c-b94c-4397-93f6-f1353e0265f6 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:38.972236 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb859c-b94c-4397-93f6-f1353e0265f6 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:38.976247 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da5859-416f-4682-9203-97316ccdb84c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d763da11c58473c9c2cf981b02835f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:38.976933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da5859-416f-4682-9203-97316ccdb84c service glance] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:38.977203 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da5859-416f-4682-9203-97316ccdb84c service glance] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:38.977478 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da5859-416f-4682-9203-97316ccdb84c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:38.988635 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da5859-416f-4682-9203-97316ccdb84c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:38.990110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da5859-416f-4682-9203-97316ccdb84c service glance] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:39.000029 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 653/1301] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:57:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:57:39.445417 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022aed4-4ee5-428b-b9c1-257896e853f5 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:39.445779 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022aed4-4ee5-428b-b9c1-257896e853f5 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:39.446118 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022aed4-4ee5-428b-b9c1-257896e853f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:39.501632 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-8022aed4-4ee5-428b-b9c1-257896e853f5 None None] MFA Rules not processed for user `b1918e2aa8f24655875480ef52df324d`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:39.502834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-8022aed4-4ee5-428b-b9c1-257896e853f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:39.564222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 649/1302] 10.222.0.39 () {58 vars in 1010 bytes} [Tue Aug 31 02:57:39 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:39.611442 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ef99e-9c8d-4931-ae4c-256b77a87bc3 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:39.611990 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ef99e-9c8d-4931-ae4c-256b77a87bc3 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:39.611990 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ef99e-9c8d-4931-ae4c-256b77a87bc3 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:39.614173 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 654/1303] 10.222.0.39 () {54 vars in 942 bytes} [Tue Aug 31 02:57:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:39.622494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f442be-b744-4287-a683-85eb76198801 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:39.625452 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f442be-b744-4287-a683-85eb76198801 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:39.626033 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f442be-b744-4287-a683-85eb76198801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:39.680002 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-f3f442be-b744-4287-a683-85eb76198801 None None] MFA Rules not processed for user `55ed84d2e3ce4c85b552732f3294aac6`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:39.681191 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f3f442be-b744-4287-a683-85eb76198801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:39.752031 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 650/1304] 10.222.0.39 () {58 vars in 1040 bytes} [Tue Aug 31 02:57:39 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:39.761936 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ef99e-9c8d-4931-ae4c-256b77a87bc3 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:39.775223 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ef99e-9c8d-4931-ae4c-256b77a87bc3 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:39.780190 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18593e91-5c70-400e-b16d-40a4ee1fa087 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ed84d2e3ce4c85b552732f3294aac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:39.780822 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18593e91-5c70-400e-b16d-40a4ee1fa087 service swift] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:39.781100 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18593e91-5c70-400e-b16d-40a4ee1fa087 service swift] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:39.781371 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18593e91-5c70-400e-b16d-40a4ee1fa087 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:39.789328 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18593e91-5c70-400e-b16d-40a4ee1fa087 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:39.790914 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18593e91-5c70-400e-b16d-40a4ee1fa087 service swift] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:39.799423 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 655/1305] 10.222.0.39 () {60 vars in 1385 bytes} [Tue Aug 31 02:57:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 02:57:40.863650 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61a721-8f91-43cb-baeb-c3a6a4d3528d None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:40.864203 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61a721-8f91-43cb-baeb-c3a6a4d3528d None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:40.864203 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61a721-8f91-43cb-baeb-c3a6a4d3528d None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:40.866128 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 651/1306] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:57:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:40.872797 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3824-1fb4-48c2-98d4-6ade939bfb99 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:40.873240 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3824-1fb4-48c2-98d4-6ade939bfb99 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:40.873355 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3824-1fb4-48c2-98d4-6ade939bfb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:40.893373 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-44ca3824-1fb4-48c2-98d4-6ade939bfb99 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:40.894692 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-44ca3824-1fb4-48c2-98d4-6ade939bfb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:40.903247 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 656/1307] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:57:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:40.950730 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61a721-8f91-43cb-baeb-c3a6a4d3528d None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:40.967946 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61a721-8f91-43cb-baeb-c3a6a4d3528d None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:40.973620 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf4b06-0de4-4c72-8e17-abff169d3f7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:40.974348 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf4b06-0de4-4c72-8e17-abff169d3f7d service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:40.974703 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf4b06-0de4-4c72-8e17-abff169d3f7d service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:40.974985 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf4b06-0de4-4c72-8e17-abff169d3f7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:40.984333 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf4b06-0de4-4c72-8e17-abff169d3f7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:40.987618 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf4b06-0de4-4c72-8e17-abff169d3f7d service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:41.001090 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 652/1308] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:57:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:57:43.242596 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bd195-b823-461c-9d22-47912401072d None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:43.243184 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bd195-b823-461c-9d22-47912401072d None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:43.243184 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bd195-b823-461c-9d22-47912401072d None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:43.250724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 657/1309] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:57:43 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:43.256984 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcaa58-3071-4e77-ab21-48bed5de9912 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:43.262597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcaa58-3071-4e77-ab21-48bed5de9912 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:43.262891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcaa58-3071-4e77-ab21-48bed5de9912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:43.283571 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-b4bcaa58-3071-4e77-ab21-48bed5de9912 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:43.285029 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b4bcaa58-3071-4e77-ab21-48bed5de9912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:43.293999 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 653/1310] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:57:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:57:43.341510 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bd195-b823-461c-9d22-47912401072d None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:43.356597 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bd195-b823-461c-9d22-47912401072d None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:43.362114 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ef678-16b0-4cbe-99ba-97ad1032830f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:43.362890 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ef678-16b0-4cbe-99ba-97ad1032830f service nova] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:43.363172 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ef678-16b0-4cbe-99ba-97ad1032830f service nova] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:43.363471 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ef678-16b0-4cbe-99ba-97ad1032830f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:43.372105 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ef678-16b0-4cbe-99ba-97ad1032830f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:43.373828 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ef678-16b0-4cbe-99ba-97ad1032830f service nova] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:43.387654 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 658/1311] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:57:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:57:57.389705 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecfe9e-8701-4e54-8e9a-6518f20ee064 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:57.390232 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecfe9e-8701-4e54-8e9a-6518f20ee064 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:57.390232 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecfe9e-8701-4e54-8e9a-6518f20ee064 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:57.392011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 654/1312] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:57:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:57.398030 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83796e0c-37f4-4ce7-a1ef-d7da095f3559 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:57.398477 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83796e0c-37f4-4ce7-a1ef-d7da095f3559 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:57.398583 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83796e0c-37f4-4ce7-a1ef-d7da095f3559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:57.416538 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-83796e0c-37f4-4ce7-a1ef-d7da095f3559 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:57.418366 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-83796e0c-37f4-4ce7-a1ef-d7da095f3559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:57.426113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 659/1313] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:57:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:57.452304 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecfe9e-8701-4e54-8e9a-6518f20ee064 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:57.464552 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecfe9e-8701-4e54-8e9a-6518f20ee064 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:57.468945 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9588ef-8a9f-4e53-a9b0-13c22c07d3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:57.469589 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9588ef-8a9f-4e53-a9b0-13c22c07d3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:57.469875 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9588ef-8a9f-4e53-a9b0-13c22c07d3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:57.470154 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9588ef-8a9f-4e53-a9b0-13c22c07d3a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:57.470873 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9588ef-8a9f-4e53-a9b0-13c22c07d3a1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:57.472746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9588ef-8a9f-4e53-a9b0-13c22c07d3a1 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:57.491737 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 655/1314] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Aug 31 02:57:57 2021] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 02:57:59.632764 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6555c11-b2e5-4ce4-8eeb-949a05d76564 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:59.633333 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6555c11-b2e5-4ce4-8eeb-949a05d76564 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:59.633333 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6555c11-b2e5-4ce4-8eeb-949a05d76564 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:59.635057 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 660/1315] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:57:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:57:59.641579 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6174911-5ef2-4cdb-b8cb-15bc2803ef8e None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:59.642018 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6174911-5ef2-4cdb-b8cb-15bc2803ef8e None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:59.642124 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6174911-5ef2-4cdb-b8cb-15bc2803ef8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:59.662619 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-c6174911-5ef2-4cdb-b8cb-15bc2803ef8e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:57:59.664627 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c6174911-5ef2-4cdb-b8cb-15bc2803ef8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:57:59.675346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 656/1316] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:57:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:57:59.699267 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6555c11-b2e5-4ce4-8eeb-949a05d76564 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:59.711518 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6555c11-b2e5-4ce4-8eeb-949a05d76564 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:59.716676 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39376b8d-bc5e-4d29-99fd-e1fae42a9f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:59.717516 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39376b8d-bc5e-4d29-99fd-e1fae42a9f14 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:59.717799 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39376b8d-bc5e-4d29-99fd-e1fae42a9f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:59.718073 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39376b8d-bc5e-4d29-99fd-e1fae42a9f14 admin admin] PATH_INFO: `/v3/projects/16281534bfb145deb85ccb6f132e26eb` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:59.728523 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39376b8d-bc5e-4d29-99fd-e1fae42a9f14 admin admin] RBAC: Authorizing `identity:get_project(project_id=16281534bfb145deb85ccb6f132e26eb)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:59.731322 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39376b8d-bc5e-4d29-99fd-e1fae42a9f14 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:59.733082 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 661/1317] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:57:59 2021] GET /identity/v3/projects/16281534bfb145deb85ccb6f132e26eb => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:57:59.739499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6174911-5ef2-4cdb-b8cb-15bc2803ef8e None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:59.748534 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6174911-5ef2-4cdb-b8cb-15bc2803ef8e None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:59.753444 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bccd3-03f6-406c-b5b3-a71d4c9e84f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:59.754080 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bccd3-03f6-406c-b5b3-a71d4c9e84f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:59.754363 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bccd3-03f6-406c-b5b3-a71d4c9e84f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:59.754635 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bccd3-03f6-406c-b5b3-a71d4c9e84f1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:59.755412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bccd3-03f6-406c-b5b3-a71d4c9e84f1 admin admin] RBAC: Adding query filter params (scope.project.id=16281534bfb145deb85ccb6f132e26eb) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:57:59.755722 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bccd3-03f6-406c-b5b3-a71d4c9e84f1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:59.757546 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bccd3-03f6-406c-b5b3-a71d4c9e84f1 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:59.764917 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 657/1318] 10.222.0.39 () {56 vars in 1232 bytes} [Tue Aug 31 02:57:59 2021] GET /identity/v3/role_assignments?scope.project.id=16281534bfb145deb85ccb6f132e26eb => generated 877 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:57:59.770845 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39376b8d-bc5e-4d29-99fd-e1fae42a9f14 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:59.781443 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39376b8d-bc5e-4d29-99fd-e1fae42a9f14 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:59.785959 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061e7d2-f4c4-4a7b-99d2-eaf27f5c571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:59.786792 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061e7d2-f4c4-4a7b-99d2-eaf27f5c571b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:59.787073 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061e7d2-f4c4-4a7b-99d2-eaf27f5c571b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:59.787349 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061e7d2-f4c4-4a7b-99d2-eaf27f5c571b admin admin] PATH_INFO: `/v3/users/68496879e3b943729b33ca968765ff64` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:59.800455 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061e7d2-f4c4-4a7b-99d2-eaf27f5c571b admin admin] RBAC: Authorizing `identity:get_user(user_id=68496879e3b943729b33ca968765ff64)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:59.802575 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061e7d2-f4c4-4a7b-99d2-eaf27f5c571b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:59.804194 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 662/1319] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:57:59 2021] GET /identity/v3/users/68496879e3b943729b33ca968765ff64 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:57:59.810250 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bccd3-03f6-406c-b5b3-a71d4c9e84f1 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:57:59.819720 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bccd3-03f6-406c-b5b3-a71d4c9e84f1 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:57:59.824879 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea85a69-aa58-4616-beab-dd6f63b84dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:57:59.825727 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea85a69-aa58-4616-beab-dd6f63b84dba admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:57:59.826010 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea85a69-aa58-4616-beab-dd6f63b84dba admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:57:59.826282 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea85a69-aa58-4616-beab-dd6f63b84dba admin admin] PATH_INFO: `/v3/users/7412bae655614de299dffc63b1000809` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:57:59.841136 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea85a69-aa58-4616-beab-dd6f63b84dba admin admin] RBAC: Authorizing `identity:get_user(user_id=7412bae655614de299dffc63b1000809)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:57:59.843272 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea85a69-aa58-4616-beab-dd6f63b84dba admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:57:59.844956 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 658/1320] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:57:59 2021] GET /identity/v3/users/7412bae655614de299dffc63b1000809 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:58:02.126674 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d91eea-d850-42f1-a883-ced466d8b44f None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:02.127087 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d91eea-d850-42f1-a883-ced466d8b44f None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:02.127233 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d91eea-d850-42f1-a883-ced466d8b44f None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:02.129094 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 663/1321] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:58:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:02.135677 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415dbf6-37b7-4249-809b-aa62c2c68f6a None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:02.136174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415dbf6-37b7-4249-809b-aa62c2c68f6a None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:02.136504 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415dbf6-37b7-4249-809b-aa62c2c68f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:02.154799 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-b415dbf6-37b7-4249-809b-aa62c2c68f6a None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:02.156136 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b415dbf6-37b7-4249-809b-aa62c2c68f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:02.163959 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 659/1322] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:58:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:02.189158 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d91eea-d850-42f1-a883-ced466d8b44f None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:02.202023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d91eea-d850-42f1-a883-ced466d8b44f None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:02.206466 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c774510-10c2-4846-8277-cae7034f0c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:02.207311 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c774510-10c2-4846-8277-cae7034f0c00 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:02.207624 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c774510-10c2-4846-8277-cae7034f0c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:02.207901 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c774510-10c2-4846-8277-cae7034f0c00 admin admin] PATH_INFO: `/v3/projects/1f3ea0c6d9a844b497078df826fbafcd` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:02.218401 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c774510-10c2-4846-8277-cae7034f0c00 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f3ea0c6d9a844b497078df826fbafcd)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:02.220501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c774510-10c2-4846-8277-cae7034f0c00 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:02.222240 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 664/1323] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:58:02 2021] GET /identity/v3/projects/1f3ea0c6d9a844b497078df826fbafcd => generated 361 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:58:02.228894 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415dbf6-37b7-4249-809b-aa62c2c68f6a None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:02.238788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415dbf6-37b7-4249-809b-aa62c2c68f6a None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:02.243224 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a69b5-16bd-43a6-85fc-38841ad67e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:02.243884 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a69b5-16bd-43a6-85fc-38841ad67e15 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:02.244162 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a69b5-16bd-43a6-85fc-38841ad67e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:02.244431 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a69b5-16bd-43a6-85fc-38841ad67e15 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:02.245819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a69b5-16bd-43a6-85fc-38841ad67e15 admin admin] RBAC: Adding query filter params (scope.project.id=1f3ea0c6d9a844b497078df826fbafcd) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:58:02.246117 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a69b5-16bd-43a6-85fc-38841ad67e15 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:02.247967 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a69b5-16bd-43a6-85fc-38841ad67e15 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:02.253463 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 660/1324] 10.222.0.39 () {56 vars in 1232 bytes} [Tue Aug 31 02:58:02 2021] GET /identity/v3/role_assignments?scope.project.id=1f3ea0c6d9a844b497078df826fbafcd => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:58:02.259847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c774510-10c2-4846-8277-cae7034f0c00 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:02.269512 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c774510-10c2-4846-8277-cae7034f0c00 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:02.274061 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b7e39-5c01-417a-b143-88a132c5d566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:02.274910 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b7e39-5c01-417a-b143-88a132c5d566 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:02.275187 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b7e39-5c01-417a-b143-88a132c5d566 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:02.275491 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b7e39-5c01-417a-b143-88a132c5d566 admin admin] PATH_INFO: `/v3/users/57ef1ff7d6ce45fd875d7a5130169adb` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:02.288481 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b7e39-5c01-417a-b143-88a132c5d566 admin admin] RBAC: Authorizing `identity:get_user(user_id=57ef1ff7d6ce45fd875d7a5130169adb)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:02.290596 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b7e39-5c01-417a-b143-88a132c5d566 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:02.292937 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 665/1325] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:58:02 2021] GET /identity/v3/users/57ef1ff7d6ce45fd875d7a5130169adb => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:58:04.463846 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e786f7-f7cc-403c-96e4-f49ec1d62aa7 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:04.464932 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e786f7-f7cc-403c-96e4-f49ec1d62aa7 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:04.465184 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e786f7-f7cc-403c-96e4-f49ec1d62aa7 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:04.466816 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 661/1326] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:58:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:04.472617 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89907bfc-f2b6-4487-8bd4-71bcd9383891 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:04.473027 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89907bfc-f2b6-4487-8bd4-71bcd9383891 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:04.473192 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89907bfc-f2b6-4487-8bd4-71bcd9383891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:04.490571 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-89907bfc-f2b6-4487-8bd4-71bcd9383891 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:04.491792 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-89907bfc-f2b6-4487-8bd4-71bcd9383891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:04.499351 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 666/1327] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:58:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:04.523478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e786f7-f7cc-403c-96e4-f49ec1d62aa7 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:04.536055 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e786f7-f7cc-403c-96e4-f49ec1d62aa7 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:04.540409 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81660b-b26f-42d4-ba0a-186536728784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:04.541231 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81660b-b26f-42d4-ba0a-186536728784 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:04.541505 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81660b-b26f-42d4-ba0a-186536728784 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:04.541775 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81660b-b26f-42d4-ba0a-186536728784 admin admin] PATH_INFO: `/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:04.552361 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81660b-b26f-42d4-ba0a-186536728784 admin admin] RBAC: Authorizing `identity:get_project(project_id=2ac5876eff2e49d3bc4acac0831e9a51)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:04.554444 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81660b-b26f-42d4-ba0a-186536728784 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:04.556114 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 662/1328] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:58:04 2021] GET /identity/v3/projects/2ac5876eff2e49d3bc4acac0831e9a51 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:58:04.562737 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89907bfc-f2b6-4487-8bd4-71bcd9383891 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:04.571802 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89907bfc-f2b6-4487-8bd4-71bcd9383891 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:04.576922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a89ed-c33a-4b83-9aab-fa77c63de2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:04.577555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a89ed-c33a-4b83-9aab-fa77c63de2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:04.577837 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a89ed-c33a-4b83-9aab-fa77c63de2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:04.578114 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a89ed-c33a-4b83-9aab-fa77c63de2c4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:04.578867 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a89ed-c33a-4b83-9aab-fa77c63de2c4 admin admin] RBAC: Adding query filter params (scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:58:04.579199 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a89ed-c33a-4b83-9aab-fa77c63de2c4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:04.581074 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a89ed-c33a-4b83-9aab-fa77c63de2c4 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:04.588530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 667/1329] 10.222.0.39 () {56 vars in 1232 bytes} [Tue Aug 31 02:58:04 2021] GET /identity/v3/role_assignments?scope.project.id=2ac5876eff2e49d3bc4acac0831e9a51 => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 02:58:04.595211 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81660b-b26f-42d4-ba0a-186536728784 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:04.604702 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81660b-b26f-42d4-ba0a-186536728784 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:04.609121 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd43b1e-acc9-433a-a05b-e09069768a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:04.609960 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd43b1e-acc9-433a-a05b-e09069768a65 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:04.610240 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd43b1e-acc9-433a-a05b-e09069768a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:04.610521 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd43b1e-acc9-433a-a05b-e09069768a65 admin admin] PATH_INFO: `/v3/users/0f6084bc6fea49b3a21c2fc85578e04e` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:04.623967 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd43b1e-acc9-433a-a05b-e09069768a65 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f6084bc6fea49b3a21c2fc85578e04e)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:04.626059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd43b1e-acc9-433a-a05b-e09069768a65 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:04.627935 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 663/1330] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:58:04 2021] GET /identity/v3/users/0f6084bc6fea49b3a21c2fc85578e04e => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:58:04.633950 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a89ed-c33a-4b83-9aab-fa77c63de2c4 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:04.648280 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a89ed-c33a-4b83-9aab-fa77c63de2c4 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:04.652861 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae329cf5-9311-421d-a359-0082710b9502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:04.653718 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae329cf5-9311-421d-a359-0082710b9502 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:04.653998 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae329cf5-9311-421d-a359-0082710b9502 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:04.654271 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae329cf5-9311-421d-a359-0082710b9502 admin admin] PATH_INFO: `/v3/users/2a89afdaf4304b8588d33fcfb779c592` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:04.655470 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae329cf5-9311-421d-a359-0082710b9502 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a89afdaf4304b8588d33fcfb779c592)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:04.657248 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae329cf5-9311-421d-a359-0082710b9502 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:04.658832 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 668/1331] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:58:04 2021] GET /identity/v3/users/2a89afdaf4304b8588d33fcfb779c592 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:58:06.883776 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb075476-117e-4fff-ae20-f5a0e128782b None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:06.884354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb075476-117e-4fff-ae20-f5a0e128782b None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:06.884661 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb075476-117e-4fff-ae20-f5a0e128782b None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:06.888019 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 664/1332] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:58:06 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:06.894052 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606baacd-24cb-41c9-bec7-060f9732f075 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:06.894487 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606baacd-24cb-41c9-bec7-060f9732f075 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:06.894601 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606baacd-24cb-41c9-bec7-060f9732f075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:06.912226 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-606baacd-24cb-41c9-bec7-060f9732f075 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:06.913404 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-606baacd-24cb-41c9-bec7-060f9732f075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:06.921079 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 669/1333] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:58:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:06.945288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb075476-117e-4fff-ae20-f5a0e128782b None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:06.958068 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb075476-117e-4fff-ae20-f5a0e128782b None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:06.962635 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09634ae-18a7-4129-8a57-a61f7e26fca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:06.963519 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09634ae-18a7-4129-8a57-a61f7e26fca6 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:06.963803 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09634ae-18a7-4129-8a57-a61f7e26fca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:06.964095 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09634ae-18a7-4129-8a57-a61f7e26fca6 admin admin] PATH_INFO: `/v3/projects/2fa811d3b72a44de83c79fec2b3d6685` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:06.974424 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09634ae-18a7-4129-8a57-a61f7e26fca6 admin admin] RBAC: Authorizing `identity:get_project(project_id=2fa811d3b72a44de83c79fec2b3d6685)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:06.976495 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09634ae-18a7-4129-8a57-a61f7e26fca6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:06.978158 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 665/1334] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:58:06 2021] GET /identity/v3/projects/2fa811d3b72a44de83c79fec2b3d6685 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:58:06.984788 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606baacd-24cb-41c9-bec7-060f9732f075 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:06.993579 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606baacd-24cb-41c9-bec7-060f9732f075 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:06.998723 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6536c9-ddab-4ce9-9878-4bfeb3171d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:06.999354 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6536c9-ddab-4ce9-9878-4bfeb3171d14 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:06.999660 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6536c9-ddab-4ce9-9878-4bfeb3171d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:06.999931 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6536c9-ddab-4ce9-9878-4bfeb3171d14 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:07.000680 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6536c9-ddab-4ce9-9878-4bfeb3171d14 admin admin] RBAC: Adding query filter params (scope.project.id=2fa811d3b72a44de83c79fec2b3d6685) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:58:07.000982 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6536c9-ddab-4ce9-9878-4bfeb3171d14 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:07.003062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6536c9-ddab-4ce9-9878-4bfeb3171d14 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:07.009532 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 670/1335] 10.222.0.39 () {56 vars in 1232 bytes} [Tue Aug 31 02:58:06 2021] GET /identity/v3/role_assignments?scope.project.id=2fa811d3b72a44de83c79fec2b3d6685 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 02:58:07.016318 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09634ae-18a7-4129-8a57-a61f7e26fca6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:07.025635 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09634ae-18a7-4129-8a57-a61f7e26fca6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:07.030167 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b4df5-c4d4-4456-874a-cd0be4c5758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:07.031001 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b4df5-c4d4-4456-874a-cd0be4c5758f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:07.031281 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b4df5-c4d4-4456-874a-cd0be4c5758f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:07.031578 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b4df5-c4d4-4456-874a-cd0be4c5758f admin admin] PATH_INFO: `/v3/users/25236dce65d64098adcd0b8966c6c2e1` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:07.044630 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b4df5-c4d4-4456-874a-cd0be4c5758f admin admin] RBAC: Authorizing `identity:get_user(user_id=25236dce65d64098adcd0b8966c6c2e1)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:07.046724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b4df5-c4d4-4456-874a-cd0be4c5758f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:07.049174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 666/1336] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:58:07 2021] GET /identity/v3/users/25236dce65d64098adcd0b8966c6c2e1 => generated 283 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:58:07.054364 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6536c9-ddab-4ce9-9878-4bfeb3171d14 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:07.064458 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6536c9-ddab-4ce9-9878-4bfeb3171d14 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:07.068948 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb41b3-b42d-47a8-acd2-d176b37ca530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:07.069795 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb41b3-b42d-47a8-acd2-d176b37ca530 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:07.070071 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb41b3-b42d-47a8-acd2-d176b37ca530 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:07.070346 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb41b3-b42d-47a8-acd2-d176b37ca530 admin admin] PATH_INFO: `/v3/users/2a89afdaf4304b8588d33fcfb779c592` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:07.071546 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb41b3-b42d-47a8-acd2-d176b37ca530 admin admin] RBAC: Authorizing `identity:get_user(user_id=2a89afdaf4304b8588d33fcfb779c592)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:07.074069 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb41b3-b42d-47a8-acd2-d176b37ca530 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:07.075661 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 671/1337] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:58:07 2021] GET /identity/v3/users/2a89afdaf4304b8588d33fcfb779c592 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:58:09.316478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25accc77-102c-43da-8974-df2df5ab623e None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:09.317004 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25accc77-102c-43da-8974-df2df5ab623e None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:09.317004 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25accc77-102c-43da-8974-df2df5ab623e None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:09.318766 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 667/1338] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:58:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:09.324678 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ccb3c-0351-4338-a629-1cffc5ca14d0 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:09.325135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ccb3c-0351-4338-a629-1cffc5ca14d0 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:09.325231 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ccb3c-0351-4338-a629-1cffc5ca14d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:09.343080 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-b43ccb3c-0351-4338-a629-1cffc5ca14d0 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:09.344297 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b43ccb3c-0351-4338-a629-1cffc5ca14d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:09.351900 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 672/1339] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:58:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:09.376755 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25accc77-102c-43da-8974-df2df5ab623e None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:09.389230 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25accc77-102c-43da-8974-df2df5ab623e None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:09.393604 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6f123-b76c-4322-9927-187daff95296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:09.394437 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6f123-b76c-4322-9927-187daff95296 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:09.394724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6f123-b76c-4322-9927-187daff95296 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:09.394995 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6f123-b76c-4322-9927-187daff95296 admin admin] PATH_INFO: `/v3/projects/5823cf5e70b144c5a0f0b24bc65c867a` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:09.405171 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6f123-b76c-4322-9927-187daff95296 admin admin] RBAC: Authorizing `identity:get_project(project_id=5823cf5e70b144c5a0f0b24bc65c867a)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:09.407222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6f123-b76c-4322-9927-187daff95296 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:09.409038 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 668/1340] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:58:09 2021] GET /identity/v3/projects/5823cf5e70b144c5a0f0b24bc65c867a => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:58:09.415239 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ccb3c-0351-4338-a629-1cffc5ca14d0 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:09.424133 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ccb3c-0351-4338-a629-1cffc5ca14d0 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:09.428789 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1f1ba-5c00-43a2-939d-7bc0ba14c35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:09.429425 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1f1ba-5c00-43a2-939d-7bc0ba14c35a admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:09.429704 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1f1ba-5c00-43a2-939d-7bc0ba14c35a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:09.429973 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1f1ba-5c00-43a2-939d-7bc0ba14c35a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:09.430720 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1f1ba-5c00-43a2-939d-7bc0ba14c35a admin admin] RBAC: Adding query filter params (scope.project.id=5823cf5e70b144c5a0f0b24bc65c867a) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:58:09.431025 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1f1ba-5c00-43a2-939d-7bc0ba14c35a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:09.433646 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1f1ba-5c00-43a2-939d-7bc0ba14c35a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:09.439497 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 673/1341] 10.222.0.39 () {56 vars in 1232 bytes} [Tue Aug 31 02:58:09 2021] GET /identity/v3/role_assignments?scope.project.id=5823cf5e70b144c5a0f0b24bc65c867a => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:58:09.445576 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6f123-b76c-4322-9927-187daff95296 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:09.455680 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6f123-b76c-4322-9927-187daff95296 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:09.460176 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173c822-3601-41e3-a1f1-0aec9b0b1756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:09.461010 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173c822-3601-41e3-a1f1-0aec9b0b1756 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:09.461290 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173c822-3601-41e3-a1f1-0aec9b0b1756 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:09.461562 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173c822-3601-41e3-a1f1-0aec9b0b1756 admin admin] PATH_INFO: `/v3/users/0f6084bc6fea49b3a21c2fc85578e04e` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:09.462726 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173c822-3601-41e3-a1f1-0aec9b0b1756 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f6084bc6fea49b3a21c2fc85578e04e)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:09.464877 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173c822-3601-41e3-a1f1-0aec9b0b1756 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:09.466422 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 669/1342] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:58:09 2021] GET /identity/v3/users/0f6084bc6fea49b3a21c2fc85578e04e => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:58:11.707664 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb361c-f594-4df5-bd1e-aa36279783f9 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:11.708243 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb361c-f594-4df5-bd1e-aa36279783f9 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:11.708243 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb361c-f594-4df5-bd1e-aa36279783f9 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:11.709949 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 674/1343] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:58:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:11.716342 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319ddf4-90f8-4df1-880d-da01c90002a3 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:11.716761 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319ddf4-90f8-4df1-880d-da01c90002a3 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:11.716891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319ddf4-90f8-4df1-880d-da01c90002a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:11.734885 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-2319ddf4-90f8-4df1-880d-da01c90002a3 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:11.736097 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-2319ddf4-90f8-4df1-880d-da01c90002a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:11.743675 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 670/1344] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:58:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:58:11.768021 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb361c-f594-4df5-bd1e-aa36279783f9 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:11.780808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb361c-f594-4df5-bd1e-aa36279783f9 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:11.785269 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048e4b8-6d09-4514-80b1-b54babd7d7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:11.786105 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048e4b8-6d09-4514-80b1-b54babd7d7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:11.786386 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048e4b8-6d09-4514-80b1-b54babd7d7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:11.786659 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048e4b8-6d09-4514-80b1-b54babd7d7b4 admin admin] PATH_INFO: `/v3/projects/8eb33f1e09d7463d8975fc4c37c2e87b` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:11.787857 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048e4b8-6d09-4514-80b1-b54babd7d7b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=8eb33f1e09d7463d8975fc4c37c2e87b)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:11.789631 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048e4b8-6d09-4514-80b1-b54babd7d7b4 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:11.791287 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 675/1345] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:58:11 2021] GET /identity/v3/projects/8eb33f1e09d7463d8975fc4c37c2e87b => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:58:11.797644 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319ddf4-90f8-4df1-880d-da01c90002a3 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:11.806512 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319ddf4-90f8-4df1-880d-da01c90002a3 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:11.811119 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb1abb-6852-4eb1-aef0-a0a7fb357e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:11.811784 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb1abb-6852-4eb1-aef0-a0a7fb357e0a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:11.812070 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb1abb-6852-4eb1-aef0-a0a7fb357e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:11.812343 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb1abb-6852-4eb1-aef0-a0a7fb357e0a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:11.813092 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb1abb-6852-4eb1-aef0-a0a7fb357e0a admin admin] RBAC: Adding query filter params (scope.project.id=8eb33f1e09d7463d8975fc4c37c2e87b) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:58:11.813395 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb1abb-6852-4eb1-aef0-a0a7fb357e0a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:11.815210 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb1abb-6852-4eb1-aef0-a0a7fb357e0a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:11.820755 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 671/1346] 10.222.0.39 () {56 vars in 1232 bytes} [Tue Aug 31 02:58:11 2021] GET /identity/v3/role_assignments?scope.project.id=8eb33f1e09d7463d8975fc4c37c2e87b => generated 879 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:58:11.827615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048e4b8-6d09-4514-80b1-b54babd7d7b4 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:11.837105 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048e4b8-6d09-4514-80b1-b54babd7d7b4 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:11.842349 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8583a2-c4d7-4380-b2a8-4a5dbd5ac63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:11.843195 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8583a2-c4d7-4380-b2a8-4a5dbd5ac63e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:11.843510 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8583a2-c4d7-4380-b2a8-4a5dbd5ac63e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:11.843790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8583a2-c4d7-4380-b2a8-4a5dbd5ac63e admin admin] PATH_INFO: `/v3/users/2a89afdaf4304b8588d33fcfb779c592` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:11.844975 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8583a2-c4d7-4380-b2a8-4a5dbd5ac63e admin admin] RBAC: Authorizing `identity:get_user(user_id=2a89afdaf4304b8588d33fcfb779c592)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:11.846764 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8583a2-c4d7-4380-b2a8-4a5dbd5ac63e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:11.848401 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 676/1347] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:58:11 2021] GET /identity/v3/users/2a89afdaf4304b8588d33fcfb779c592 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:58:14.013198 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddd3a6-c5b0-491d-9825-3d3aa33ecd03 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:14.013853 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddd3a6-c5b0-491d-9825-3d3aa33ecd03 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:14.013853 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddd3a6-c5b0-491d-9825-3d3aa33ecd03 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:14.015544 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 672/1348] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:58:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:14.021515 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1d8f3-2cdb-41a8-9d01-0e191bc33700 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:14.021947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1d8f3-2cdb-41a8-9d01-0e191bc33700 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:14.022062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1d8f3-2cdb-41a8-9d01-0e191bc33700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:14.039047 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-a2e1d8f3-2cdb-41a8-9d01-0e191bc33700 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:14.040274 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a2e1d8f3-2cdb-41a8-9d01-0e191bc33700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:14.048411 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 677/1349] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:58:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:14.072382 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddd3a6-c5b0-491d-9825-3d3aa33ecd03 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:14.084827 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddd3a6-c5b0-491d-9825-3d3aa33ecd03 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:14.089178 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703051b-7194-4765-aa26-5c0a965789b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:14.090042 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703051b-7194-4765-aa26-5c0a965789b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:14.090838 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703051b-7194-4765-aa26-5c0a965789b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:14.091146 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703051b-7194-4765-aa26-5c0a965789b9 admin admin] PATH_INFO: `/v3/projects/f4cd2fc1595c40a5a8f420862b7a5fab` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:14.101519 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703051b-7194-4765-aa26-5c0a965789b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=f4cd2fc1595c40a5a8f420862b7a5fab)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:14.103655 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703051b-7194-4765-aa26-5c0a965789b9 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:14.105359 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 673/1350] 10.222.0.39 () {56 vars in 1208 bytes} [Tue Aug 31 02:58:14 2021] GET /identity/v3/projects/f4cd2fc1595c40a5a8f420862b7a5fab => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:58:14.112468 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1d8f3-2cdb-41a8-9d01-0e191bc33700 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:14.121459 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1d8f3-2cdb-41a8-9d01-0e191bc33700 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:14.126900 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3891fa-7557-4a32-8e66-457d8010947d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:14.127589 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3891fa-7557-4a32-8e66-457d8010947d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:14.127868 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3891fa-7557-4a32-8e66-457d8010947d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:14.128143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3891fa-7557-4a32-8e66-457d8010947d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:14.129189 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3891fa-7557-4a32-8e66-457d8010947d admin admin] RBAC: Adding query filter params (scope.project.id=f4cd2fc1595c40a5a8f420862b7a5fab) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 02:58:14.129189 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3891fa-7557-4a32-8e66-457d8010947d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:14.131002 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3891fa-7557-4a32-8e66-457d8010947d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:14.137343 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 678/1351] 10.222.0.39 () {56 vars in 1232 bytes} [Tue Aug 31 02:58:14 2021] GET /identity/v3/role_assignments?scope.project.id=f4cd2fc1595c40a5a8f420862b7a5fab => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 02:58:14.143763 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703051b-7194-4765-aa26-5c0a965789b9 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:14.154070 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703051b-7194-4765-aa26-5c0a965789b9 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:14.158691 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726a641-1967-4a8c-8c47-c25f91d22e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:14.159574 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726a641-1967-4a8c-8c47-c25f91d22e73 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:14.159855 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726a641-1967-4a8c-8c47-c25f91d22e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:14.160127 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726a641-1967-4a8c-8c47-c25f91d22e73 admin admin] PATH_INFO: `/v3/users/e5f4549b47284153b493a351d674a5d0` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:14.173889 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726a641-1967-4a8c-8c47-c25f91d22e73 admin admin] RBAC: Authorizing `identity:get_user(user_id=e5f4549b47284153b493a351d674a5d0)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:14.176047 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726a641-1967-4a8c-8c47-c25f91d22e73 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:14.177676 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 674/1352] 10.222.0.39 () {56 vars in 1199 bytes} [Tue Aug 31 02:58:14 2021] GET /identity/v3/users/e5f4549b47284153b493a351d674a5d0 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 02:58:19.429419 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239e3c-40d4-48b7-9cc5-ceec16a5fbb1 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:19.429947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239e3c-40d4-48b7-9cc5-ceec16a5fbb1 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:19.429947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239e3c-40d4-48b7-9cc5-ceec16a5fbb1 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:19.431766 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 679/1353] 10.222.0.39 () {54 vars in 918 bytes} [Tue Aug 31 02:58:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:19.438364 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01da8a1-13ed-4106-97ac-9b08a04a02c4 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:19.438760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01da8a1-13ed-4106-97ac-9b08a04a02c4 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:19.438922 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01da8a1-13ed-4106-97ac-9b08a04a02c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:19.456467 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-a01da8a1-13ed-4106-97ac-9b08a04a02c4 None None] MFA Rules not processed for user `bbcf0359f8bc4f55be3307f235f8aac5`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:19.457673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a01da8a1-13ed-4106-97ac-9b08a04a02c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:19.466083 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 675/1354] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Aug 31 02:58:19 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:19.481541 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bfb2b-622c-4242-a951-c6ddfec44510 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:19.481823 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bfb2b-622c-4242-a951-c6ddfec44510 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:19.482225 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bfb2b-622c-4242-a951-c6ddfec44510 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:19.484105 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 680/1355] 10.222.0.39 () {54 vars in 918 bytes} [Tue Aug 31 02:58:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:19.489352 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ec545-3746-4dab-b840-934770e5172f None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:19.489639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ec545-3746-4dab-b840-934770e5172f None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:19.489943 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ec545-3746-4dab-b840-934770e5172f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:19.508026 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-4c6ec545-3746-4dab-b840-934770e5172f None None] MFA Rules not processed for user `a6bb852fc4394f88800ec9616cb65416`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:19.509215 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-4c6ec545-3746-4dab-b840-934770e5172f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:19.519535 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 676/1356] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Aug 31 02:58:19 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:22.321831 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098d11d-01c4-4a91-94a4-db46b1155dbc None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:22.322401 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098d11d-01c4-4a91-94a4-db46b1155dbc None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:22.322401 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098d11d-01c4-4a91-94a4-db46b1155dbc None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:22.324226 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 681/1357] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:58:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:22.330018 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d1b25-67f5-4140-ba86-db162ba10f66 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:22.330414 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d1b25-67f5-4140-ba86-db162ba10f66 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:22.330574 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d1b25-67f5-4140-ba86-db162ba10f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:22.348184 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-4f1d1b25-67f5-4140-ba86-db162ba10f66 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:22.349375 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-4f1d1b25-67f5-4140-ba86-db162ba10f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:22.357753 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 677/1358] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:58:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:22.401050 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098d11d-01c4-4a91-94a4-db46b1155dbc None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:22.414811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098d11d-01c4-4a91-94a4-db46b1155dbc None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:22.420779 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cfb72-fcfb-4623-8ecc-b14cb4ac7b09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:22.422576 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cfb72-fcfb-4623-8ecc-b14cb4ac7b09 service nova] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:22.422576 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cfb72-fcfb-4623-8ecc-b14cb4ac7b09 service nova] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:22.422576 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cfb72-fcfb-4623-8ecc-b14cb4ac7b09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:22.432058 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cfb72-fcfb-4623-8ecc-b14cb4ac7b09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:22.433650 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cfb72-fcfb-4623-8ecc-b14cb4ac7b09 service nova] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:22.443904 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 682/1359] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:58:23.844670 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a764d6-bbe3-4fed-aefd-90bc47223cba None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:23.845172 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a764d6-bbe3-4fed-aefd-90bc47223cba None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:23.845172 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a764d6-bbe3-4fed-aefd-90bc47223cba None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:23.846876 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 678/1360] 10.222.0.39 () {54 vars in 911 bytes} [Tue Aug 31 02:58:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:23.852450 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3cb74-7284-4b39-a344-405f2fb3f5f4 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:23.852846 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3cb74-7284-4b39-a344-405f2fb3f5f4 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:23.853010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3cb74-7284-4b39-a344-405f2fb3f5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:23.872417 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-b0b3cb74-7284-4b39-a344-405f2fb3f5f4 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:23.873606 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b0b3cb74-7284-4b39-a344-405f2fb3f5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:23.881549 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 683/1361] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Aug 31 02:58:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:24.033347 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a764d6-bbe3-4fed-aefd-90bc47223cba None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:24.047850 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a764d6-bbe3-4fed-aefd-90bc47223cba None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:24.053077 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd301b02-c7d1-4e47-b81c-321565b84dfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:24.053701 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd301b02-c7d1-4e47-b81c-321565b84dfa service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:24.053980 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd301b02-c7d1-4e47-b81c-321565b84dfa service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:24.054254 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd301b02-c7d1-4e47-b81c-321565b84dfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:24.062988 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd301b02-c7d1-4e47-b81c-321565b84dfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:24.064627 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd301b02-c7d1-4e47-b81c-321565b84dfa service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:24.073607 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 679/1362] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:58:25.474312 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e733e56-b701-4984-b09a-ed3f5766beaf None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:25.474839 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e733e56-b701-4984-b09a-ed3f5766beaf None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:25.474839 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e733e56-b701-4984-b09a-ed3f5766beaf None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:25.476583 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 684/1363] 10.222.0.39 () {54 vars in 911 bytes} [Tue Aug 31 02:58:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:25.482564 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cedf88-06fb-4e68-84b6-7bd28ceb2b59 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:25.483010 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cedf88-06fb-4e68-84b6-7bd28ceb2b59 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:25.483122 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cedf88-06fb-4e68-84b6-7bd28ceb2b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:25.501168 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-70cedf88-06fb-4e68-84b6-7bd28ceb2b59 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:25.502593 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-70cedf88-06fb-4e68-84b6-7bd28ceb2b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:25.510066 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 680/1364] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Aug 31 02:58:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:25.660516 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e733e56-b701-4984-b09a-ed3f5766beaf None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:25.674968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e733e56-b701-4984-b09a-ed3f5766beaf None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:25.680263 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f5d88-0693-4911-932d-fe4a373a9920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:25.680890 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f5d88-0693-4911-932d-fe4a373a9920 service nova] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:25.681170 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f5d88-0693-4911-932d-fe4a373a9920 service nova] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:25.681441 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f5d88-0693-4911-932d-fe4a373a9920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:25.689381 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f5d88-0693-4911-932d-fe4a373a9920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:25.690952 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f5d88-0693-4911-932d-fe4a373a9920 service nova] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:25.699946 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 685/1365] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:58:27.111069 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb15f9d-538c-4f50-9304-f01b1662f681 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:27.111646 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb15f9d-538c-4f50-9304-f01b1662f681 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:27.111646 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb15f9d-538c-4f50-9304-f01b1662f681 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:27.113424 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 681/1366] 10.222.0.39 () {54 vars in 911 bytes} [Tue Aug 31 02:58:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:27.118972 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa990eaa-e713-48c5-b8cd-24d6a05dd66e None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:27.119401 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa990eaa-e713-48c5-b8cd-24d6a05dd66e None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:27.119554 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa990eaa-e713-48c5-b8cd-24d6a05dd66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:27.137130 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-aa990eaa-e713-48c5-b8cd-24d6a05dd66e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:27.138301 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-aa990eaa-e713-48c5-b8cd-24d6a05dd66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:27.145973 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 686/1367] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Aug 31 02:58:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:27.298642 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb15f9d-538c-4f50-9304-f01b1662f681 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:27.312905 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb15f9d-538c-4f50-9304-f01b1662f681 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:27.318228 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dce10-6e38-4960-b850-a0e65ad0bf2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:27.318856 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dce10-6e38-4960-b850-a0e65ad0bf2f service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:27.319137 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dce10-6e38-4960-b850-a0e65ad0bf2f service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:27.319434 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dce10-6e38-4960-b850-a0e65ad0bf2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:27.327206 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dce10-6e38-4960-b850-a0e65ad0bf2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:27.328797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dce10-6e38-4960-b850-a0e65ad0bf2f service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:27.337841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 682/1368] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:58:28.739256 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9117b-5ace-48f8-8c5a-a1fc5338d47f None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:28.739813 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9117b-5ace-48f8-8c5a-a1fc5338d47f None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:28.739906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9117b-5ace-48f8-8c5a-a1fc5338d47f None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:28.741624 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 687/1369] 10.222.0.39 () {54 vars in 911 bytes} [Tue Aug 31 02:58:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:28.747891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30099e-b2ff-4ff1-9a8e-54ee1ab637b0 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:28.748326 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30099e-b2ff-4ff1-9a8e-54ee1ab637b0 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:28.748431 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30099e-b2ff-4ff1-9a8e-54ee1ab637b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:28.767167 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-9c30099e-b2ff-4ff1-9a8e-54ee1ab637b0 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:28.768605 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-9c30099e-b2ff-4ff1-9a8e-54ee1ab637b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:28.777974 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 683/1370] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Aug 31 02:58:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:28.931118 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9117b-5ace-48f8-8c5a-a1fc5338d47f None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:28.945773 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9117b-5ace-48f8-8c5a-a1fc5338d47f None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:28.951738 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5ea0f-ff56-4a2a-a785-3830a41934c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:28.952368 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5ea0f-ff56-4a2a-a785-3830a41934c2 service nova] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:28.952649 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5ea0f-ff56-4a2a-a785-3830a41934c2 service nova] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:28.952922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5ea0f-ff56-4a2a-a785-3830a41934c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:28.960737 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5ea0f-ff56-4a2a-a785-3830a41934c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:28.962310 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5ea0f-ff56-4a2a-a785-3830a41934c2 service nova] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:28.971679 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 688/1371] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:58:30.302003 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9bd46-d523-4a20-83f2-41caf368e4f1 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:30.302554 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9bd46-d523-4a20-83f2-41caf368e4f1 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:30.302554 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9bd46-d523-4a20-83f2-41caf368e4f1 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:30.304385 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 684/1372] 10.222.0.39 () {54 vars in 911 bytes} [Tue Aug 31 02:58:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:30.310757 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c34db-ffcc-4d24-8930-737a1dfeb11b None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:30.311211 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c34db-ffcc-4d24-8930-737a1dfeb11b None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:30.311313 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c34db-ffcc-4d24-8930-737a1dfeb11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:30.329359 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-526c34db-ffcc-4d24-8930-737a1dfeb11b None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:30.330543 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-526c34db-ffcc-4d24-8930-737a1dfeb11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:30.338248 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 689/1373] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Aug 31 02:58:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:30.490469 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9bd46-d523-4a20-83f2-41caf368e4f1 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:30.507596 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9bd46-d523-4a20-83f2-41caf368e4f1 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:30.513107 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbdf33-b47b-4b2b-b5ef-8603534b9839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:30.513731 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbdf33-b47b-4b2b-b5ef-8603534b9839 service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:30.514008 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbdf33-b47b-4b2b-b5ef-8603534b9839 service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:30.514278 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbdf33-b47b-4b2b-b5ef-8603534b9839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:30.522123 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbdf33-b47b-4b2b-b5ef-8603534b9839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:30.523793 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbdf33-b47b-4b2b-b5ef-8603534b9839 service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:30.532712 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 685/1374] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:58:31.870002 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059a4d9-72b1-460f-90b1-af948289a274 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:31.870534 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059a4d9-72b1-460f-90b1-af948289a274 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:31.870534 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059a4d9-72b1-460f-90b1-af948289a274 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:31.872591 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 690/1375] 10.222.0.39 () {54 vars in 911 bytes} [Tue Aug 31 02:58:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:31.878432 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c269e92-729a-488b-8211-3ce8c3da09a1 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:31.878870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c269e92-729a-488b-8211-3ce8c3da09a1 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:31.879008 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c269e92-729a-488b-8211-3ce8c3da09a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:31.896583 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-0c269e92-729a-488b-8211-3ce8c3da09a1 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:31.897781 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0c269e92-729a-488b-8211-3ce8c3da09a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:31.906357 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 686/1376] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Aug 31 02:58:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:32.058165 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059a4d9-72b1-460f-90b1-af948289a274 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:32.072498 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059a4d9-72b1-460f-90b1-af948289a274 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:32.078577 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94af96e-3cab-4470-a0b0-a6b71a2c93b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:32.079210 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94af96e-3cab-4470-a0b0-a6b71a2c93b6 service nova] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:32.079524 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94af96e-3cab-4470-a0b0-a6b71a2c93b6 service nova] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:32.079796 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94af96e-3cab-4470-a0b0-a6b71a2c93b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:32.087706 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94af96e-3cab-4470-a0b0-a6b71a2c93b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:32.089277 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94af96e-3cab-4470-a0b0-a6b71a2c93b6 service nova] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:32.098947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 691/1377] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:58:33.412439 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808ef71-1cd1-4b39-bd43-0a30acd222df None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:33.412959 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808ef71-1cd1-4b39-bd43-0a30acd222df None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:33.412959 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808ef71-1cd1-4b39-bd43-0a30acd222df None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:33.414703 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 687/1378] 10.222.0.39 () {54 vars in 911 bytes} [Tue Aug 31 02:58:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:33.420120 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408eab1-8f79-437c-ba8e-d942eebe9d0a None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:33.420574 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408eab1-8f79-437c-ba8e-d942eebe9d0a None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:33.420669 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408eab1-8f79-437c-ba8e-d942eebe9d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:33.438620 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-d408eab1-8f79-437c-ba8e-d942eebe9d0a None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:33.439820 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-d408eab1-8f79-437c-ba8e-d942eebe9d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:33.447349 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 692/1379] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Aug 31 02:58:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:33.601215 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808ef71-1cd1-4b39-bd43-0a30acd222df None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:33.615785 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808ef71-1cd1-4b39-bd43-0a30acd222df None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:33.628812 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca2627-8565-4281-b447-e6445baf741b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:33.629908 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca2627-8565-4281-b447-e6445baf741b service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:33.630404 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca2627-8565-4281-b447-e6445baf741b service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:33.630906 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca2627-8565-4281-b447-e6445baf741b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:33.643590 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca2627-8565-4281-b447-e6445baf741b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:33.645207 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca2627-8565-4281-b447-e6445baf741b service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:33.654965 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 688/1380] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:58:34.999391 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5952ee-3a60-4bc4-a297-8a54492ed60e None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:34.999391 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5952ee-3a60-4bc4-a297-8a54492ed60e None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:34.999391 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5952ee-3a60-4bc4-a297-8a54492ed60e None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:35.000243 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 693/1381] 10.222.0.39 () {54 vars in 911 bytes} [Tue Aug 31 02:58:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 02:58:35.006303 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f80280-7117-4fd0-803f-9cc8904c83ad None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:35.006768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f80280-7117-4fd0-803f-9cc8904c83ad None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:35.006883 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f80280-7117-4fd0-803f-9cc8904c83ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:35.024870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-a3f80280-7117-4fd0-803f-9cc8904c83ad None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:35.026037 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a3f80280-7117-4fd0-803f-9cc8904c83ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:35.033903 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 689/1382] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Aug 31 02:58:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:35.186153 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5952ee-3a60-4bc4-a297-8a54492ed60e None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:35.200537 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5952ee-3a60-4bc4-a297-8a54492ed60e None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:35.206167 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e882445-d722-47ff-917f-f9458b699736 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:35.206811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e882445-d722-47ff-917f-f9458b699736 service nova] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:35.207091 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e882445-d722-47ff-917f-f9458b699736 service nova] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:35.207423 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e882445-d722-47ff-917f-f9458b699736 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:35.215923 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e882445-d722-47ff-917f-f9458b699736 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:35.217506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e882445-d722-47ff-917f-f9458b699736 service nova] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:35.226554 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 694/1383] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:58:37.280275 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec49bba-8984-4c39-8810-664c4d25a031 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:37.280876 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec49bba-8984-4c39-8810-664c4d25a031 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:37.280876 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec49bba-8984-4c39-8810-664c4d25a031 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:37.282593 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 690/1384] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:58:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:37.288582 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1910e44-6971-4e4d-a0cb-c49aedf839cf None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:37.288998 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1910e44-6971-4e4d-a0cb-c49aedf839cf None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:37.289110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1910e44-6971-4e4d-a0cb-c49aedf839cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:37.307130 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-d1910e44-6971-4e4d-a0cb-c49aedf839cf None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:37.308343 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-d1910e44-6971-4e4d-a0cb-c49aedf839cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:37.316542 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 695/1385] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:58:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:37.354699 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec49bba-8984-4c39-8810-664c4d25a031 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:37.365551 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec49bba-8984-4c39-8810-664c4d25a031 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:37.369008 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2041a00-0e6f-429d-b78b-c6a8ffa41e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:37.369629 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041a00-0e6f-429d-b78b-c6a8ffa41e6b service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:37.369905 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041a00-0e6f-429d-b78b-c6a8ffa41e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:37.370176 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041a00-0e6f-429d-b78b-c6a8ffa41e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:37.379591 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2041a00-0e6f-429d-b78b-c6a8ffa41e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:37.380940 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2041a00-0e6f-429d-b78b-c6a8ffa41e6b service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:37.390208 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 691/1386] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:58:39.772612 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53af3d-8ebb-45ab-b87c-9a655cc52a42 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:39.773169 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53af3d-8ebb-45ab-b87c-9a655cc52a42 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:39.773169 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53af3d-8ebb-45ab-b87c-9a655cc52a42 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:39.774952 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 696/1387] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:58:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:39.781500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce240bf-7d61-4303-9347-80d40c65fe3c None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:39.781901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce240bf-7d61-4303-9347-80d40c65fe3c None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:39.782061 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce240bf-7d61-4303-9347-80d40c65fe3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:39.799299 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-2ce240bf-7d61-4303-9347-80d40c65fe3c None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:39.800509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-2ce240bf-7d61-4303-9347-80d40c65fe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:39.808055 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 692/1388] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:58:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:39.847826 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53af3d-8ebb-45ab-b87c-9a655cc52a42 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:39.858408 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53af3d-8ebb-45ab-b87c-9a655cc52a42 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:39.861885 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923148e-7aa2-415a-9885-563aab496ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:39.862513 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923148e-7aa2-415a-9885-563aab496ceb service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:39.862793 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923148e-7aa2-415a-9885-563aab496ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:39.863066 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923148e-7aa2-415a-9885-563aab496ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:39.872175 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923148e-7aa2-415a-9885-563aab496ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:39.873602 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923148e-7aa2-415a-9885-563aab496ceb service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:39.883179 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 697/1389] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:58:42.351996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75945a9-2caa-4e98-bd2f-439c6f6e44a9 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:42.352542 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75945a9-2caa-4e98-bd2f-439c6f6e44a9 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:42.352542 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75945a9-2caa-4e98-bd2f-439c6f6e44a9 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:42.354323 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 693/1390] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:58:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:42.360730 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47b10a-2848-4019-946b-f079050b7971 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:42.361119 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47b10a-2848-4019-946b-f079050b7971 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:42.361280 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47b10a-2848-4019-946b-f079050b7971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:42.378944 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-ab47b10a-2848-4019-946b-f079050b7971 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:42.380088 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ab47b10a-2848-4019-946b-f079050b7971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:42.387798 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 698/1391] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:58:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:42.427425 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75945a9-2caa-4e98-bd2f-439c6f6e44a9 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:42.437918 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75945a9-2caa-4e98-bd2f-439c6f6e44a9 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:42.441416 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b3b3e-4d78-4655-992a-5d419ac3e4e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:42.442043 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b3b3e-4d78-4655-992a-5d419ac3e4e3 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:42.442346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b3b3e-4d78-4655-992a-5d419ac3e4e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:42.442608 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b3b3e-4d78-4655-992a-5d419ac3e4e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:42.451862 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b3b3e-4d78-4655-992a-5d419ac3e4e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:42.453280 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b3b3e-4d78-4655-992a-5d419ac3e4e3 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:42.462339 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 694/1392] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:58:44.717268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa84e58-3452-4f97-947e-f37ed1b26fc4 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:44.717877 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa84e58-3452-4f97-947e-f37ed1b26fc4 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:44.717877 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa84e58-3452-4f97-947e-f37ed1b26fc4 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:44.719630 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 699/1393] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:58:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:44.725327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57bf74-27e2-445f-9ee4-79be67f0b9fd None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:44.725759 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57bf74-27e2-445f-9ee4-79be67f0b9fd None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:44.725868 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57bf74-27e2-445f-9ee4-79be67f0b9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:44.743547 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-ba57bf74-27e2-445f-9ee4-79be67f0b9fd None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:44.744723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-ba57bf74-27e2-445f-9ee4-79be67f0b9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:44.753213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 695/1394] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:58:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:44.791568 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa84e58-3452-4f97-947e-f37ed1b26fc4 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:44.802872 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa84e58-3452-4f97-947e-f37ed1b26fc4 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:44.806330 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40449d79-6fea-4f09-bb4e-e07d8246e0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:44.806956 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40449d79-6fea-4f09-bb4e-e07d8246e0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:44.807232 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40449d79-6fea-4f09-bb4e-e07d8246e0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:44.807531 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40449d79-6fea-4f09-bb4e-e07d8246e0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:44.817067 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40449d79-6fea-4f09-bb4e-e07d8246e0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:44.818479 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40449d79-6fea-4f09-bb4e-e07d8246e0c4 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:44.828017 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 700/1395] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:58:47.027589 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac738205-f305-499e-a0af-f493d60b6bb2 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:47.028146 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac738205-f305-499e-a0af-f493d60b6bb2 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:47.028265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac738205-f305-499e-a0af-f493d60b6bb2 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:47.030069 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 696/1396] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:58:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:47.036207 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c719dd9-6ac3-403f-bee7-c655f9b101e6 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:47.036648 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c719dd9-6ac3-403f-bee7-c655f9b101e6 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:47.038461 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c719dd9-6ac3-403f-bee7-c655f9b101e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:47.065460 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-6c719dd9-6ac3-403f-bee7-c655f9b101e6 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:47.067341 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-6c719dd9-6ac3-403f-bee7-c655f9b101e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:47.076019 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 701/1397] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:58:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:47.115206 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac738205-f305-499e-a0af-f493d60b6bb2 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:47.125986 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac738205-f305-499e-a0af-f493d60b6bb2 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:47.129687 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78090e-07ed-4ddc-8448-14acf1ef7ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:47.130319 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78090e-07ed-4ddc-8448-14acf1ef7ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:47.130587 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78090e-07ed-4ddc-8448-14acf1ef7ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:47.130864 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78090e-07ed-4ddc-8448-14acf1ef7ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:47.140489 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78090e-07ed-4ddc-8448-14acf1ef7ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:47.141900 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78090e-07ed-4ddc-8448-14acf1ef7ee6 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:47.150980 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 697/1398] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:58:49.404662 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8efda0-1535-4f94-bec9-63717d910853 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:49.405180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8efda0-1535-4f94-bec9-63717d910853 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:49.405392 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8efda0-1535-4f94-bec9-63717d910853 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:49.408166 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 702/1399] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:58:49 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:49.414201 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64514f-3eb8-40cc-90f7-5f1bfe5a6988 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:49.414679 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64514f-3eb8-40cc-90f7-5f1bfe5a6988 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:49.414786 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64514f-3eb8-40cc-90f7-5f1bfe5a6988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:49.432763 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-1a64514f-3eb8-40cc-90f7-5f1bfe5a6988 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:49.434178 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1a64514f-3eb8-40cc-90f7-5f1bfe5a6988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:49.441893 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 698/1400] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:58:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:49.481263 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8efda0-1535-4f94-bec9-63717d910853 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:49.491587 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8efda0-1535-4f94-bec9-63717d910853 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:49.495081 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07e2f9-e0a7-41f0-a448-5f52021e1cff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:49.495794 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07e2f9-e0a7-41f0-a448-5f52021e1cff service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:49.496081 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07e2f9-e0a7-41f0-a448-5f52021e1cff service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:49.496346 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07e2f9-e0a7-41f0-a448-5f52021e1cff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:49.505101 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07e2f9-e0a7-41f0-a448-5f52021e1cff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:49.506530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07e2f9-e0a7-41f0-a448-5f52021e1cff service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:49.516631 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 703/1401] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:58:51.730921 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2b069-6098-4fac-ba9e-c1fd3d497f1c None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:51.731526 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2b069-6098-4fac-ba9e-c1fd3d497f1c None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:51.731526 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2b069-6098-4fac-ba9e-c1fd3d497f1c None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:51.733271 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 699/1402] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:58:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:51.739327 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ba336-f9b7-44ab-9725-9d1d9fd5792d None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:51.739726 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ba336-f9b7-44ab-9725-9d1d9fd5792d None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:51.740006 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ba336-f9b7-44ab-9725-9d1d9fd5792d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:51.758005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-715ba336-f9b7-44ab-9725-9d1d9fd5792d None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:51.759168 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-715ba336-f9b7-44ab-9725-9d1d9fd5792d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:51.766901 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 704/1403] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:58:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:51.805061 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2b069-6098-4fac-ba9e-c1fd3d497f1c None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:51.816203 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2b069-6098-4fac-ba9e-c1fd3d497f1c None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:51.819747 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae509db-06de-423d-8bbe-25da7aa8ca93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:51.820381 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae509db-06de-423d-8bbe-25da7aa8ca93 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:51.820667 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae509db-06de-423d-8bbe-25da7aa8ca93 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:51.820943 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae509db-06de-423d-8bbe-25da7aa8ca93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:51.829849 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae509db-06de-423d-8bbe-25da7aa8ca93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:51.831268 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae509db-06de-423d-8bbe-25da7aa8ca93 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:51.840942 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 700/1404] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:58:54.027624 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f182b0b-c6ef-4b2a-bc38-8ee1297209c5 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:54.028190 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f182b0b-c6ef-4b2a-bc38-8ee1297209c5 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:54.028190 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f182b0b-c6ef-4b2a-bc38-8ee1297209c5 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:54.030572 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 705/1405] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:58:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:54.036631 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f7501-beb6-4625-886a-9e1e185baeb8 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:54.037054 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f7501-beb6-4625-886a-9e1e185baeb8 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:54.037180 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f7501-beb6-4625-886a-9e1e185baeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:54.054284 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-388f7501-beb6-4625-886a-9e1e185baeb8 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:54.055495 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-388f7501-beb6-4625-886a-9e1e185baeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:54.063081 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 701/1406] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:58:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:54.101136 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f182b0b-c6ef-4b2a-bc38-8ee1297209c5 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:54.111842 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f182b0b-c6ef-4b2a-bc38-8ee1297209c5 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:54.115333 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078608c-1703-43f2-86e3-60fc7ab25068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:54.116010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078608c-1703-43f2-86e3-60fc7ab25068 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:54.116294 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078608c-1703-43f2-86e3-60fc7ab25068 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:54.116572 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078608c-1703-43f2-86e3-60fc7ab25068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:54.126055 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078608c-1703-43f2-86e3-60fc7ab25068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:54.127766 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078608c-1703-43f2-86e3-60fc7ab25068 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:54.137866 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 706/1407] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:58:56.303907 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c77178-5345-40ca-b452-454221f13656 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:56.304459 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c77178-5345-40ca-b452-454221f13656 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:56.304459 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c77178-5345-40ca-b452-454221f13656 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:56.306234 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 702/1408] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:58:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:56.312695 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02595cd6-8373-4a4c-b29c-cf590049940d None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:56.313125 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02595cd6-8373-4a4c-b29c-cf590049940d None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:56.313256 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02595cd6-8373-4a4c-b29c-cf590049940d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:56.330781 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-02595cd6-8373-4a4c-b29c-cf590049940d None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:56.331994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-02595cd6-8373-4a4c-b29c-cf590049940d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:56.340186 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 707/1409] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:58:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:58:56.377719 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c77178-5345-40ca-b452-454221f13656 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:56.388175 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c77178-5345-40ca-b452-454221f13656 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:56.391698 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205c0c5-f8c4-483c-b7d1-b43cad6f332a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:56.392330 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205c0c5-f8c4-483c-b7d1-b43cad6f332a service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:56.392612 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205c0c5-f8c4-483c-b7d1-b43cad6f332a service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:56.392890 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205c0c5-f8c4-483c-b7d1-b43cad6f332a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:56.401398 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205c0c5-f8c4-483c-b7d1-b43cad6f332a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:56.403466 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205c0c5-f8c4-483c-b7d1-b43cad6f332a service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:56.412613 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 703/1410] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:58:58.587906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae148e-cd88-49e8-8e86-249e9fcd8105 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:58.588449 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae148e-cd88-49e8-8e86-249e9fcd8105 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:58.588449 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae148e-cd88-49e8-8e86-249e9fcd8105 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:58.590362 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 708/1411] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:58:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:58:58.596227 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf27bb1-cede-4048-a05f-b86b3e314961 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:58.596678 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf27bb1-cede-4048-a05f-b86b3e314961 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:58.596782 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf27bb1-cede-4048-a05f-b86b3e314961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:58.613994 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-faf27bb1-cede-4048-a05f-b86b3e314961 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:58:58.615202 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-faf27bb1-cede-4048-a05f-b86b3e314961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:58:58.624097 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 704/1412] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:58:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:58:58.662206 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae148e-cd88-49e8-8e86-249e9fcd8105 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:58:58.672929 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae148e-cd88-49e8-8e86-249e9fcd8105 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:58:58.676474 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fd7e3-10e8-44c0-898c-79d8a9e245c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:58:58.677103 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fd7e3-10e8-44c0-898c-79d8a9e245c1 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:58:58.677388 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fd7e3-10e8-44c0-898c-79d8a9e245c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:58:58.677665 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fd7e3-10e8-44c0-898c-79d8a9e245c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:58:58.686975 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fd7e3-10e8-44c0-898c-79d8a9e245c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:58:58.688434 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fd7e3-10e8-44c0-898c-79d8a9e245c1 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:58:58.697432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 709/1413] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:58:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:59:15.463510 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201be728-e017-453a-b404-c58d66960d95 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:15.464811 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201be728-e017-453a-b404-c58d66960d95 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:15.464811 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201be728-e017-453a-b404-c58d66960d95 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:15.466185 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 705/1414] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:59:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:59:15.472196 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e49896-0c31-4c98-a955-7d738ba2fd9d None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:15.472605 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e49896-0c31-4c98-a955-7d738ba2fd9d None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:15.472751 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e49896-0c31-4c98-a955-7d738ba2fd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:15.490203 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-59e49896-0c31-4c98-a955-7d738ba2fd9d None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:59:15.491452 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-59e49896-0c31-4c98-a955-7d738ba2fd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:59:15.499315 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 710/1415] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:59:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:59:15.549232 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f1e6e-4d20-46a0-9a28-2a48aba78920 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:15.549515 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f1e6e-4d20-46a0-9a28-2a48aba78920 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:15.549790 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f1e6e-4d20-46a0-9a28-2a48aba78920 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:15.551603 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 706/1416] 10.222.0.39 () {54 vars in 966 bytes} [Tue Aug 31 02:59:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:59:15.556563 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8600879-e74f-41bf-9ac5-f403842fa421 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:15.556855 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8600879-e74f-41bf-9ac5-f403842fa421 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:15.557132 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8600879-e74f-41bf-9ac5-f403842fa421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:15.575350 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-f8600879-e74f-41bf-9ac5-f403842fa421 None None] MFA Rules not processed for user `0d763da11c58473c9c2cf981b02835f3`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:59:15.576548 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f8600879-e74f-41bf-9ac5-f403842fa421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:59:15.582854 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 711/1417] 10.222.0.39 () {58 vars in 1064 bytes} [Tue Aug 31 02:59:15 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:59:15.591113 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f1e6e-4d20-46a0-9a28-2a48aba78920 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:59:15.601400 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f1e6e-4d20-46a0-9a28-2a48aba78920 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:59:15.604999 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26fd8c-301e-4917-ade7-547151dd9944 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d763da11c58473c9c2cf981b02835f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:59:15.605621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26fd8c-301e-4917-ade7-547151dd9944 service glance] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:15.605904 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26fd8c-301e-4917-ade7-547151dd9944 service glance] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:15.606179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26fd8c-301e-4917-ade7-547151dd9944 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:15.614715 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26fd8c-301e-4917-ade7-547151dd9944 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:59:15.616154 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26fd8c-301e-4917-ade7-547151dd9944 service glance] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:59:15.625295 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 707/1418] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:59:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:59:17.869082 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8fe0d-d150-414e-acdc-542710f3f35e None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:17.869692 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8fe0d-d150-414e-acdc-542710f3f35e None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:17.870397 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8fe0d-d150-414e-acdc-542710f3f35e None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:17.872043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 712/1419] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:59:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:59:17.878368 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ee585-4b4a-4418-89cb-2edfd1c758ca None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:17.878785 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ee585-4b4a-4418-89cb-2edfd1c758ca None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:17.878928 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ee585-4b4a-4418-89cb-2edfd1c758ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:17.896323 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-958ee585-4b4a-4418-89cb-2edfd1c758ca None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:59:17.897496 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-958ee585-4b4a-4418-89cb-2edfd1c758ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:59:17.905099 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 708/1420] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:59:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:59:17.929888 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8fe0d-d150-414e-acdc-542710f3f35e None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:59:17.943538 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8fe0d-d150-414e-acdc-542710f3f35e None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:59:17.948724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72416d55-69a6-4e2b-bfd7-d820015d9eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:59:17.949463 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72416d55-69a6-4e2b-bfd7-d820015d9eef admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:17.949825 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72416d55-69a6-4e2b-bfd7-d820015d9eef admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:17.950105 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72416d55-69a6-4e2b-bfd7-d820015d9eef admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:17.950823 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72416d55-69a6-4e2b-bfd7-d820015d9eef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:59:17.952984 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72416d55-69a6-4e2b-bfd7-d820015d9eef admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:59:17.967889 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 713/1421] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Aug 31 02:59:17 2021] GET /identity/v3/projects => generated 2553 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 02:59:20.158812 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15847e2e-8361-4d73-a0a7-784c7ee90889 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:20.159341 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15847e2e-8361-4d73-a0a7-784c7ee90889 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:20.159341 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15847e2e-8361-4d73-a0a7-784c7ee90889 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:20.161180 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 709/1422] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:59:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:59:20.167053 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8c1af-9db0-4113-bec9-68911e60079e None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:20.167512 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8c1af-9db0-4113-bec9-68911e60079e None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:20.167705 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8c1af-9db0-4113-bec9-68911e60079e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:20.184988 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-8af8c1af-9db0-4113-bec9-68911e60079e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:59:20.186172 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-8af8c1af-9db0-4113-bec9-68911e60079e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:59:20.193942 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 714/1423] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:59:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:59:20.238158 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15847e2e-8361-4d73-a0a7-784c7ee90889 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:59:20.252571 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15847e2e-8361-4d73-a0a7-784c7ee90889 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:59:20.258162 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5b41e-8cfe-4b13-aea6-2fae89dc4c8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:59:20.258793 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5b41e-8cfe-4b13-aea6-2fae89dc4c8b service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:20.259077 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5b41e-8cfe-4b13-aea6-2fae89dc4c8b service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:20.259356 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5b41e-8cfe-4b13-aea6-2fae89dc4c8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:20.267959 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5b41e-8cfe-4b13-aea6-2fae89dc4c8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:59:20.269538 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5b41e-8cfe-4b13-aea6-2fae89dc4c8b service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:59:20.279133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 710/1424] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:59:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:59:22.626350 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bdab7-49e4-41f3-9fc3-c12b9b140893 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:22.627292 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bdab7-49e4-41f3-9fc3-c12b9b140893 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:22.627292 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bdab7-49e4-41f3-9fc3-c12b9b140893 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:22.629231 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 715/1425] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:59:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:59:22.636018 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f7a2d-0b23-4d40-a5aa-523667a8da5c None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:22.636549 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f7a2d-0b23-4d40-a5aa-523667a8da5c None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:22.636549 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f7a2d-0b23-4d40-a5aa-523667a8da5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:22.654845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-399f7a2d-0b23-4d40-a5aa-523667a8da5c None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:59:22.656056 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-399f7a2d-0b23-4d40-a5aa-523667a8da5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:59:22.663951 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 711/1426] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:59:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:59:22.702179 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bdab7-49e4-41f3-9fc3-c12b9b140893 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:59:22.712629 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bdab7-49e4-41f3-9fc3-c12b9b140893 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:59:22.716476 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b008756-3ac8-493c-8591-711d6ae4cbb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:59:22.717105 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b008756-3ac8-493c-8591-711d6ae4cbb6 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:22.717389 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b008756-3ac8-493c-8591-711d6ae4cbb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:22.717668 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b008756-3ac8-493c-8591-711d6ae4cbb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:22.726245 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b008756-3ac8-493c-8591-711d6ae4cbb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:59:22.727717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b008756-3ac8-493c-8591-711d6ae4cbb6 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:59:22.736799 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 716/1427] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:59:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:59:24.960918 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d07541-dc3a-4606-8980-2158d84d5654 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:24.961482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d07541-dc3a-4606-8980-2158d84d5654 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:24.961482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d07541-dc3a-4606-8980-2158d84d5654 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:24.963833 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 712/1428] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:59:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:59:24.969629 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5815f73-d6f8-4063-a503-7db9bea4c274 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:24.970072 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5815f73-d6f8-4063-a503-7db9bea4c274 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:24.970233 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5815f73-d6f8-4063-a503-7db9bea4c274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:24.988930 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-f5815f73-d6f8-4063-a503-7db9bea4c274 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:59:24.990102 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f5815f73-d6f8-4063-a503-7db9bea4c274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:59:24.998170 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 717/1429] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:59:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:59:25.037356 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d07541-dc3a-4606-8980-2158d84d5654 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:59:25.048734 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d07541-dc3a-4606-8980-2158d84d5654 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:59:25.052241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42337dd-622d-4f4f-98a3-ec8b093c9677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:59:25.052876 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42337dd-622d-4f4f-98a3-ec8b093c9677 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:25.053153 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42337dd-622d-4f4f-98a3-ec8b093c9677 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:25.053422 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42337dd-622d-4f4f-98a3-ec8b093c9677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:25.062055 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42337dd-622d-4f4f-98a3-ec8b093c9677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:59:25.063486 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42337dd-622d-4f4f-98a3-ec8b093c9677 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:59:25.072533 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 713/1430] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:59:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:59:27.404457 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c8345-3d95-4521-854a-575506c1f83d None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:27.404982 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c8345-3d95-4521-854a-575506c1f83d None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:27.404982 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c8345-3d95-4521-854a-575506c1f83d None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:27.406655 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 718/1431] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:59:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:59:27.412516 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4073b-ec38-4aec-8d8e-be3b937c11b3 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:27.412951 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4073b-ec38-4aec-8d8e-be3b937c11b3 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:27.413107 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4073b-ec38-4aec-8d8e-be3b937c11b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:27.430746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-a1c4073b-ec38-4aec-8d8e-be3b937c11b3 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:59:27.432523 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a1c4073b-ec38-4aec-8d8e-be3b937c11b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:59:27.440572 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 714/1432] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:59:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 02:59:27.482055 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c8345-3d95-4521-854a-575506c1f83d None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:59:27.492514 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c8345-3d95-4521-854a-575506c1f83d None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:59:27.498850 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68add45-50a9-4afd-9d23-ea49c90641c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:59:27.500427 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68add45-50a9-4afd-9d23-ea49c90641c6 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:27.500712 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68add45-50a9-4afd-9d23-ea49c90641c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:27.500990 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68add45-50a9-4afd-9d23-ea49c90641c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:27.510114 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68add45-50a9-4afd-9d23-ea49c90641c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:59:27.511726 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68add45-50a9-4afd-9d23-ea49c90641c6 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:59:27.520737 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 719/1433] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:59:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 02:59:29.894952 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd1d21-f656-4831-acd8-6b3e5d1fd9c5 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:29.895558 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd1d21-f656-4831-acd8-6b3e5d1fd9c5 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:29.895558 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd1d21-f656-4831-acd8-6b3e5d1fd9c5 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:29.897317 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 715/1434] 10.222.0.39 () {54 vars in 926 bytes} [Tue Aug 31 02:59:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 02:59:29.903694 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70be1d-5840-446a-99fe-fb212027fd7c None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:29.904144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70be1d-5840-446a-99fe-fb212027fd7c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:29.904251 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70be1d-5840-446a-99fe-fb212027fd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:29.922201 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-7f70be1d-5840-446a-99fe-fb212027fd7c None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 02:59:29.923424 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-7f70be1d-5840-446a-99fe-fb212027fd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 02:59:29.931159 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 720/1435] 10.222.0.39 () {58 vars in 1024 bytes} [Tue Aug 31 02:59:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 02:59:29.971818 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd1d21-f656-4831-acd8-6b3e5d1fd9c5 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 02:59:29.982256 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd1d21-f656-4831-acd8-6b3e5d1fd9c5 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 02:59:29.985720 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8bbbc-3729-475c-b083-199bae85f482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 02:59:29.986348 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8bbbc-3729-475c-b083-199bae85f482 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 02:59:29.986631 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8bbbc-3729-475c-b083-199bae85f482 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 02:59:29.986907 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8bbbc-3729-475c-b083-199bae85f482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 02:59:29.995594 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8bbbc-3729-475c-b083-199bae85f482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 02:59:29.997004 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8bbbc-3729-475c-b083-199bae85f482 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 02:59:30.006233 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 716/1436] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 02:59:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:00:38.470475 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e6b63-1fc5-41c3-acb5-f6bb76fbb6f6 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:00:38.471030 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e6b63-1fc5-41c3-acb5-f6bb76fbb6f6 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:00:38.471030 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e6b63-1fc5-41c3-acb5-f6bb76fbb6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:00:38.488245 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-1c7e6b63-1fc5-41c3-acb5-f6bb76fbb6f6 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:00:38.489403 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-1c7e6b63-1fc5-41c3-acb5-f6bb76fbb6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:00:38.497544 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 721/1437] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:00:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:00:38.505638 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642c6a3-6de1-4c81-98dd-ff1a952590f2 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:00:38.506107 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642c6a3-6de1-4c81-98dd-ff1a952590f2 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:00:38.506211 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642c6a3-6de1-4c81-98dd-ff1a952590f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:00:38.524201 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-5642c6a3-6de1-4c81-98dd-ff1a952590f2 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:00:38.525364 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-5642c6a3-6de1-4c81-98dd-ff1a952590f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:00:38.533409 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 717/1438] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:00:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:00:38.537854 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e6b63-1fc5-41c3-acb5-f6bb76fbb6f6 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:00:38.547262 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e6b63-1fc5-41c3-acb5-f6bb76fbb6f6 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:00:38.551735 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a6bea-647c-4dca-882b-89f88b62a758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:00:38.552369 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a6bea-647c-4dca-882b-89f88b62a758 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:00:38.552646 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a6bea-647c-4dca-882b-89f88b62a758 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:00:38.552917 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a6bea-647c-4dca-882b-89f88b62a758 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:00:38.553609 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a6bea-647c-4dca-882b-89f88b62a758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:00:38.553904 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a6bea-647c-4dca-882b-89f88b62a758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:00:38.556146 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a6bea-647c-4dca-882b-89f88b62a758 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:00:38.566934 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 722/1439] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:00:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:00:38.575195 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642c6a3-6de1-4c81-98dd-ff1a952590f2 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:00:38.584031 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642c6a3-6de1-4c81-98dd-ff1a952590f2 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:00:38.588550 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88f94e-e5f3-4874-ab1d-1ed6357734f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:00:38.589189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88f94e-e5f3-4874-ab1d-1ed6357734f6 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:00:38.589470 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88f94e-e5f3-4874-ab1d-1ed6357734f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:00:38.589745 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88f94e-e5f3-4874-ab1d-1ed6357734f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:00:38.590426 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88f94e-e5f3-4874-ab1d-1ed6357734f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:00:38.592361 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88f94e-e5f3-4874-ab1d-1ed6357734f6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:00:38.629072 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 718/1440] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:00:38 2021] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:00:38.634342 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a6bea-647c-4dca-882b-89f88b62a758 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:00:38.643948 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a6bea-647c-4dca-882b-89f88b62a758 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:00:38.697118 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c35674-e965-4ce7-82f2-240962b54ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:00:38.697813 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c35674-e965-4ce7-82f2-240962b54ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:00:38.698105 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c35674-e965-4ce7-82f2-240962b54ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:00:38.698393 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c35674-e965-4ce7-82f2-240962b54ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:00:38.699095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c35674-e965-4ce7-82f2-240962b54ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:00:38.701059 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c35674-e965-4ce7-82f2-240962b54ad0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:00:38.720910 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 723/1441] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:00:38 2021] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:00:38.725015 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88f94e-e5f3-4874-ab1d-1ed6357734f6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:00:38.735626 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88f94e-e5f3-4874-ab1d-1ed6357734f6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:00:38.740223 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af90eb-dc21-4872-8d14-e0af403152bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:00:38.740870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af90eb-dc21-4872-8d14-e0af403152bf admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:00:38.741150 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af90eb-dc21-4872-8d14-e0af403152bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:00:38.741432 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af90eb-dc21-4872-8d14-e0af403152bf admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:00:38.742126 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af90eb-dc21-4872-8d14-e0af403152bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:00:38.744484 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af90eb-dc21-4872-8d14-e0af403152bf admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:00:38.757500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 719/1442] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:00:38 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:00:38.762018 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c35674-e965-4ce7-82f2-240962b54ad0 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:00:38.771606 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c35674-e965-4ce7-82f2-240962b54ad0 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:00:38.776544 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efe9b4-cd17-4331-9eff-00ca5405f492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:00:38.777192 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efe9b4-cd17-4331-9eff-00ca5405f492 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:00:38.777471 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efe9b4-cd17-4331-9eff-00ca5405f492 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:00:38.777741 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efe9b4-cd17-4331-9eff-00ca5405f492 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:00:38.778447 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efe9b4-cd17-4331-9eff-00ca5405f492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:00:38.780158 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efe9b4-cd17-4331-9eff-00ca5405f492 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:00:38.793977 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 724/1443] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:00:38 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:00:38.798047 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af90eb-dc21-4872-8d14-e0af403152bf admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:00:38.808426 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af90eb-dc21-4872-8d14-e0af403152bf admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:00:38.813086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24a31f-0b27-4560-818d-94975d81384d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:00:38.813948 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24a31f-0b27-4560-818d-94975d81384d admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:00:38.814229 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24a31f-0b27-4560-818d-94975d81384d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:00:38.814507 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24a31f-0b27-4560-818d-94975d81384d admin admin] PATH_INFO: `/v3/projects/e0f9a8ba7ba3470a805c14a7b08d8e5e/users/aaa92cda14b14ccf844c12fc39ebb653/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:00:38.829133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24a31f-0b27-4560-818d-94975d81384d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f9a8ba7ba3470a805c14a7b08d8e5e, user_id=aaa92cda14b14ccf844c12fc39ebb653, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:00:38.831781 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24a31f-0b27-4560-818d-94975d81384d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:00:38.844284 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 720/1444] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:00:38 2021] PUT /identity/v3/projects/e0f9a8ba7ba3470a805c14a7b08d8e5e/users/aaa92cda14b14ccf844c12fc39ebb653/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:00:38.857162 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba0c58-491d-4891-a359-1bab9564ecd0 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:00:38.857439 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba0c58-491d-4891-a359-1bab9564ecd0 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:00:38.857717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba0c58-491d-4891-a359-1bab9564ecd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:00:38.883530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-3aba0c58-491d-4891-a359-1bab9564ecd0 None None] MFA Rules not processed for user `aaa92cda14b14ccf844c12fc39ebb653`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:00:38.884844 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-3aba0c58-491d-4891-a359-1bab9564ecd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:00:38.945451 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 725/1445] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:00:38 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:00:38.956862 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24a31f-0b27-4560-818d-94975d81384d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:00:39.022480 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24a31f-0b27-4560-818d-94975d81384d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:00:39.028101 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be97160-e71e-489a-b88d-a582fe970f4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:00:39.028732 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be97160-e71e-489a-b88d-a582fe970f4a service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:00:39.029011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be97160-e71e-489a-b88d-a582fe970f4a service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:00:39.029287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be97160-e71e-489a-b88d-a582fe970f4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:00:39.036755 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be97160-e71e-489a-b88d-a582fe970f4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:00:39.038316 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be97160-e71e-489a-b88d-a582fe970f4a service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:00:39.047270 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 721/1446] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:00:38 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:00:39.116249 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1f1ad-4c61-4d49-a93b-beb9e61a23cb None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:00:39.116541 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1f1ad-4c61-4d49-a93b-beb9e61a23cb None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:00:39.116823 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1f1ad-4c61-4d49-a93b-beb9e61a23cb None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:00:39.118587 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 726/1447] 10.222.0.39 () {52 vars in 829 bytes} [Tue Aug 31 03:00:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:00:39.122337 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be97160-e71e-489a-b88d-a582fe970f4a service nova] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:00:39.180879 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be97160-e71e-489a-b88d-a582fe970f4a service nova] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:00:39.185401 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c148811-870b-4dd9-8a1d-5b2c1579f272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:00:39.186251 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c148811-870b-4dd9-8a1d-5b2c1579f272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:00:39.186531 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c148811-870b-4dd9-8a1d-5b2c1579f272 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:00:39.186804 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c148811-870b-4dd9-8a1d-5b2c1579f272 admin admin] PATH_INFO: `/v3/users/aaa92cda14b14ccf844c12fc39ebb653` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:00:39.187981 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c148811-870b-4dd9-8a1d-5b2c1579f272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa92cda14b14ccf844c12fc39ebb653)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:00:39.188983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-9c148811-870b-4dd9-8a1d-5b2c1579f272 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 03:00:39.188983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 03:00:39.188983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 03:00:39.190179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c148811-870b-4dd9-8a1d-5b2c1579f272 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:00:39.252092 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9c148811-870b-4dd9-8a1d-5b2c1579f272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa92cda14b14ccf844c12fc39ebb653'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:00:39.252746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9c148811-870b-4dd9-8a1d-5b2c1579f272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa92cda14b14ccf844c12fc39ebb653'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:00:39.253451 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9c148811-870b-4dd9-8a1d-5b2c1579f272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa92cda14b14ccf844c12fc39ebb653'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:00:39.272813 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9c148811-870b-4dd9-8a1d-5b2c1579f272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa92cda14b14ccf844c12fc39ebb653'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:00:39.282259 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9c148811-870b-4dd9-8a1d-5b2c1579f272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa92cda14b14ccf844c12fc39ebb653'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:00:39.300060 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 722/1448] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:00:39 2021] DELETE /identity/v3/users/aaa92cda14b14ccf844c12fc39ebb653 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:00:39.304528 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ab421-d652-4644-a6ea-f618b467f405 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:00:39.304810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ab421-d652-4644-a6ea-f618b467f405 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:00:39.305118 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ab421-d652-4644-a6ea-f618b467f405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:00:39.322404 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-575ab421-d652-4644-a6ea-f618b467f405 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:00:39.323618 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-575ab421-d652-4644-a6ea-f618b467f405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:00:39.379228 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 727/1449] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:00:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:00:39.389647 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c148811-870b-4dd9-8a1d-5b2c1579f272 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:00:39.391047 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-9c148811-870b-4dd9-8a1d-5b2c1579f272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:00:39.447159 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c148811-870b-4dd9-8a1d-5b2c1579f272 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:00:39.450688 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d333ddf-d5b4-4bc4-9691-7dabfdf0dbf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:00:39.451623 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d333ddf-d5b4-4bc4-9691-7dabfdf0dbf1 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:00:39.451910 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d333ddf-d5b4-4bc4-9691-7dabfdf0dbf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:00:39.452183 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d333ddf-d5b4-4bc4-9691-7dabfdf0dbf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:00:39.460724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d333ddf-d5b4-4bc4-9691-7dabfdf0dbf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:00:39.462485 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d333ddf-d5b4-4bc4-9691-7dabfdf0dbf1 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:00:39.471536 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 723/1450] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:00:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:00:39.810090 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ab421-d652-4644-a6ea-f618b467f405 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:00:39.811553 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-575ab421-d652-4644-a6ea-f618b467f405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:00:39.822917 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ab421-d652-4644-a6ea-f618b467f405 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:00:39.827653 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5d43f-245a-4684-9728-45782df666cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:00:39.828446 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5d43f-245a-4684-9728-45782df666cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:00:39.828750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5d43f-245a-4684-9728-45782df666cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:00:39.829023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5d43f-245a-4684-9728-45782df666cd admin admin] PATH_INFO: `/v3/projects/e0f9a8ba7ba3470a805c14a7b08d8e5e` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:00:39.830183 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5d43f-245a-4684-9728-45782df666cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f9a8ba7ba3470a805c14a7b08d8e5e)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:00:39.831188 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-4ca5d43f-245a-4684-9728-45782df666cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 03:00:39.831188 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 03:00:39.831188 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 03:00:39.832418 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5d43f-245a-4684-9728-45782df666cd admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:00:39.888667 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4ca5d43f-245a-4684-9728-45782df666cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f9a8ba7ba3470a805c14a7b08d8e5e', 'request_id': 'req-4ca5d43f-245a-4684-9728-45782df666cd'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:00:39.894327 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4ca5d43f-245a-4684-9728-45782df666cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f9a8ba7ba3470a805c14a7b08d8e5e', 'request_id': 'req-4ca5d43f-245a-4684-9728-45782df666cd'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:00:39.904319 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4ca5d43f-245a-4684-9728-45782df666cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f9a8ba7ba3470a805c14a7b08d8e5e', 'request_id': 'req-4ca5d43f-245a-4684-9728-45782df666cd'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:00:39.924471 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4ca5d43f-245a-4684-9728-45782df666cd admin admin] The token cache is being invalidate because project e0f9a8ba7ba3470a805c14a7b08d8e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:00:39.924758 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4ca5d43f-245a-4684-9728-45782df666cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:00:39.925400 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4ca5d43f-245a-4684-9728-45782df666cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:00:39.926978 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 728/1451] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:00:39 2021] DELETE /identity/v3/projects/e0f9a8ba7ba3470a805c14a7b08d8e5e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:02:04.630320 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d4602-ca85-4411-b895-e43437decd15 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:04.630934 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d4602-ca85-4411-b895-e43437decd15 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:04.631336 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d4602-ca85-4411-b895-e43437decd15 None None] PATH_INFO: `/v3` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:04.632951 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 724/1452] 10.222.0.45 () {54 vars in 926 bytes} [Tue Aug 31 03:02:04 2021] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:02:04.639874 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7769677-b34a-4960-9d84-93b0ac99723f None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:04.640341 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7769677-b34a-4960-9d84-93b0ac99723f None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:04.640451 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7769677-b34a-4960-9d84-93b0ac99723f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:04.659290 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-c7769677-b34a-4960-9d84-93b0ac99723f None None] MFA Rules not processed for user `bbcf0359f8bc4f55be3307f235f8aac5`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:02:04.660531 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c7769677-b34a-4960-9d84-93b0ac99723f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:02:04.720989 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 729/1453] 10.222.0.45 () {58 vars in 1016 bytes} [Tue Aug 31 03:02:04 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:02:05.211268 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae2a1c-4c79-4c06-ab38-053e4cf3517f None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:05.211658 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae2a1c-4c79-4c06-ab38-053e4cf3517f None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:05.211945 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae2a1c-4c79-4c06-ab38-053e4cf3517f None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:05.214574 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 725/1454] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 31 03:02:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:02:05.220696 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c77660-4483-4852-9ee7-a720dcd05810 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:05.220990 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c77660-4483-4852-9ee7-a720dcd05810 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:05.221268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c77660-4483-4852-9ee7-a720dcd05810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:05.238915 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-75c77660-4483-4852-9ee7-a720dcd05810 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:02:05.240173 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-75c77660-4483-4852-9ee7-a720dcd05810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:02:05.296051 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 730/1455] 127.0.0.1 () {58 vars in 999 bytes} [Tue Aug 31 03:02:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:02:05.453310 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae2a1c-4c79-4c06-ab38-053e4cf3517f None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:02:05.456352 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f9ae2a1c-4c79-4c06-ab38-053e4cf3517f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:02:05.534713 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae2a1c-4c79-4c06-ab38-053e4cf3517f None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:02:05.540600 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397815f-36a7-4587-91fc-64518b874a8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:02:05.541612 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397815f-36a7-4587-91fc-64518b874a8a service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:05.541612 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397815f-36a7-4587-91fc-64518b874a8a service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:05.541901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397815f-36a7-4587-91fc-64518b874a8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:05.550840 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397815f-36a7-4587-91fc-64518b874a8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:02:05.552838 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397815f-36a7-4587-91fc-64518b874a8a service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:02:05.563251 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 726/1456] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:02:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:02:07.059639 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be3a70-f966-4801-b963-492d3c7f207b None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:07.060217 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be3a70-f966-4801-b963-492d3c7f207b None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:07.060217 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be3a70-f966-4801-b963-492d3c7f207b None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:07.061941 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 731/1457] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 31 03:02:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:02:07.067217 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31637b93-9754-454d-8200-068338a2e74d None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:07.067716 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31637b93-9754-454d-8200-068338a2e74d None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:07.067849 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31637b93-9754-454d-8200-068338a2e74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:07.085729 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-31637b93-9754-454d-8200-068338a2e74d None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:02:07.086931 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-31637b93-9754-454d-8200-068338a2e74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:02:07.095207 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 727/1458] 127.0.0.1 () {58 vars in 999 bytes} [Tue Aug 31 03:02:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:02:07.249922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be3a70-f966-4801-b963-492d3c7f207b None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:02:07.264836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be3a70-f966-4801-b963-492d3c7f207b None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:02:07.270133 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351d673-8030-4f7c-95c4-ddec9a704f59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:02:07.270760 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351d673-8030-4f7c-95c4-ddec9a704f59 service nova] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:07.271041 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351d673-8030-4f7c-95c4-ddec9a704f59 service nova] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:07.271313 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351d673-8030-4f7c-95c4-ddec9a704f59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:07.279897 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351d673-8030-4f7c-95c4-ddec9a704f59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:02:07.281485 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351d673-8030-4f7c-95c4-ddec9a704f59 service nova] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:02:07.290711 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 732/1459] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:02:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:02:08.253607 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021abed1-5ae0-4942-b889-cacdf23ddece None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:08.254045 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021abed1-5ae0-4942-b889-cacdf23ddece None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:08.254149 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021abed1-5ae0-4942-b889-cacdf23ddece None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:08.256034 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 728/1460] 10.222.0.39 () {54 vars in 960 bytes} [Tue Aug 31 03:02:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:02:08.261368 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea9863-bcee-48ad-9bcc-cb5d69055812 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:08.261818 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea9863-bcee-48ad-9bcc-cb5d69055812 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:08.261966 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea9863-bcee-48ad-9bcc-cb5d69055812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:08.281764 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-94ea9863-bcee-48ad-9bcc-cb5d69055812 None None] MFA Rules not processed for user `bbcf0359f8bc4f55be3307f235f8aac5`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:02:08.282944 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-94ea9863-bcee-48ad-9bcc-cb5d69055812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:02:08.292316 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 733/1461] 10.222.0.39 () {58 vars in 1058 bytes} [Tue Aug 31 03:02:08 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:02:08.300225 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021abed1-5ae0-4942-b889-cacdf23ddece None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:02:08.313164 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021abed1-5ae0-4942-b889-cacdf23ddece None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:02:08.319136 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b201d-0645-44de-b037-ac2103003ca2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcf0359f8bc4f55be3307f235f8aac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:02:08.319802 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b201d-0645-44de-b037-ac2103003ca2 service placement] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:08.320088 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b201d-0645-44de-b037-ac2103003ca2 service placement] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:08.320506 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b201d-0645-44de-b037-ac2103003ca2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:08.331429 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b201d-0645-44de-b037-ac2103003ca2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:02:08.333006 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b201d-0645-44de-b037-ac2103003ca2 service placement] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:02:08.343190 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 729/1462] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:02:08 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:02:19.057663 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ec080-8c1d-4c37-a5d6-8e27e337339f None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:19.058238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ec080-8c1d-4c37-a5d6-8e27e337339f None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:19.058238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ec080-8c1d-4c37-a5d6-8e27e337339f None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:19.059994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 734/1463] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 31 03:02:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:02:19.065191 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a97061-514a-47a1-b08e-3db59ed5c45e None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:19.065572 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a97061-514a-47a1-b08e-3db59ed5c45e None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:19.065752 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a97061-514a-47a1-b08e-3db59ed5c45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:19.085384 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-10a97061-514a-47a1-b08e-3db59ed5c45e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:02:19.086565 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-10a97061-514a-47a1-b08e-3db59ed5c45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:02:19.094802 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 730/1464] 127.0.0.1 () {58 vars in 999 bytes} [Tue Aug 31 03:02:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:02:19.253865 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ec080-8c1d-4c37-a5d6-8e27e337339f None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:02:19.268560 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ec080-8c1d-4c37-a5d6-8e27e337339f None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:02:19.273903 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9dc9db-66b5-4bdd-9f45-ffc6ad4881ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:02:19.274532 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dc9db-66b5-4bdd-9f45-ffc6ad4881ff service nova] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:19.274814 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dc9db-66b5-4bdd-9f45-ffc6ad4881ff service nova] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:19.275087 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dc9db-66b5-4bdd-9f45-ffc6ad4881ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:19.283645 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9dc9db-66b5-4bdd-9f45-ffc6ad4881ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:02:19.285213 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9dc9db-66b5-4bdd-9f45-ffc6ad4881ff service nova] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:02:19.294357 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 735/1465] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:02:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:02:20.633760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141eff7b-9c54-4470-8e19-aafb56cbf164 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:20.634578 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141eff7b-9c54-4470-8e19-aafb56cbf164 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:20.634578 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141eff7b-9c54-4470-8e19-aafb56cbf164 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:20.636800 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 731/1466] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 31 03:02:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:02:20.642021 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede492f-9d76-469e-811f-74a0c3150d27 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:20.642434 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede492f-9d76-469e-811f-74a0c3150d27 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:20.642574 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede492f-9d76-469e-811f-74a0c3150d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:20.660581 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-3ede492f-9d76-469e-811f-74a0c3150d27 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:02:20.661749 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-3ede492f-9d76-469e-811f-74a0c3150d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:02:20.669354 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 736/1467] 127.0.0.1 () {58 vars in 999 bytes} [Tue Aug 31 03:02:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:02:20.821493 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141eff7b-9c54-4470-8e19-aafb56cbf164 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:02:20.835891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141eff7b-9c54-4470-8e19-aafb56cbf164 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:02:20.842166 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646762b0-1795-4776-8a5e-8e50447f603c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:02:20.842875 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646762b0-1795-4776-8a5e-8e50447f603c service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:20.843160 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646762b0-1795-4776-8a5e-8e50447f603c service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:20.843465 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646762b0-1795-4776-8a5e-8e50447f603c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:20.851490 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646762b0-1795-4776-8a5e-8e50447f603c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:02:20.853076 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646762b0-1795-4776-8a5e-8e50447f603c service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:02:20.862629 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 732/1468] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:02:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:02:25.017175 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487b8ef-d3f5-4bf7-a532-1c105f0ebcd5 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:25.017769 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487b8ef-d3f5-4bf7-a532-1c105f0ebcd5 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:25.017769 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487b8ef-d3f5-4bf7-a532-1c105f0ebcd5 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:25.019524 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 737/1469] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 31 03:02:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:02:25.025190 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830f48a-7c1c-4635-babe-b980ac4ee771 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:25.026150 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830f48a-7c1c-4635-babe-b980ac4ee771 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:25.026421 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830f48a-7c1c-4635-babe-b980ac4ee771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:25.044706 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-e830f48a-7c1c-4635-babe-b980ac4ee771 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:02:25.045892 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-e830f48a-7c1c-4635-babe-b980ac4ee771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:02:25.053512 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 733/1470] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 31 03:02:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:02:25.091983 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487b8ef-d3f5-4bf7-a532-1c105f0ebcd5 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:02:25.093651 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a487b8ef-d3f5-4bf7-a532-1c105f0ebcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:02:25.151916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487b8ef-d3f5-4bf7-a532-1c105f0ebcd5 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:02:25.155549 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1df2a0-f96b-4ba6-8097-9f8177ebc0d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:02:25.156191 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1df2a0-f96b-4ba6-8097-9f8177ebc0d3 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:25.156476 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1df2a0-f96b-4ba6-8097-9f8177ebc0d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:25.156753 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1df2a0-f96b-4ba6-8097-9f8177ebc0d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:25.165370 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1df2a0-f96b-4ba6-8097-9f8177ebc0d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:02:25.166978 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1df2a0-f96b-4ba6-8097-9f8177ebc0d3 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:02:25.176128 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 738/1471] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:02:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:02:27.339523 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2a147-9194-4b1b-b309-c28d3048d78f None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:27.340077 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2a147-9194-4b1b-b309-c28d3048d78f None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:27.340077 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2a147-9194-4b1b-b309-c28d3048d78f None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:27.341858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 734/1472] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 31 03:02:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:02:27.347527 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167b49c-cc0c-4a18-adbf-675789ec159c None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:27.347949 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167b49c-cc0c-4a18-adbf-675789ec159c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:27.348097 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167b49c-cc0c-4a18-adbf-675789ec159c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:27.366601 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-5167b49c-cc0c-4a18-adbf-675789ec159c None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:02:27.367809 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-5167b49c-cc0c-4a18-adbf-675789ec159c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:02:27.376068 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 739/1473] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 31 03:02:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:02:27.413263 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2a147-9194-4b1b-b309-c28d3048d78f None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:02:27.424212 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2a147-9194-4b1b-b309-c28d3048d78f None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:02:27.427703 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7af785-e443-45fb-8f82-3c80410d2c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:02:27.428330 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7af785-e443-45fb-8f82-3c80410d2c2e service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:27.428610 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7af785-e443-45fb-8f82-3c80410d2c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:27.428884 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7af785-e443-45fb-8f82-3c80410d2c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:27.437977 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7af785-e443-45fb-8f82-3c80410d2c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:02:27.439792 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7af785-e443-45fb-8f82-3c80410d2c2e service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:02:27.448550 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 735/1474] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:02:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:02:31.267054 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b4af8-908f-42ee-8169-fd2e46d19e5c None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:31.267635 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b4af8-908f-42ee-8169-fd2e46d19e5c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:31.267635 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b4af8-908f-42ee-8169-fd2e46d19e5c None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:31.269391 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 740/1475] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 31 03:02:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:02:31.276414 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cfe02-1980-47b1-a4c5-9479922f53a4 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:31.277183 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cfe02-1980-47b1-a4c5-9479922f53a4 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:31.277183 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cfe02-1980-47b1-a4c5-9479922f53a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:31.298190 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-d68cfe02-1980-47b1-a4c5-9479922f53a4 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:02:31.299417 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d68cfe02-1980-47b1-a4c5-9479922f53a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:02:31.307719 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 736/1476] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 31 03:02:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:02:31.360874 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b4af8-908f-42ee-8169-fd2e46d19e5c None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:02:31.362505 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-db9b4af8-908f-42ee-8169-fd2e46d19e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:02:31.418733 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b4af8-908f-42ee-8169-fd2e46d19e5c None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:02:31.422253 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba857063-4e83-4e07-bcb3-892eb3565616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:02:31.422894 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba857063-4e83-4e07-bcb3-892eb3565616 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:31.423180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba857063-4e83-4e07-bcb3-892eb3565616 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:31.423486 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba857063-4e83-4e07-bcb3-892eb3565616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:31.432863 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba857063-4e83-4e07-bcb3-892eb3565616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:02:31.434290 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba857063-4e83-4e07-bcb3-892eb3565616 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:02:31.443487 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 741/1477] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:02:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:02:33.594072 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c837a-904a-4066-a646-a9799cb2878d None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:33.594626 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c837a-904a-4066-a646-a9799cb2878d None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:33.594626 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c837a-904a-4066-a646-a9799cb2878d None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:33.596420 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 737/1478] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 31 03:02:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:02:33.602113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca17df-f09e-4561-b967-8f9138c41396 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:33.602567 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca17df-f09e-4561-b967-8f9138c41396 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:33.602664 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca17df-f09e-4561-b967-8f9138c41396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:33.622362 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-7fca17df-f09e-4561-b967-8f9138c41396 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:02:33.624235 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-7fca17df-f09e-4561-b967-8f9138c41396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:02:33.632257 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 742/1479] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 31 03:02:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:02:33.687318 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4c9b0-f332-4731-a7df-cbc028a20175 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:33.687633 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4c9b0-f332-4731-a7df-cbc028a20175 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:33.687916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4c9b0-f332-4731-a7df-cbc028a20175 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:33.689666 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 738/1480] 10.222.0.39 () {54 vars in 966 bytes} [Tue Aug 31 03:02:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:02:33.695325 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb17b7-c374-4f6f-a27f-1e948ae38560 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:33.695601 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb17b7-c374-4f6f-a27f-1e948ae38560 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:33.695881 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb17b7-c374-4f6f-a27f-1e948ae38560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:33.714113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-2ccb17b7-c374-4f6f-a27f-1e948ae38560 None None] MFA Rules not processed for user `2e701dd89a844fe9aa21c3b5e1fc59cf`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:02:33.715298 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-2ccb17b7-c374-4f6f-a27f-1e948ae38560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:02:33.721633 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 743/1481] 10.222.0.39 () {58 vars in 1064 bytes} [Tue Aug 31 03:02:33 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:02:33.730160 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4c9b0-f332-4731-a7df-cbc028a20175 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:02:33.740398 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4c9b0-f332-4731-a7df-cbc028a20175 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:02:33.743933 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a34f1b-b401-4cb4-848d-e7d9a1227ff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:02:33.744601 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a34f1b-b401-4cb4-848d-e7d9a1227ff7 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:02:33.744883 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a34f1b-b401-4cb4-848d-e7d9a1227ff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:02:33.745156 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a34f1b-b401-4cb4-848d-e7d9a1227ff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:02:33.753933 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a34f1b-b401-4cb4-848d-e7d9a1227ff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:02:33.755354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a34f1b-b401-4cb4-848d-e7d9a1227ff7 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:02:33.764667 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 739/1482] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:02:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:03:53.707802 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf10b9-a24d-42df-beda-bbc8fefb7704 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:53.708388 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf10b9-a24d-42df-beda-bbc8fefb7704 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:53.708477 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf10b9-a24d-42df-beda-bbc8fefb7704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:53.733051 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-fcbf10b9-a24d-42df-beda-bbc8fefb7704 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:53.734267 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-fcbf10b9-a24d-42df-beda-bbc8fefb7704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:53.742782 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 744/1483] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:53.752067 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c2e2a-0af6-44c6-ba02-9894a4d55acc None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:53.753285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c2e2a-0af6-44c6-ba02-9894a4d55acc None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:53.753787 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c2e2a-0af6-44c6-ba02-9894a4d55acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:53.777178 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-943c2e2a-0af6-44c6-ba02-9894a4d55acc None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:53.778874 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-943c2e2a-0af6-44c6-ba02-9894a4d55acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:53.790500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 740/1484] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:53.795783 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf10b9-a24d-42df-beda-bbc8fefb7704 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:53.801857 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311721a-9a0d-4736-aad5-bfc31c1a9c66 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:53.802411 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311721a-9a0d-4736-aad5-bfc31c1a9c66 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:53.802902 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311721a-9a0d-4736-aad5-bfc31c1a9c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:53.805656 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf10b9-a24d-42df-beda-bbc8fefb7704 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:53.815849 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8a202-de72-435b-ad1a-0312de00e487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:53.816515 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8a202-de72-435b-ad1a-0312de00e487 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:53.816796 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8a202-de72-435b-ad1a-0312de00e487 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:53.817083 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8a202-de72-435b-ad1a-0312de00e487 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:53.818043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8a202-de72-435b-ad1a-0312de00e487 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:03:53.818043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8a202-de72-435b-ad1a-0312de00e487 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:53.819704 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8a202-de72-435b-ad1a-0312de00e487 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:53.824854 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-f311721a-9a0d-4736-aad5-bfc31c1a9c66 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:53.826300 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f311721a-9a0d-4736-aad5-bfc31c1a9c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:53.842862 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 745/1486] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:03:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:03:53.843627 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 741/1486] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:03:53.850763 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8a202-de72-435b-ad1a-0312de00e487 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:53.858504 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e9eac-e86f-4a01-b211-76cbb7acd802 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:53.859080 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e9eac-e86f-4a01-b211-76cbb7acd802 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:53.859703 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e9eac-e86f-4a01-b211-76cbb7acd802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:53.870292 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8a202-de72-435b-ad1a-0312de00e487 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:53.889505 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa39e3-b984-41bc-88e1-643ecd5a3cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:53.890176 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa39e3-b984-41bc-88e1-643ecd5a3cfe admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:53.890578 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa39e3-b984-41bc-88e1-643ecd5a3cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:53.890854 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa39e3-b984-41bc-88e1-643ecd5a3cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:53.891565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa39e3-b984-41bc-88e1-643ecd5a3cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:53.893462 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa39e3-b984-41bc-88e1-643ecd5a3cfe admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:53.900457 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-798e9eac-e86f-4a01-b211-76cbb7acd802 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:53.901688 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-798e9eac-e86f-4a01-b211-76cbb7acd802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:53.926327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 742/1487] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:03:53.932954 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e9eac-e86f-4a01-b211-76cbb7acd802 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:53.943324 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 746/1488] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:03:53 2021] POST /identity/v3/projects => generated 391 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:03:53.947310 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa39e3-b984-41bc-88e1-643ecd5a3cfe admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:53.948171 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e9eac-e86f-4a01-b211-76cbb7acd802 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.035692 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c7b7a-206b-43cb-883e-f35a2bcefee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.036849 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c7b7a-206b-43cb-883e-f35a2bcefee6 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.037751 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c7b7a-206b-43cb-883e-f35a2bcefee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.038245 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c7b7a-206b-43cb-883e-f35a2bcefee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.039174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c7b7a-206b-43cb-883e-f35a2bcefee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:03:54.039714 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c7b7a-206b-43cb-883e-f35a2bcefee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.042160 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c7b7a-206b-43cb-883e-f35a2bcefee6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.066653 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 743/1489] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:03:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:03:54.076146 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c7b7a-206b-43cb-883e-f35a2bcefee6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.080841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa39e3-b984-41bc-88e1-643ecd5a3cfe admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.094275 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c7b7a-206b-43cb-883e-f35a2bcefee6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.095158 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7302f-c613-49d8-ae59-34d74742a762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.095909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7302f-c613-49d8-ae59-34d74742a762 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.096157 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7302f-c613-49d8-ae59-34d74742a762 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.096432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7302f-c613-49d8-ae59-34d74742a762 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.097123 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7302f-c613-49d8-ae59-34d74742a762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.099053 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7302f-c613-49d8-ae59-34d74742a762 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.101131 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c3a55-9b60-4ded-9710-473e99fb1a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.102010 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c3a55-9b60-4ded-9710-473e99fb1a64 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.102640 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c3a55-9b60-4ded-9710-473e99fb1a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.103131 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c3a55-9b60-4ded-9710-473e99fb1a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.104616 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c3a55-9b60-4ded-9710-473e99fb1a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.111391 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c3a55-9b60-4ded-9710-473e99fb1a64 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.151693 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 747/1490] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:03:53 2021] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:03:54.155456 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7302f-c613-49d8-ae59-34d74742a762 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.164877 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 744/1491] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:03:54.167246 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875aa4e-6878-4f72-a7c4-36ece2f5ef84 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.167774 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875aa4e-6878-4f72-a7c4-36ece2f5ef84 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.168270 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875aa4e-6878-4f72-a7c4-36ece2f5ef84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.173062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7302f-c613-49d8-ae59-34d74742a762 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.202850 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-6875aa4e-6878-4f72-a7c4-36ece2f5ef84 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:54.204560 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-6875aa4e-6878-4f72-a7c4-36ece2f5ef84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:54.252382 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0f55d-ce92-4826-805f-27e91e82d3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.253334 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0f55d-ce92-4826-805f-27e91e82d3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.253615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0f55d-ce92-4826-805f-27e91e82d3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.253887 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0f55d-ce92-4826-805f-27e91e82d3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.254611 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0f55d-ce92-4826-805f-27e91e82d3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.256257 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0f55d-ce92-4826-805f-27e91e82d3a0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.278393 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 748/1492] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:03:54.279031 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0f55d-ce92-4826-805f-27e91e82d3a0 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.293314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0f55d-ce92-4826-805f-27e91e82d3a0 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.303264 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c6be5-2e14-43f8-810e-c1eec00e37fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.304034 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c6be5-2e14-43f8-810e-c1eec00e37fa admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.304325 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c6be5-2e14-43f8-810e-c1eec00e37fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.304836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c6be5-2e14-43f8-810e-c1eec00e37fa admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.305534 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c6be5-2e14-43f8-810e-c1eec00e37fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.307662 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c6be5-2e14-43f8-810e-c1eec00e37fa admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.311729 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 745/1493] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:54.313361 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cc939-a5ce-48b0-8401-0de44589959f None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.313877 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cc939-a5ce-48b0-8401-0de44589959f None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.314360 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cc939-a5ce-48b0-8401-0de44589959f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.333639 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 749/1494] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/users => generated 286 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:03:54.333639 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98500ba-1a64-4a9b-98af-71cac571921e None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.333639 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98500ba-1a64-4a9b-98af-71cac571921e None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.333639 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98500ba-1a64-4a9b-98af-71cac571921e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.341017 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-814cc939-a5ce-48b0-8401-0de44589959f None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:54.342429 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-814cc939-a5ce-48b0-8401-0de44589959f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:54.351079 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 746/1495] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:54.352038 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cc939-a5ce-48b0-8401-0de44589959f None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.352370 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-f98500ba-1a64-4a9b-98af-71cac571921e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:54.353710 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f98500ba-1a64-4a9b-98af-71cac571921e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:54.361412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cc939-a5ce-48b0-8401-0de44589959f None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.361703 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 750/1496] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:54.362949 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c42fcc-02dd-4e45-a785-53a630d46f78 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.363230 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c42fcc-02dd-4e45-a785-53a630d46f78 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.363616 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c42fcc-02dd-4e45-a785-53a630d46f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.366193 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b229ab1-999d-4768-bdcc-cdf659c43746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.366838 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b229ab1-999d-4768-bdcc-cdf659c43746 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.367117 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b229ab1-999d-4768-bdcc-cdf659c43746 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.367407 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b229ab1-999d-4768-bdcc-cdf659c43746 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.368140 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b229ab1-999d-4768-bdcc-cdf659c43746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.369937 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b229ab1-999d-4768-bdcc-cdf659c43746 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.380134 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 747/1497] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:54.381500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c8d32-632d-4ada-a022-4d5c8c0a8aee None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.381780 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-c7c42fcc-02dd-4e45-a785-53a630d46f78 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:54.381891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c8d32-632d-4ada-a022-4d5c8c0a8aee None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.382083 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c8d32-632d-4ada-a022-4d5c8c0a8aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.382976 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c7c42fcc-02dd-4e45-a785-53a630d46f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:54.391683 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 751/1498] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:54.392922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e22e6-e0e4-4f14-a60e-65d2b7366aa8 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.393207 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e22e6-e0e4-4f14-a60e-65d2b7366aa8 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.393484 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e22e6-e0e4-4f14-a60e-65d2b7366aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.400923 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-3a9c8d32-632d-4ada-a022-4d5c8c0a8aee None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:54.401957 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-3a9c8d32-632d-4ada-a022-4d5c8c0a8aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:54.409563 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 748/1499] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:54.410456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c8d32-632d-4ada-a022-4d5c8c0a8aee None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.411317 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-2e8e22e6-e0e4-4f14-a60e-65d2b7366aa8 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:54.412637 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-2e8e22e6-e0e4-4f14-a60e-65d2b7366aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:54.419457 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c8d32-632d-4ada-a022-4d5c8c0a8aee None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.421280 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 752/1500] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:54.422673 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da58b5a-f32b-4660-8009-5b8c920acda2 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.422962 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da58b5a-f32b-4660-8009-5b8c920acda2 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.423242 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da58b5a-f32b-4660-8009-5b8c920acda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.424145 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836854c2-0d06-49cf-aa98-1e4ad155aa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.424868 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836854c2-0d06-49cf-aa98-1e4ad155aa27 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.425157 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836854c2-0d06-49cf-aa98-1e4ad155aa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.425429 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836854c2-0d06-49cf-aa98-1e4ad155aa27 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.426143 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836854c2-0d06-49cf-aa98-1e4ad155aa27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.427768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836854c2-0d06-49cf-aa98-1e4ad155aa27 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.440506 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 749/1501] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:54.440506 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d2b8a-f1e6-47c2-899f-b6f6c76b5faf None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.440506 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d2b8a-f1e6-47c2-899f-b6f6c76b5faf None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.440506 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d2b8a-f1e6-47c2-899f-b6f6c76b5faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.440961 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-4da58b5a-f32b-4660-8009-5b8c920acda2 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:54.442154 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-4da58b5a-f32b-4660-8009-5b8c920acda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:54.450506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 753/1502] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:54.451769 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c6f3d-cceb-497e-a1b0-c0185b693b4a None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.452058 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c6f3d-cceb-497e-a1b0-c0185b693b4a None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.452337 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c6f3d-cceb-497e-a1b0-c0185b693b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.457992 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-109d2b8a-f1e6-47c2-899f-b6f6c76b5faf None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:54.459187 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-109d2b8a-f1e6-47c2-899f-b6f6c76b5faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:54.469284 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 750/1503] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:54.470055 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d2b8a-f1e6-47c2-899f-b6f6c76b5faf None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.470168 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-d05c6f3d-cceb-497e-a1b0-c0185b693b4a None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:54.471833 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-d05c6f3d-cceb-497e-a1b0-c0185b693b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:54.479452 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 754/1504] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:54.480855 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a57592-bb82-4cdb-a461-392bae402b66 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.481122 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d2b8a-f1e6-47c2-899f-b6f6c76b5faf None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.481239 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a57592-bb82-4cdb-a461-392bae402b66 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.481435 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a57592-bb82-4cdb-a461-392bae402b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.485666 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae66cb-57ce-47c2-abee-122a36862435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.486645 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae66cb-57ce-47c2-abee-122a36862435 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.486927 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae66cb-57ce-47c2-abee-122a36862435 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.487195 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae66cb-57ce-47c2-abee-122a36862435 admin admin] PATH_INFO: `/v3/projects/a2341cbfd5bf46039747c27a0d5fb8f9/users/029cbdf4fa7340549518b28e20c9328d/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.499505 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-99a57592-bb82-4cdb-a461-392bae402b66 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:54.500715 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-99a57592-bb82-4cdb-a461-392bae402b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:54.501070 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae66cb-57ce-47c2-abee-122a36862435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2341cbfd5bf46039747c27a0d5fb8f9, user_id=029cbdf4fa7340549518b28e20c9328d, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.504017 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae66cb-57ce-47c2-abee-122a36862435 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.510463 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 755/1505] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:54.511936 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e8c7-257d-4d1a-8654-0023b2e46681 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.512217 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e8c7-257d-4d1a-8654-0023b2e46681 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.512495 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e8c7-257d-4d1a-8654-0023b2e46681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.517949 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 751/1506] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:03:54 2021] PUT /identity/v3/projects/a2341cbfd5bf46039747c27a0d5fb8f9/users/029cbdf4fa7340549518b28e20c9328d/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:03:54.518757 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae66cb-57ce-47c2-abee-122a36862435 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.531926 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-b358e8c7-257d-4d1a-8654-0023b2e46681 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:54.533117 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b358e8c7-257d-4d1a-8654-0023b2e46681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:54.577780 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae66cb-57ce-47c2-abee-122a36862435 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.582245 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75738b41-84b7-41ce-bc8e-e2ebe93fb9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.582897 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75738b41-84b7-41ce-bc8e-e2ebe93fb9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.583179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75738b41-84b7-41ce-bc8e-e2ebe93fb9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.583481 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75738b41-84b7-41ce-bc8e-e2ebe93fb9e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.584185 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75738b41-84b7-41ce-bc8e-e2ebe93fb9e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:03:54.584496 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75738b41-84b7-41ce-bc8e-e2ebe93fb9e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.586077 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75738b41-84b7-41ce-bc8e-e2ebe93fb9e1 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.590617 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 756/1507] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:54.591509 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358e8c7-257d-4d1a-8654-0023b2e46681 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.597798 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 752/1508] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:03:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:03:54.599059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7f5c5-3eb0-42f9-93ac-194025f81454 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.599346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7f5c5-3eb0-42f9-93ac-194025f81454 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.599653 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7f5c5-3eb0-42f9-93ac-194025f81454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.600704 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358e8c7-257d-4d1a-8654-0023b2e46681 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.608111 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9968023-f639-49ce-b918-4bae57aa27f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.608781 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9968023-f639-49ce-b918-4bae57aa27f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.609067 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9968023-f639-49ce-b918-4bae57aa27f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.609398 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9968023-f639-49ce-b918-4bae57aa27f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.610132 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9968023-f639-49ce-b918-4bae57aa27f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.611796 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9968023-f639-49ce-b918-4bae57aa27f4 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.624990 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 757/1509] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:54.625157 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-11f7f5c5-3eb0-42f9-93ac-194025f81454 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:54.625257 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9968023-f639-49ce-b918-4bae57aa27f4 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.625346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-11f7f5c5-3eb0-42f9-93ac-194025f81454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:54.633011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 753/1510] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:54.633781 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7f5c5-3eb0-42f9-93ac-194025f81454 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.634383 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9968023-f639-49ce-b918-4bae57aa27f4 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.639782 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a805647-cf0e-4b1b-af9e-024c50fc9455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.640432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a805647-cf0e-4b1b-af9e-024c50fc9455 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.640717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a805647-cf0e-4b1b-af9e-024c50fc9455 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.640981 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a805647-cf0e-4b1b-af9e-024c50fc9455 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.642043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a805647-cf0e-4b1b-af9e-024c50fc9455 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:03:54.642411 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a805647-cf0e-4b1b-af9e-024c50fc9455 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.644178 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a805647-cf0e-4b1b-af9e-024c50fc9455 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.646561 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7f5c5-3eb0-42f9-93ac-194025f81454 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.652017 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb656c-736c-4d04-a44a-2dd1ca7c76ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.652671 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb656c-736c-4d04-a44a-2dd1ca7c76ab admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.652951 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb656c-736c-4d04-a44a-2dd1ca7c76ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.653224 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb656c-736c-4d04-a44a-2dd1ca7c76ab admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.653934 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb656c-736c-4d04-a44a-2dd1ca7c76ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:03:54.654240 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb656c-736c-4d04-a44a-2dd1ca7c76ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.655859 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb656c-736c-4d04-a44a-2dd1ca7c76ab admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.657546 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 758/1511] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:03:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:03:54.658484 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a805647-cf0e-4b1b-af9e-024c50fc9455 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.667528 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a805647-cf0e-4b1b-af9e-024c50fc9455 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.669689 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 754/1512] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:03:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:03:54.671012 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345f089-4048-49a6-ab0e-b8eaa3d65c29 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.671309 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345f089-4048-49a6-ab0e-b8eaa3d65c29 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.671621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345f089-4048-49a6-ab0e-b8eaa3d65c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.672948 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71411dea-6ac5-4b2c-8a45-77fd3c8d47d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.673749 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71411dea-6ac5-4b2c-8a45-77fd3c8d47d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.674186 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71411dea-6ac5-4b2c-8a45-77fd3c8d47d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.674615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71411dea-6ac5-4b2c-8a45-77fd3c8d47d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.675487 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71411dea-6ac5-4b2c-8a45-77fd3c8d47d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:03:54.675956 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71411dea-6ac5-4b2c-8a45-77fd3c8d47d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.678095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71411dea-6ac5-4b2c-8a45-77fd3c8d47d5 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.688761 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-b345f089-4048-49a6-ab0e-b8eaa3d65c29 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:54.689961 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b345f089-4048-49a6-ab0e-b8eaa3d65c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:54.690109 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 759/1513] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:03:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:03:54.690892 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71411dea-6ac5-4b2c-8a45-77fd3c8d47d5 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.698242 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 755/1514] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:54.699038 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345f089-4048-49a6-ab0e-b8eaa3d65c29 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.701341 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71411dea-6ac5-4b2c-8a45-77fd3c8d47d5 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.708062 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345f089-4048-49a6-ab0e-b8eaa3d65c29 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.708641 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545485f-07cd-4522-905b-709a307548f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.709294 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545485f-07cd-4522-905b-709a307548f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.709568 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545485f-07cd-4522-905b-709a307548f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.709836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545485f-07cd-4522-905b-709a307548f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.710546 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545485f-07cd-4522-905b-709a307548f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:03:54.710844 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545485f-07cd-4522-905b-709a307548f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.712479 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545485f-07cd-4522-905b-709a307548f7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.712830 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b675167-1160-4db5-880d-6a85215e0f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.713476 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b675167-1160-4db5-880d-6a85215e0f2b admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.713760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b675167-1160-4db5-880d-6a85215e0f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.714034 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b675167-1160-4db5-880d-6a85215e0f2b admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.714711 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b675167-1160-4db5-880d-6a85215e0f2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.716631 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b675167-1160-4db5-880d-6a85215e0f2b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.724352 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 760/1515] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:03:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:03:54.725183 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545485f-07cd-4522-905b-709a307548f7 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.735258 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545485f-07cd-4522-905b-709a307548f7 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.739991 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a9f56-b073-40dc-b6cc-894d732f7760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.740888 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a9f56-b073-40dc-b6cc-894d732f7760 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.741170 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a9f56-b073-40dc-b6cc-894d732f7760 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.741443 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a9f56-b073-40dc-b6cc-894d732f7760 admin admin] PATH_INFO: `/v3/projects/f3387a68ed744356ae7a2815ae8ef970/users/1d482b6ca72b463c9f47b651294b5a75/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.742613 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 756/1516] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:03:54.743347 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b675167-1160-4db5-880d-6a85215e0f2b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.757062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a9f56-b073-40dc-b6cc-894d732f7760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3387a68ed744356ae7a2815ae8ef970, user_id=1d482b6ca72b463c9f47b651294b5a75, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.760319 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a9f56-b073-40dc-b6cc-894d732f7760 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.772888 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 761/1517] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:03:54 2021] PUT /identity/v3/projects/f3387a68ed744356ae7a2815ae8ef970/users/1d482b6ca72b463c9f47b651294b5a75/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:03:54.773643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a9f56-b073-40dc-b6cc-894d732f7760 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.814241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b675167-1160-4db5-880d-6a85215e0f2b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.832539 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a9f56-b073-40dc-b6cc-894d732f7760 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.837095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aae272-f548-4c10-a338-ff5154c42025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.837841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aae272-f548-4c10-a338-ff5154c42025 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.838275 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aae272-f548-4c10-a338-ff5154c42025 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.838555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aae272-f548-4c10-a338-ff5154c42025 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.839230 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aae272-f548-4c10-a338-ff5154c42025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.841149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aae272-f548-4c10-a338-ff5154c42025 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.865420 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 762/1518] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:03:54.866218 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aae272-f548-4c10-a338-ff5154c42025 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.870597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4d7ca-7770-42ec-8a73-8d8601e4183a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.871471 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4d7ca-7770-42ec-8a73-8d8601e4183a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.871752 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4d7ca-7770-42ec-8a73-8d8601e4183a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.872050 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4d7ca-7770-42ec-8a73-8d8601e4183a admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.872766 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4d7ca-7770-42ec-8a73-8d8601e4183a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:03:54.873060 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4d7ca-7770-42ec-8a73-8d8601e4183a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.875128 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4d7ca-7770-42ec-8a73-8d8601e4183a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.894412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 757/1519] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:03:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:03:54.894412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4d7ca-7770-42ec-8a73-8d8601e4183a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.897587 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4d7ca-7770-42ec-8a73-8d8601e4183a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.926074 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aae272-f548-4c10-a338-ff5154c42025 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:54.930787 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa053498-9570-431d-8fc5-3af377771fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.932046 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa053498-9570-431d-8fc5-3af377771fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.932421 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa053498-9570-431d-8fc5-3af377771fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.932692 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa053498-9570-431d-8fc5-3af377771fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.933393 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa053498-9570-431d-8fc5-3af377771fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.935294 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa053498-9570-431d-8fc5-3af377771fd0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.951022 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731643eb-5523-477e-92ee-6d340d8a2a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:54.951713 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731643eb-5523-477e-92ee-6d340d8a2a0d admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:54.951998 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731643eb-5523-477e-92ee-6d340d8a2a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:54.952279 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731643eb-5523-477e-92ee-6d340d8a2a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:54.952959 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731643eb-5523-477e-92ee-6d340d8a2a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:54.954869 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731643eb-5523-477e-92ee-6d340d8a2a0d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:54.960216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 763/1520] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:03:54.961105 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa053498-9570-431d-8fc5-3af377771fd0 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:54.981748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 758/1521] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:03:54.982543 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731643eb-5523-477e-92ee-6d340d8a2a0d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.014947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa053498-9570-431d-8fc5-3af377771fd0 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.039533 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731643eb-5523-477e-92ee-6d340d8a2a0d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.045599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc328e0-6b0d-479d-928b-7ac46c2bc843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.046276 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc328e0-6b0d-479d-928b-7ac46c2bc843 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.046577 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc328e0-6b0d-479d-928b-7ac46c2bc843 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.046850 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc328e0-6b0d-479d-928b-7ac46c2bc843 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.047577 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc328e0-6b0d-479d-928b-7ac46c2bc843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.049482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc328e0-6b0d-479d-928b-7ac46c2bc843 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.061685 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919e0f4-86d0-4b66-8a60-cf6633069e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.062337 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919e0f4-86d0-4b66-8a60-cf6633069e81 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.062624 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919e0f4-86d0-4b66-8a60-cf6633069e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.062902 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919e0f4-86d0-4b66-8a60-cf6633069e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.072713 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919e0f4-86d0-4b66-8a60-cf6633069e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.074146 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919e0f4-86d0-4b66-8a60-cf6633069e81 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.078026 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 759/1522] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:03:54 2021] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:03:55.078026 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc328e0-6b0d-479d-928b-7ac46c2bc843 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.083943 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 764/1523] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:03:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:03:55.084998 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ffd64-905b-4084-ad8e-f44044a3bedb None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.085290 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ffd64-905b-4084-ad8e-f44044a3bedb None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.085572 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ffd64-905b-4084-ad8e-f44044a3bedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.112988 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-ed0ffd64-905b-4084-ad8e-f44044a3bedb None None] MFA Rules not processed for user `1d482b6ca72b463c9f47b651294b5a75`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:55.114216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ed0ffd64-905b-4084-ad8e-f44044a3bedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:55.154476 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc328e0-6b0d-479d-928b-7ac46c2bc843 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.159494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6defd4-5593-430e-b02a-8d1b29ac3e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.160180 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6defd4-5593-430e-b02a-8d1b29ac3e12 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.160466 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6defd4-5593-430e-b02a-8d1b29ac3e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.160767 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6defd4-5593-430e-b02a-8d1b29ac3e12 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.161599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6defd4-5593-430e-b02a-8d1b29ac3e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.163826 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6defd4-5593-430e-b02a-8d1b29ac3e12 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.188011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 760/1524] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:03:55 2021] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:03:55.188855 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6defd4-5593-430e-b02a-8d1b29ac3e12 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.191898 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 765/1525] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:55 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:55.192808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ffd64-905b-4084-ad8e-f44044a3bedb None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.201023 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6defd4-5593-430e-b02a-8d1b29ac3e12 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.206807 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77c31c-ecad-4273-a265-0ba101fd6bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.207847 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77c31c-ecad-4273-a265-0ba101fd6bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.208145 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ffd64-905b-4084-ad8e-f44044a3bedb None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.208542 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77c31c-ecad-4273-a265-0ba101fd6bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.209119 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77c31c-ecad-4273-a265-0ba101fd6bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.210063 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77c31c-ecad-4273-a265-0ba101fd6bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.212167 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77c31c-ecad-4273-a265-0ba101fd6bc3 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.214506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45283312-e74d-4443-ae17-8d416065ec1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.215195 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45283312-e74d-4443-ae17-8d416065ec1c admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.215634 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45283312-e74d-4443-ae17-8d416065ec1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.215977 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45283312-e74d-4443-ae17-8d416065ec1c admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.216659 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45283312-e74d-4443-ae17-8d416065ec1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.219155 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45283312-e74d-4443-ae17-8d416065ec1c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.235905 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 761/1526] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:03:55 2021] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:03:55.236711 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77c31c-ecad-4273-a265-0ba101fd6bc3 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.251298 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77c31c-ecad-4273-a265-0ba101fd6bc3 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.252589 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 766/1527] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:03:55 2021] POST /identity/v3/projects => generated 405 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:03:55.253743 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45283312-e74d-4443-ae17-8d416065ec1c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.316379 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc125f-9c6f-4185-adda-9295b6d2498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.317061 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc125f-9c6f-4185-adda-9295b6d2498a admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.317350 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc125f-9c6f-4185-adda-9295b6d2498a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.317640 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc125f-9c6f-4185-adda-9295b6d2498a admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.318635 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc125f-9c6f-4185-adda-9295b6d2498a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.320916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc125f-9c6f-4185-adda-9295b6d2498a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.337902 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45283312-e74d-4443-ae17-8d416065ec1c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.344640 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb83da-14b1-48b3-b191-98e93f5c12ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.345463 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb83da-14b1-48b3-b191-98e93f5c12ae admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.345668 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb83da-14b1-48b3-b191-98e93f5c12ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.345952 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb83da-14b1-48b3-b191-98e93f5c12ae admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.346739 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb83da-14b1-48b3-b191-98e93f5c12ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.348739 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb83da-14b1-48b3-b191-98e93f5c12ae admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.357316 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 762/1528] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:03:55 2021] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:03:55.358201 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc125f-9c6f-4185-adda-9295b6d2498a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.369730 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc125f-9c6f-4185-adda-9295b6d2498a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.374801 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645b091-dcad-442e-a719-10f0cb33eaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.375841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645b091-dcad-442e-a719-10f0cb33eaf1 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.376270 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645b091-dcad-442e-a719-10f0cb33eaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.376606 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645b091-dcad-442e-a719-10f0cb33eaf1 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.380930 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 767/1529] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:03:55 2021] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:03:55.381067 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645b091-dcad-442e-a719-10f0cb33eaf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.381183 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb83da-14b1-48b3-b191-98e93f5c12ae admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.381285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645b091-dcad-442e-a719-10f0cb33eaf1 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.391326 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb83da-14b1-48b3-b191-98e93f5c12ae admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.397691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083012b3-d1e9-46b9-8bb2-a9d6038b0955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.398435 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083012b3-d1e9-46b9-8bb2-a9d6038b0955 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.398795 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083012b3-d1e9-46b9-8bb2-a9d6038b0955 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.399148 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083012b3-d1e9-46b9-8bb2-a9d6038b0955 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.400231 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083012b3-d1e9-46b9-8bb2-a9d6038b0955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.402835 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083012b3-d1e9-46b9-8bb2-a9d6038b0955 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.403707 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 763/1530] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:03:55 2021] POST /identity/v3/users => generated 288 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:03:55.405285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a1317-9e6d-4168-8acd-81bfe74dd0ec None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.405677 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a1317-9e6d-4168-8acd-81bfe74dd0ec None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.406097 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a1317-9e6d-4168-8acd-81bfe74dd0ec None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.408130 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 764/1531] 10.222.0.39 () {54 vars in 961 bytes} [Tue Aug 31 03:03:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:03:55.408944 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a1317-9e6d-4168-8acd-81bfe74dd0ec None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.419408 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 768/1532] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:55 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:55.419920 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083012b3-d1e9-46b9-8bb2-a9d6038b0955 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.427102 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a1317-9e6d-4168-8acd-81bfe74dd0ec None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.429812 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083012b3-d1e9-46b9-8bb2-a9d6038b0955 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.432633 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d4980-47e0-4eb0-aff4-05955dfe0b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.433430 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d4980-47e0-4eb0-aff4-05955dfe0b8d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.433793 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d4980-47e0-4eb0-aff4-05955dfe0b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.434173 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d4980-47e0-4eb0-aff4-05955dfe0b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.435005 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d4980-47e0-4eb0-aff4-05955dfe0b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.435551 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b10dcc-eb11-4064-bc20-6e06fc9f4ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.436203 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b10dcc-eb11-4064-bc20-6e06fc9f4ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.436482 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b10dcc-eb11-4064-bc20-6e06fc9f4ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.436756 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b10dcc-eb11-4064-bc20-6e06fc9f4ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.437252 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d4980-47e0-4eb0-aff4-05955dfe0b8d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.437478 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b10dcc-eb11-4064-bc20-6e06fc9f4ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.439400 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b10dcc-eb11-4064-bc20-6e06fc9f4ea6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.454553 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 765/1533] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:55 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:55.454553 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d4980-47e0-4eb0-aff4-05955dfe0b8d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.466945 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d4980-47e0-4eb0-aff4-05955dfe0b8d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.473362 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939f448-9572-474d-ba7a-1a3f03cf0b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.473752 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 769/1534] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:03:55 2021] POST /identity/v3/users => generated 303 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:03:55.474577 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939f448-9572-474d-ba7a-1a3f03cf0b61 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.474693 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b10dcc-eb11-4064-bc20-6e06fc9f4ea6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.475171 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939f448-9572-474d-ba7a-1a3f03cf0b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.475486 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939f448-9572-474d-ba7a-1a3f03cf0b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.476652 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939f448-9572-474d-ba7a-1a3f03cf0b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.478978 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939f448-9572-474d-ba7a-1a3f03cf0b61 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.488749 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b10dcc-eb11-4064-bc20-6e06fc9f4ea6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.497340 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 766/1535] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:55 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:55.497340 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939f448-9572-474d-ba7a-1a3f03cf0b61 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.506172 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22eef9c-1d4a-43e3-bc0c-110924715fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.506887 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22eef9c-1d4a-43e3-bc0c-110924715fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.507172 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22eef9c-1d4a-43e3-bc0c-110924715fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.507484 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22eef9c-1d4a-43e3-bc0c-110924715fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.507940 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939f448-9572-474d-ba7a-1a3f03cf0b61 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.508221 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22eef9c-1d4a-43e3-bc0c-110924715fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.509896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22eef9c-1d4a-43e3-bc0c-110924715fd2 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.513737 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c14915-e274-4943-8bd3-4f3d984741ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.514570 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c14915-e274-4943-8bd3-4f3d984741ec admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.514859 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c14915-e274-4943-8bd3-4f3d984741ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.515139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c14915-e274-4943-8bd3-4f3d984741ec admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.516392 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c14915-e274-4943-8bd3-4f3d984741ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.518725 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c14915-e274-4943-8bd3-4f3d984741ec admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.520358 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 770/1536] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:55 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:55.521655 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb20d3b-2faa-4688-8f17-78bd4d6fdd7b None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.521947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb20d3b-2faa-4688-8f17-78bd4d6fdd7b None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.522230 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb20d3b-2faa-4688-8f17-78bd4d6fdd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.530557 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 767/1537] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:55 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:55.531397 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c14915-e274-4943-8bd3-4f3d984741ec admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.544105 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c14915-e274-4943-8bd3-4f3d984741ec admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.547530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-acb20d3b-2faa-4688-8f17-78bd4d6fdd7b None None] MFA Rules not processed for user `a6bb852fc4394f88800ec9616cb65416`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:55.548833 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-acb20d3b-2faa-4688-8f17-78bd4d6fdd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:55.549373 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4125c9-34f7-4ad6-baf9-fddc6f9cd8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.550143 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4125c9-34f7-4ad6-baf9-fddc6f9cd8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.550433 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4125c9-34f7-4ad6-baf9-fddc6f9cd8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.550744 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4125c9-34f7-4ad6-baf9-fddc6f9cd8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.551615 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4125c9-34f7-4ad6-baf9-fddc6f9cd8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.553389 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4125c9-34f7-4ad6-baf9-fddc6f9cd8e7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.566977 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 768/1538] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:55 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:55.568564 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4125c9-34f7-4ad6-baf9-fddc6f9cd8e7 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.578451 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4125c9-34f7-4ad6-baf9-fddc6f9cd8e7 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.583125 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f875d-1422-4c43-90d4-856d7417c7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.583857 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f875d-1422-4c43-90d4-856d7417c7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.584148 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f875d-1422-4c43-90d4-856d7417c7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.584421 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f875d-1422-4c43-90d4-856d7417c7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.585173 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f875d-1422-4c43-90d4-856d7417c7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.586764 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f875d-1422-4c43-90d4-856d7417c7b2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.598200 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 769/1539] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:55.599153 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f875d-1422-4c43-90d4-856d7417c7b2 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.609988 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f875d-1422-4c43-90d4-856d7417c7b2 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.614706 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32983417-a432-4a56-a26b-4159a541f42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.615356 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32983417-a432-4a56-a26b-4159a541f42b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.615745 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32983417-a432-4a56-a26b-4159a541f42b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.615954 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32983417-a432-4a56-a26b-4159a541f42b admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.616671 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32983417-a432-4a56-a26b-4159a541f42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.618253 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32983417-a432-4a56-a26b-4159a541f42b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.626392 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 771/1540] 10.222.0.39 () {58 vars in 1059 bytes} [Tue Aug 31 03:03:55 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:55.627497 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb20d3b-2faa-4688-8f17-78bd4d6fdd7b None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.628663 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 770/1541] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:55.629834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32983417-a432-4a56-a26b-4159a541f42b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.642835 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32983417-a432-4a56-a26b-4159a541f42b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.643386 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb20d3b-2faa-4688-8f17-78bd4d6fdd7b None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.648359 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750926a6-6e4a-4762-a944-d0111506e8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.648881 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab34a3-4e01-4135-a360-2d0731bdd8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.649020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750926a6-6e4a-4762-a944-d0111506e8fc admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.649342 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750926a6-6e4a-4762-a944-d0111506e8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.649675 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750926a6-6e4a-4762-a944-d0111506e8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.649790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab34a3-4e01-4135-a360-2d0731bdd8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.649946 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab34a3-4e01-4135-a360-2d0731bdd8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.650756 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab34a3-4e01-4135-a360-2d0731bdd8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.651024 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750926a6-6e4a-4762-a944-d0111506e8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.651749 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab34a3-4e01-4135-a360-2d0731bdd8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.653208 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750926a6-6e4a-4762-a944-d0111506e8fc admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.653387 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab34a3-4e01-4135-a360-2d0731bdd8f3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.666643 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 771/1542] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:55 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:55.667077 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 772/1543] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:55 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:55.668285 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab34a3-4e01-4135-a360-2d0731bdd8f3 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.670819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750926a6-6e4a-4762-a944-d0111506e8fc admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.679392 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab34a3-4e01-4135-a360-2d0731bdd8f3 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.680064 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750926a6-6e4a-4762-a944-d0111506e8fc admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.684467 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99dc57-2a64-49a6-9a6a-76d233f8030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.685391 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99dc57-2a64-49a6-9a6a-76d233f8030b admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.685519 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5a9b2-3ba4-4628-ae41-2b08b451bf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.685617 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99dc57-2a64-49a6-9a6a-76d233f8030b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.685933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99dc57-2a64-49a6-9a6a-76d233f8030b admin admin] PATH_INFO: `/v3/projects/cbeddb341e5b4fe38a57da85751267ba/users/999210c8bd9c4367869ebaf967556c6b/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.686225 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5a9b2-3ba4-4628-ae41-2b08b451bf88 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.686483 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5a9b2-3ba4-4628-ae41-2b08b451bf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.686909 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5a9b2-3ba4-4628-ae41-2b08b451bf88 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.687911 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5a9b2-3ba4-4628-ae41-2b08b451bf88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.689924 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5a9b2-3ba4-4628-ae41-2b08b451bf88 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.701780 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99dc57-2a64-49a6-9a6a-76d233f8030b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbeddb341e5b4fe38a57da85751267ba, user_id=999210c8bd9c4367869ebaf967556c6b, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.703354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 772/1544] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:55 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:55.704392 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5a9b2-3ba4-4628-ae41-2b08b451bf88 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.704508 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99dc57-2a64-49a6-9a6a-76d233f8030b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.716796 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5a9b2-3ba4-4628-ae41-2b08b451bf88 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.719866 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 773/1545] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:03:55 2021] PUT /identity/v3/projects/cbeddb341e5b4fe38a57da85751267ba/users/999210c8bd9c4367869ebaf967556c6b/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:03:55.721635 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99dc57-2a64-49a6-9a6a-76d233f8030b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.781138 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41259746-4baf-4d7b-b55d-570c7fe0d22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.782275 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41259746-4baf-4d7b-b55d-570c7fe0d22e admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.782727 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41259746-4baf-4d7b-b55d-570c7fe0d22e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.783176 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41259746-4baf-4d7b-b55d-570c7fe0d22e admin admin] PATH_INFO: `/v3/projects/2c86e34615414b2ca54ee3779044ffe6/users/9f64c6e3e57b4c46a78ad643f5aa2770/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.795281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99dc57-2a64-49a6-9a6a-76d233f8030b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.799785 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41259746-4baf-4d7b-b55d-570c7fe0d22e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c86e34615414b2ca54ee3779044ffe6, user_id=9f64c6e3e57b4c46a78ad643f5aa2770, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.800970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e9c0-9ff5-4e0a-b444-c02eea0ec093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.802025 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e9c0-9ff5-4e0a-b444-c02eea0ec093 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.802372 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e9c0-9ff5-4e0a-b444-c02eea0ec093 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.802523 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41259746-4baf-4d7b-b55d-570c7fe0d22e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.802770 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e9c0-9ff5-4e0a-b444-c02eea0ec093 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.804603 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744e9c0-9ff5-4e0a-b444-c02eea0ec093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.808916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744e9c0-9ff5-4e0a-b444-c02eea0ec093 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.825251 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 774/1546] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:55 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:55.825251 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e9c0-9ff5-4e0a-b444-c02eea0ec093 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.832148 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 773/1547] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:03:55 2021] PUT /identity/v3/projects/2c86e34615414b2ca54ee3779044ffe6/users/9f64c6e3e57b4c46a78ad643f5aa2770/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:03:55.833069 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41259746-4baf-4d7b-b55d-570c7fe0d22e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:55.916961 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41259746-4baf-4d7b-b55d-570c7fe0d22e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.922314 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f987a-55bd-44e0-afe2-0fbe1e2c76d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:55.923326 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f987a-55bd-44e0-afe2-0fbe1e2c76d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:55.923728 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f987a-55bd-44e0-afe2-0fbe1e2c76d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:55.924117 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f987a-55bd-44e0-afe2-0fbe1e2c76d4 admin admin] PATH_INFO: `/v3/projects/0060db79d68e4bb492cfc5e672c9d4a1/users/361eb264d0a147e9879a758807cd3eed/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:55.936060 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e9c0-9ff5-4e0a-b444-c02eea0ec093 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:55.945561 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f987a-55bd-44e0-afe2-0fbe1e2c76d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0060db79d68e4bb492cfc5e672c9d4a1, user_id=361eb264d0a147e9879a758807cd3eed, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:55.948664 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f987a-55bd-44e0-afe2-0fbe1e2c76d4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:55.968218 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 774/1548] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:03:55 2021] PUT /identity/v3/projects/0060db79d68e4bb492cfc5e672c9d4a1/users/361eb264d0a147e9879a758807cd3eed/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:03:55.968977 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f987a-55bd-44e0-afe2-0fbe1e2c76d4 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:56.007706 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372ca15-18af-462c-a13b-94dbb4a88893 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:56.008682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372ca15-18af-462c-a13b-94dbb4a88893 service nova] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.008972 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372ca15-18af-462c-a13b-94dbb4a88893 service nova] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.009250 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372ca15-18af-462c-a13b-94dbb4a88893 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.043859 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f987a-55bd-44e0-afe2-0fbe1e2c76d4 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:56.048656 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e9f56-332a-4651-9f8b-623e991c48b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:56.049648 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e9f56-332a-4651-9f8b-623e991c48b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.049941 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e9f56-332a-4651-9f8b-623e991c48b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.050219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e9f56-332a-4651-9f8b-623e991c48b2 admin admin] PATH_INFO: `/v3/projects/914e98e1b8e64dd6a3d50cf009c9a2af/users/562353a14c284dcda0f7fdba85a418ef/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.066624 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e9f56-332a-4651-9f8b-623e991c48b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=914e98e1b8e64dd6a3d50cf009c9a2af, user_id=562353a14c284dcda0f7fdba85a418ef, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:56.069894 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372ca15-18af-462c-a13b-94dbb4a88893 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:56.070639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e9f56-332a-4651-9f8b-623e991c48b2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:56.071535 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372ca15-18af-462c-a13b-94dbb4a88893 service nova] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:56.082168 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 775/1549] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:03:55 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:03:56.082814 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372ca15-18af-462c-a13b-94dbb4a88893 service nova] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:56.090608 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 775/1550] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:03:55 2021] PUT /identity/v3/projects/914e98e1b8e64dd6a3d50cf009c9a2af/users/562353a14c284dcda0f7fdba85a418ef/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:03:56.092222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94908502-33ae-4b5e-8fe5-1050755d8639 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.092546 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94908502-33ae-4b5e-8fe5-1050755d8639 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.092827 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94908502-33ae-4b5e-8fe5-1050755d8639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.093753 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372ca15-18af-462c-a13b-94dbb4a88893 service nova] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:56.116597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-94908502-33ae-4b5e-8fe5-1050755d8639 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:56.117813 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-94908502-33ae-4b5e-8fe5-1050755d8639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:56.162196 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853864c5-8ace-4c3e-9848-d8e45cf80dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:56.163925 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853864c5-8ace-4c3e-9848-d8e45cf80dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.164227 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853864c5-8ace-4c3e-9848-d8e45cf80dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.164600 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853864c5-8ace-4c3e-9848-d8e45cf80dfd admin admin] PATH_INFO: `/v3/projects/65e123f49a16418eb59bd353c6ab19b9/users/db4b7bebbd9149d8bd4482e255cbbb7e/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.185590 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853864c5-8ace-4c3e-9848-d8e45cf80dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e123f49a16418eb59bd353c6ab19b9, user_id=db4b7bebbd9149d8bd4482e255cbbb7e, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:56.189218 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853864c5-8ace-4c3e-9848-d8e45cf80dfd admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:56.199201 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 776/1551] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:56.203538 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94908502-33ae-4b5e-8fe5-1050755d8639 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:56.207470 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 776/1552] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:03:56 2021] PUT /identity/v3/projects/65e123f49a16418eb59bd353c6ab19b9/users/db4b7bebbd9149d8bd4482e255cbbb7e/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:03:56.207470 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08f2dc-1446-49cd-aaa2-ca3b2c65875a None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.207470 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08f2dc-1446-49cd-aaa2-ca3b2c65875a None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.207801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08f2dc-1446-49cd-aaa2-ca3b2c65875a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.214247 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94908502-33ae-4b5e-8fe5-1050755d8639 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:56.244454 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-af08f2dc-1446-49cd-aaa2-ca3b2c65875a None None] MFA Rules not processed for user `9f64c6e3e57b4c46a78ad643f5aa2770`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:56.246142 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-af08f2dc-1446-49cd-aaa2-ca3b2c65875a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:56.277605 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4800ff-cc62-461f-af79-8ad96fdadd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:56.278676 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4800ff-cc62-461f-af79-8ad96fdadd40 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.278992 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4800ff-cc62-461f-af79-8ad96fdadd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.279467 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4800ff-cc62-461f-af79-8ad96fdadd40 admin admin] PATH_INFO: `/v3/projects/d2c271fd1a554e1ab67a94b3ccbc791c/users/1e51a415f33f48eb9242beea431d6d28/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.295791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4800ff-cc62-461f-af79-8ad96fdadd40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c271fd1a554e1ab67a94b3ccbc791c, user_id=1e51a415f33f48eb9242beea431d6d28, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:56.298771 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4800ff-cc62-461f-af79-8ad96fdadd40 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:56.314215 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 777/1553] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:03:56 2021] PUT /identity/v3/projects/d2c271fd1a554e1ab67a94b3ccbc791c/users/1e51a415f33f48eb9242beea431d6d28/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:03:56.316320 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e59eb-f958-42a8-b41b-98df79a0c466 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.316612 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e59eb-f958-42a8-b41b-98df79a0c466 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.317172 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e59eb-f958-42a8-b41b-98df79a0c466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.328713 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 777/1554] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:56 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:56.330077 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064f8f0-325f-436d-93b4-339e11132323 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.330374 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064f8f0-325f-436d-93b4-339e11132323 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.330658 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064f8f0-325f-436d-93b4-339e11132323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.339638 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-ed9e59eb-f958-42a8-b41b-98df79a0c466 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:56.342115 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-ed9e59eb-f958-42a8-b41b-98df79a0c466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:56.352277 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-a064f8f0-325f-436d-93b4-339e11132323 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:56.354195 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a064f8f0-325f-436d-93b4-339e11132323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:56.419402 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 778/1555] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:56.420989 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d011d-d097-409b-aaa0-57fb895c8b47 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.421345 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d011d-d097-409b-aaa0-57fb895c8b47 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.421697 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d011d-d097-409b-aaa0-57fb895c8b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.428809 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 778/1556] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:56.430000 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064f8f0-325f-436d-93b4-339e11132323 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:56.431605 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a064f8f0-325f-436d-93b4-339e11132323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:56.457352 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-539d011d-d097-409b-aaa0-57fb895c8b47 None None] MFA Rules not processed for user `db4b7bebbd9149d8bd4482e255cbbb7e`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:56.458569 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-539d011d-d097-409b-aaa0-57fb895c8b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:56.488442 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064f8f0-325f-436d-93b4-339e11132323 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:56.492217 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991efad0-6600-4b2a-b3d3-fcbb34cf242c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:56.492850 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991efad0-6600-4b2a-b3d3-fcbb34cf242c service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.493133 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991efad0-6600-4b2a-b3d3-fcbb34cf242c service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.493458 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991efad0-6600-4b2a-b3d3-fcbb34cf242c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.512228 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991efad0-6600-4b2a-b3d3-fcbb34cf242c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:56.514000 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991efad0-6600-4b2a-b3d3-fcbb34cf242c service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:56.524902 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 779/1557] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:03:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:03:56.527446 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4eb96-ef86-497e-b8f9-b52a46b72c03 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.527818 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4eb96-ef86-497e-b8f9-b52a46b72c03 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.528161 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4eb96-ef86-497e-b8f9-b52a46b72c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.534995 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 779/1558] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:56 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:56.536195 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d011d-d097-409b-aaa0-57fb895c8b47 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:56.551598 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d011d-d097-409b-aaa0-57fb895c8b47 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:56.569046 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acae0a4-ed8b-4491-88e7-48fb994f0b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:56.569192 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-41b4eb96-ef86-497e-b8f9-b52a46b72c03 None None] MFA Rules not processed for user `1e51a415f33f48eb9242beea431d6d28`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:56.569709 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acae0a4-ed8b-4491-88e7-48fb994f0b91 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.569996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acae0a4-ed8b-4491-88e7-48fb994f0b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.570380 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acae0a4-ed8b-4491-88e7-48fb994f0b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.570514 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-41b4eb96-ef86-497e-b8f9-b52a46b72c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:56.571209 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acae0a4-ed8b-4491-88e7-48fb994f0b91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:56.573971 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acae0a4-ed8b-4491-88e7-48fb994f0b91 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:56.603324 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 780/1559] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:03:56 2021] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:03:56.604700 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8826fa4-c3e8-4f28-80cd-bf26b9dcf119 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.605079 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8826fa4-c3e8-4f28-80cd-bf26b9dcf119 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.605433 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8826fa4-c3e8-4f28-80cd-bf26b9dcf119 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.607585 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 781/1560] 10.222.0.39 () {54 vars in 912 bytes} [Tue Aug 31 03:03:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:03:56.608201 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8826fa4-c3e8-4f28-80cd-bf26b9dcf119 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:56.653363 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 780/1561] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:56 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:56.654318 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4eb96-ef86-497e-b8f9-b52a46b72c03 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:56.664986 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4eb96-ef86-497e-b8f9-b52a46b72c03 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:56.677646 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8826fa4-c3e8-4f28-80cd-bf26b9dcf119 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:56.682454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90d676-26c5-4abf-8241-e91670933ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:56.683169 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90d676-26c5-4abf-8241-e91670933ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.683555 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90d676-26c5-4abf-8241-e91670933ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.683869 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90d676-26c5-4abf-8241-e91670933ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.718151 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b51646-4b20-4b1a-b225-cb78a4e44918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:56.718762 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b51646-4b20-4b1a-b225-cb78a4e44918 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.719048 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b51646-4b20-4b1a-b225-cb78a4e44918 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.719328 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b51646-4b20-4b1a-b225-cb78a4e44918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.755494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90d676-26c5-4abf-8241-e91670933ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:56.756959 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90d676-26c5-4abf-8241-e91670933ba5 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:56.767282 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 782/1562] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:03:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:03:56.768682 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb88c1-2451-453e-b465-3f39351dc0f1 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.768979 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb88c1-2451-453e-b465-3f39351dc0f1 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.769379 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb88c1-2451-453e-b465-3f39351dc0f1 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.771509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 783/1563] 10.222.0.39 () {54 vars in 961 bytes} [Tue Aug 31 03:03:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:03:56.772252 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb88c1-2451-453e-b465-3f39351dc0f1 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:56.786209 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb88c1-2451-453e-b465-3f39351dc0f1 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:56.791857 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93737a-f340-4d1c-a8b9-796577ef4137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:56.792535 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93737a-f340-4d1c-a8b9-796577ef4137 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.792824 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93737a-f340-4d1c-a8b9-796577ef4137 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.793501 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93737a-f340-4d1c-a8b9-796577ef4137 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.793791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93737a-f340-4d1c-a8b9-796577ef4137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:56.795753 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93737a-f340-4d1c-a8b9-796577ef4137 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:56.798132 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b51646-4b20-4b1a-b225-cb78a4e44918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:56.799509 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b51646-4b20-4b1a-b225-cb78a4e44918 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:56.811208 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 781/1564] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:03:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:03:56.817283 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 784/1565] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:03:56 2021] POST /identity/v3/users => generated 299 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:03:56.817408 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e949e2b-c401-4b68-9b32-c0cde5d34d1f None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.817962 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e949e2b-c401-4b68-9b32-c0cde5d34d1f None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.818257 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e949e2b-c401-4b68-9b32-c0cde5d34d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.820799 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93737a-f340-4d1c-a8b9-796577ef4137 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:56.832189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93737a-f340-4d1c-a8b9-796577ef4137 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:56.838672 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f9794-b98c-43ae-8753-98c39dc855ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:56.839430 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f9794-b98c-43ae-8753-98c39dc855ab admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.839844 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f9794-b98c-43ae-8753-98c39dc855ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.840179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f9794-b98c-43ae-8753-98c39dc855ab admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.841263 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f9794-b98c-43ae-8753-98c39dc855ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:56.843642 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f9794-b98c-43ae-8753-98c39dc855ab admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:56.844915 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-5e949e2b-c401-4b68-9b32-c0cde5d34d1f None None] MFA Rules not processed for user `a6bb852fc4394f88800ec9616cb65416`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:56.846119 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-5e949e2b-c401-4b68-9b32-c0cde5d34d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:56.882384 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 785/1566] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:03:56 2021] POST /identity/v3/projects => generated 403 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:03:56.888250 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1b723-8154-46bf-bb80-edc048f145c5 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:56.888588 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1b723-8154-46bf-bb80-edc048f145c5 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:56.893368 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1b723-8154-46bf-bb80-edc048f145c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:56.924102 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-c5c1b723-8154-46bf-bb80-edc048f145c5 None None] MFA Rules not processed for user `a6bb852fc4394f88800ec9616cb65416`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:56.925331 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c5c1b723-8154-46bf-bb80-edc048f145c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:56.971819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 782/1567] 10.222.0.39 () {58 vars in 1010 bytes} [Tue Aug 31 03:03:56 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:56.973302 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e949e2b-c401-4b68-9b32-c0cde5d34d1f None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:56.997123 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e949e2b-c401-4b68-9b32-c0cde5d34d1f None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:57.012532 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 786/1568] 10.222.0.39 () {58 vars in 1059 bytes} [Tue Aug 31 03:03:56 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:57.013490 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1b723-8154-46bf-bb80-edc048f145c5 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:57.092401 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48b7c9-5950-456f-9afa-c70016960607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:57.093130 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48b7c9-5950-456f-9afa-c70016960607 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:57.093701 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48b7c9-5950-456f-9afa-c70016960607 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:57.093701 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48b7c9-5950-456f-9afa-c70016960607 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:57.094405 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48b7c9-5950-456f-9afa-c70016960607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:57.096275 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48b7c9-5950-456f-9afa-c70016960607 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:57.099347 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1b723-8154-46bf-bb80-edc048f145c5 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:57.109695 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f848552-63de-4e03-9ee8-74dd868d535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:57.110757 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f848552-63de-4e03-9ee8-74dd868d535d admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:57.111144 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f848552-63de-4e03-9ee8-74dd868d535d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:57.111464 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f848552-63de-4e03-9ee8-74dd868d535d admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:57.112500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f848552-63de-4e03-9ee8-74dd868d535d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:57.114224 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 783/1569] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:56 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:57.115226 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48b7c9-5950-456f-9afa-c70016960607 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:57.118568 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f848552-63de-4e03-9ee8-74dd868d535d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:57.154065 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 787/1570] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:03:57 2021] POST /identity/v3/users => generated 308 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:03:57.156925 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f848552-63de-4e03-9ee8-74dd868d535d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:57.177847 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f848552-63de-4e03-9ee8-74dd868d535d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:57.186773 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2a156-f4bc-4901-98db-9337a1e7aa09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:57.188059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2a156-f4bc-4901-98db-9337a1e7aa09 service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:57.188059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2a156-f4bc-4901-98db-9337a1e7aa09 service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:57.188967 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2a156-f4bc-4901-98db-9337a1e7aa09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:57.201653 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48b7c9-5950-456f-9afa-c70016960607 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:57.206930 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3e1bf-07e1-44d7-a84b-99a946f465fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:57.208240 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3e1bf-07e1-44d7-a84b-99a946f465fc service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:57.208735 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3e1bf-07e1-44d7-a84b-99a946f465fc service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:57.209435 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3e1bf-07e1-44d7-a84b-99a946f465fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:57.224762 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3e1bf-07e1-44d7-a84b-99a946f465fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:57.226919 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3e1bf-07e1-44d7-a84b-99a946f465fc service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:57.261506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 784/1571] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:03:57 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:03:57.263046 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3e1bf-07e1-44d7-a84b-99a946f465fc service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:57.266771 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2a156-f4bc-4901-98db-9337a1e7aa09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:57.268428 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2a156-f4bc-4901-98db-9337a1e7aa09 service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:57.280284 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 788/1572] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:03:57 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:03:57.281161 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2a156-f4bc-4901-98db-9337a1e7aa09 service nova] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:57.293463 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2a156-f4bc-4901-98db-9337a1e7aa09 service nova] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:57.297011 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3e1bf-07e1-44d7-a84b-99a946f465fc service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:57.299106 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04585b7c-6188-4f78-a381-aad2830107c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:57.299823 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04585b7c-6188-4f78-a381-aad2830107c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:57.300266 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04585b7c-6188-4f78-a381-aad2830107c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:57.300556 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04585b7c-6188-4f78-a381-aad2830107c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:57.301288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04585b7c-6188-4f78-a381-aad2830107c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:57.302954 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04585b7c-6188-4f78-a381-aad2830107c4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:57.310565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68ee3f-dc8f-40dc-9bf1-65dc84562818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:57.311793 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68ee3f-dc8f-40dc-9bf1-65dc84562818 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:57.312283 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68ee3f-dc8f-40dc-9bf1-65dc84562818 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:57.312761 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68ee3f-dc8f-40dc-9bf1-65dc84562818 admin admin] PATH_INFO: `/v3/projects/aea44c7ec85e4429bdceee92e65821e1/users/f7891d083fc5468a860e26bf04253eb3/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:57.319093 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 789/1573] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:57 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:57.320747 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04585b7c-6188-4f78-a381-aad2830107c4 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:57.332192 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04585b7c-6188-4f78-a381-aad2830107c4 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:57.337558 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc57d8-7e36-4870-a14f-c7cabce28f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:57.338459 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc57d8-7e36-4870-a14f-c7cabce28f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:57.339094 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc57d8-7e36-4870-a14f-c7cabce28f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:57.339969 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc57d8-7e36-4870-a14f-c7cabce28f2f admin admin] PATH_INFO: `/v3/projects/bc4d86610439462da3118196491824bf/users/a014f91d57864863a095f4f69c1fea4b/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:57.350696 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68ee3f-dc8f-40dc-9bf1-65dc84562818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea44c7ec85e4429bdceee92e65821e1, user_id=f7891d083fc5468a860e26bf04253eb3, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:57.354694 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68ee3f-dc8f-40dc-9bf1-65dc84562818 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:57.358983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc57d8-7e36-4870-a14f-c7cabce28f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4d86610439462da3118196491824bf, user_id=a014f91d57864863a095f4f69c1fea4b, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:57.364395 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc57d8-7e36-4870-a14f-c7cabce28f2f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:57.387070 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 790/1574] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:03:57 2021] PUT /identity/v3/projects/bc4d86610439462da3118196491824bf/users/a014f91d57864863a095f4f69c1fea4b/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:03:57.391565 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc57d8-7e36-4870-a14f-c7cabce28f2f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:57.404477 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 785/1575] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:03:57 2021] PUT /identity/v3/projects/aea44c7ec85e4429bdceee92e65821e1/users/f7891d083fc5468a860e26bf04253eb3/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:03:57.405619 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68ee3f-dc8f-40dc-9bf1-65dc84562818 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:57.520683 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc57d8-7e36-4870-a14f-c7cabce28f2f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:57.533908 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558eebc-971c-42a0-afbe-a90cd5e9f294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:57.535624 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558eebc-971c-42a0-afbe-a90cd5e9f294 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:57.537307 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558eebc-971c-42a0-afbe-a90cd5e9f294 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:57.537797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558eebc-971c-42a0-afbe-a90cd5e9f294 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:57.538552 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558eebc-971c-42a0-afbe-a90cd5e9f294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:57.541900 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68ee3f-dc8f-40dc-9bf1-65dc84562818 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:57.544739 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558eebc-971c-42a0-afbe-a90cd5e9f294 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:57.553170 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753be2a-6ce6-4b71-8986-da2d614e9f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:57.554850 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753be2a-6ce6-4b71-8986-da2d614e9f13 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:57.555145 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753be2a-6ce6-4b71-8986-da2d614e9f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:57.555449 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753be2a-6ce6-4b71-8986-da2d614e9f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:57.558360 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753be2a-6ce6-4b71-8986-da2d614e9f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:57.563698 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753be2a-6ce6-4b71-8986-da2d614e9f13 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:57.565484 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 791/1576] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:57 2021] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:57.570260 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558eebc-971c-42a0-afbe-a90cd5e9f294 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:57.592715 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 786/1577] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:03:57 2021] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:03:57.594979 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753be2a-6ce6-4b71-8986-da2d614e9f13 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:57.596451 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558eebc-971c-42a0-afbe-a90cd5e9f294 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:57.608150 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261a869-de76-4439-9c97-da0bfae2501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:57.609046 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261a869-de76-4439-9c97-da0bfae2501d admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:57.609333 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261a869-de76-4439-9c97-da0bfae2501d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:57.610732 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261a869-de76-4439-9c97-da0bfae2501d admin admin] PATH_INFO: `/v3/projects/bc4d86610439462da3118196491824bf/users/a014f91d57864863a095f4f69c1fea4b/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:57.615654 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261a869-de76-4439-9c97-da0bfae2501d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc4d86610439462da3118196491824bf, user_id=a014f91d57864863a095f4f69c1fea4b, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:57.616224 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753be2a-6ce6-4b71-8986-da2d614e9f13 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:57.621235 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261a869-de76-4439-9c97-da0bfae2501d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:57.627386 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5b5de-9fd8-46f6-a4ff-a76ef65cae70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:57.629355 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5b5de-9fd8-46f6-a4ff-a76ef65cae70 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:57.630637 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5b5de-9fd8-46f6-a4ff-a76ef65cae70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:57.630637 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5b5de-9fd8-46f6-a4ff-a76ef65cae70 admin admin] PATH_INFO: `/v3/projects/aea44c7ec85e4429bdceee92e65821e1/users/f7891d083fc5468a860e26bf04253eb3/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:57.635602 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5b5de-9fd8-46f6-a4ff-a76ef65cae70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea44c7ec85e4429bdceee92e65821e1, user_id=f7891d083fc5468a860e26bf04253eb3, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:57.641098 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5b5de-9fd8-46f6-a4ff-a76ef65cae70 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:57.659783 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 792/1578] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:03:57 2021] PUT /identity/v3/projects/bc4d86610439462da3118196491824bf/users/a014f91d57864863a095f4f69c1fea4b/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:03:57.661444 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdf1ea-35a5-4d2c-9d3a-2fc6dbe76dd1 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:57.661708 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdf1ea-35a5-4d2c-9d3a-2fc6dbe76dd1 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:57.661995 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdf1ea-35a5-4d2c-9d3a-2fc6dbe76dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:57.674336 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 787/1579] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:03:57 2021] PUT /identity/v3/projects/aea44c7ec85e4429bdceee92e65821e1/users/f7891d083fc5468a860e26bf04253eb3/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:03:57.685665 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95407faf-1f44-4ecd-b128-06b0eee611f0 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:57.686323 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95407faf-1f44-4ecd-b128-06b0eee611f0 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:57.686832 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95407faf-1f44-4ecd-b128-06b0eee611f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:57.747870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-cccdf1ea-35a5-4d2c-9d3a-2fc6dbe76dd1 None None] MFA Rules not processed for user `a014f91d57864863a095f4f69c1fea4b`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:57.749558 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-cccdf1ea-35a5-4d2c-9d3a-2fc6dbe76dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:57.750928 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-95407faf-1f44-4ecd-b128-06b0eee611f0 None None] MFA Rules not processed for user `f7891d083fc5468a860e26bf04253eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:57.752386 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-95407faf-1f44-4ecd-b128-06b0eee611f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:57.905712 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 788/1580] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:57 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:03:57.906936 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2ca89-616d-4d8e-b823-7833ee644eb2 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:57.907220 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2ca89-616d-4d8e-b823-7833ee644eb2 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:57.907531 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2ca89-616d-4d8e-b823-7833ee644eb2 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:57.909247 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 789/1581] 10.222.0.39 () {54 vars in 912 bytes} [Tue Aug 31 03:03:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:03:57.917392 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8f071-421c-4883-949e-ed4ce13c89ce None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:57.917682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8f071-421c-4883-949e-ed4ce13c89ce None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:57.917963 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8f071-421c-4883-949e-ed4ce13c89ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:57.935393 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 793/1582] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:57 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:57.936352 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdf1ea-35a5-4d2c-9d3a-2fc6dbe76dd1 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:57.937800 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-a1f8f071-421c-4883-949e-ed4ce13c89ce None None] MFA Rules not processed for user `a6bb852fc4394f88800ec9616cb65416`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:57.939625 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a1f8f071-421c-4883-949e-ed4ce13c89ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:58.013907 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdf1ea-35a5-4d2c-9d3a-2fc6dbe76dd1 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:58.018222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ff5bb-9312-4373-91b5-1a250f24c307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:58.018821 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ff5bb-9312-4373-91b5-1a250f24c307 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:58.018955 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ff5bb-9312-4373-91b5-1a250f24c307 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:58.019233 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ff5bb-9312-4373-91b5-1a250f24c307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:58.031219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ff5bb-9312-4373-91b5-1a250f24c307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:58.032862 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ff5bb-9312-4373-91b5-1a250f24c307 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:58.044496 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 794/1583] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:03:57 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:03:58.079858 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 790/1584] 10.222.0.39 () {58 vars in 1010 bytes} [Tue Aug 31 03:03:57 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:58.081220 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ff5bb-9312-4373-91b5-1a250f24c307 service cinder] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:58.108529 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8f071-421c-4883-949e-ed4ce13c89ce None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:58.127943 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8f071-421c-4883-949e-ed4ce13c89ce None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:58.139639 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cafb1-c4fa-41a4-848a-21b5bc05d8db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:58.141896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cafb1-c4fa-41a4-848a-21b5bc05d8db service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:58.142391 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cafb1-c4fa-41a4-848a-21b5bc05d8db service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:58.142681 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cafb1-c4fa-41a4-848a-21b5bc05d8db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:58.160097 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ff5bb-9312-4373-91b5-1a250f24c307 service cinder] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:58.167606 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cafb1-c4fa-41a4-848a-21b5bc05d8db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:58.167805 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90af4e7-358b-44a0-abf8-c72eaf88461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:58.168810 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90af4e7-358b-44a0-abf8-c72eaf88461b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:58.169096 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cafb1-c4fa-41a4-848a-21b5bc05d8db service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:58.169209 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90af4e7-358b-44a0-abf8-c72eaf88461b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:58.169637 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90af4e7-358b-44a0-abf8-c72eaf88461b admin admin] PATH_INFO: `/v3/users/9f64c6e3e57b4c46a78ad643f5aa2770` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:58.171412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90af4e7-358b-44a0-abf8-c72eaf88461b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f64c6e3e57b4c46a78ad643f5aa2770)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:58.173672 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90af4e7-358b-44a0-abf8-c72eaf88461b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:58.193274 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 791/1585] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:03:58 2021] GET /identity/v3/auth/tokens => generated 3490 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:03:58.251134 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a90af4e7-358b-44a0-abf8-c72eaf88461b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f64c6e3e57b4c46a78ad643f5aa2770'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:58.252046 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a90af4e7-358b-44a0-abf8-c72eaf88461b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f64c6e3e57b4c46a78ad643f5aa2770'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:58.253863 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a90af4e7-358b-44a0-abf8-c72eaf88461b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f64c6e3e57b4c46a78ad643f5aa2770'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:58.269403 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a90af4e7-358b-44a0-abf8-c72eaf88461b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f64c6e3e57b4c46a78ad643f5aa2770'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:58.279581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a90af4e7-358b-44a0-abf8-c72eaf88461b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f64c6e3e57b4c46a78ad643f5aa2770'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:58.297536 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 795/1586] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:03:58 2021] DELETE /identity/v3/users/9f64c6e3e57b4c46a78ad643f5aa2770 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:03:58.306007 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515463ad-1d0b-4075-aed9-5331875ee65e None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:58.306413 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515463ad-1d0b-4075-aed9-5331875ee65e None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:58.307209 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515463ad-1d0b-4075-aed9-5331875ee65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:58.349764 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-515463ad-1d0b-4075-aed9-5331875ee65e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:58.350986 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-515463ad-1d0b-4075-aed9-5331875ee65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:58.359015 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90af4e7-358b-44a0-abf8-c72eaf88461b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:58.360922 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a90af4e7-358b-44a0-abf8-c72eaf88461b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:58.526756 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90af4e7-358b-44a0-abf8-c72eaf88461b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:58.532971 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435da0e-8d10-42ab-9f3a-c927e77e7947 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:58.533913 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435da0e-8d10-42ab-9f3a-c927e77e7947 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:58.534356 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435da0e-8d10-42ab-9f3a-c927e77e7947 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:58.535300 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435da0e-8d10-42ab-9f3a-c927e77e7947 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:58.537410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d435da0e-8d10-42ab-9f3a-c927e77e7947 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:58.563278 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 792/1587] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:58.573559 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bc824-58ab-4b35-bb22-01ab52e63c2b None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:58.575585 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bc824-58ab-4b35-bb22-01ab52e63c2b None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:58.575876 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bc824-58ab-4b35-bb22-01ab52e63c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:58.646465 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-5f1bc824-58ab-4b35-bb22-01ab52e63c2b None None] MFA Rules not processed for user `999210c8bd9c4367869ebaf967556c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:58.649132 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-5f1bc824-58ab-4b35-bb22-01ab52e63c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:58.695479 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435da0e-8d10-42ab-9f3a-c927e77e7947 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:58.699128 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435da0e-8d10-42ab-9f3a-c927e77e7947 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:58.727167 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 796/1588] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:03:58 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:03:58.729586 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cdf8a-7195-4d14-90c5-8772de37fd43 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:58.729980 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cdf8a-7195-4d14-90c5-8772de37fd43 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:58.730362 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cdf8a-7195-4d14-90c5-8772de37fd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:58.797179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-232cdf8a-7195-4d14-90c5-8772de37fd43 None None] MFA Rules not processed for user `361eb264d0a147e9879a758807cd3eed`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:58.800569 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-232cdf8a-7195-4d14-90c5-8772de37fd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:58.811490 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 793/1589] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:58 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:58.819790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bc824-58ab-4b35-bb22-01ab52e63c2b None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:58.819790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-5f1bc824-58ab-4b35-bb22-01ab52e63c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:58.943586 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 797/1590] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:58 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:58.944922 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a92c09-0fd0-475a-9dff-23db61815824 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:58.945208 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a92c09-0fd0-475a-9dff-23db61815824 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:58.945548 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a92c09-0fd0-475a-9dff-23db61815824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:58.977018 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-88a92c09-0fd0-475a-9dff-23db61815824 None None] MFA Rules not processed for user `999210c8bd9c4367869ebaf967556c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:58.979285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-88a92c09-0fd0-475a-9dff-23db61815824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:58.988539 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 798/1591] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:58 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:58.991177 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f8c3b-ad94-4791-ac25-28953a9b870a None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:58.991647 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f8c3b-ad94-4791-ac25-28953a9b870a None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:58.992791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f8c3b-ad94-4791-ac25-28953a9b870a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:59.020220 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bc824-58ab-4b35-bb22-01ab52e63c2b None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:59.033206 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7eb994-4f97-4d59-beda-19d5175fd611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:59.033677 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7eb994-4f97-4d59-beda-19d5175fd611 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:59.033970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7eb994-4f97-4d59-beda-19d5175fd611 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:59.034267 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7eb994-4f97-4d59-beda-19d5175fd611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:59.038687 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-054f8c3b-ad94-4791-ac25-28953a9b870a None None] MFA Rules not processed for user `361eb264d0a147e9879a758807cd3eed`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:59.042359 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-054f8c3b-ad94-4791-ac25-28953a9b870a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:59.054579 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 799/1592] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:58 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:59.054579 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f8c3b-ad94-4791-ac25-28953a9b870a None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:59.057354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-054f8c3b-ad94-4791-ac25-28953a9b870a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:59.073854 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7eb994-4f97-4d59-beda-19d5175fd611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:59.075644 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7eb994-4f97-4d59-beda-19d5175fd611 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:59.096347 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f8c3b-ad94-4791-ac25-28953a9b870a None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:59.099891 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 794/1593] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:03:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:03:59.101294 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7eb994-4f97-4d59-beda-19d5175fd611 service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:59.104644 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-3b7eb994-4f97-4d59-beda-19d5175fd611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:59.123219 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7eb994-4f97-4d59-beda-19d5175fd611 service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:59.124842 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1e94e-3a3e-4389-b197-a0ce57c92cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:59.125742 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1e94e-3a3e-4389-b197-a0ce57c92cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:59.126027 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1e94e-3a3e-4389-b197-a0ce57c92cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:59.128958 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1e94e-3a3e-4389-b197-a0ce57c92cd7 admin admin] PATH_INFO: `/v3/users/1e51a415f33f48eb9242beea431d6d28` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:59.130962 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986538b6-d0de-43de-be26-d47cee544f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:59.131760 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986538b6-d0de-43de-be26-d47cee544f05 service nova] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:59.132512 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1e94e-3a3e-4389-b197-a0ce57c92cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e51a415f33f48eb9242beea431d6d28)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:59.132651 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986538b6-d0de-43de-be26-d47cee544f05 service nova] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:59.132651 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986538b6-d0de-43de-be26-d47cee544f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:59.138892 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1e94e-3a3e-4389-b197-a0ce57c92cd7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:59.143196 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986538b6-d0de-43de-be26-d47cee544f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:59.145484 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986538b6-d0de-43de-be26-d47cee544f05 service nova] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:59.158708 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 795/1594] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:03:59 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:03:59.159917 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986538b6-d0de-43de-be26-d47cee544f05 service nova] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:59.161584 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-986538b6-d0de-43de-be26-d47cee544f05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:59.179850 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986538b6-d0de-43de-be26-d47cee544f05 service nova] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:59.186472 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c91395-5fdd-4aff-9271-266568d329c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:59.187809 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c91395-5fdd-4aff-9271-266568d329c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:59.188011 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c91395-5fdd-4aff-9271-266568d329c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:59.195143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c91395-5fdd-4aff-9271-266568d329c2 admin admin] PATH_INFO: `/v3/users/db4b7bebbd9149d8bd4482e255cbbb7e` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:59.197426 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c91395-5fdd-4aff-9271-266568d329c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db4b7bebbd9149d8bd4482e255cbbb7e)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:59.198684 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: WARNING py.warnings [None req-f0c91395-5fdd-4aff-9271-266568d329c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 03:03:59.198684 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: warnings.warn(msg) Aug 31 03:03:59.198684 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: Aug 31 03:03:59.200684 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c91395-5fdd-4aff-9271-266568d329c2 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:59.295293 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-06e1e94e-3a3e-4389-b197-a0ce57c92cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e51a415f33f48eb9242beea431d6d28'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:59.299884 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-06e1e94e-3a3e-4389-b197-a0ce57c92cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e51a415f33f48eb9242beea431d6d28'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:59.300637 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-06e1e94e-3a3e-4389-b197-a0ce57c92cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e51a415f33f48eb9242beea431d6d28'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:59.317144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-f0c91395-5fdd-4aff-9271-266568d329c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db4b7bebbd9149d8bd4482e255cbbb7e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:59.332593 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-06e1e94e-3a3e-4389-b197-a0ce57c92cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e51a415f33f48eb9242beea431d6d28'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:59.350189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-06e1e94e-3a3e-4389-b197-a0ce57c92cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e51a415f33f48eb9242beea431d6d28'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:59.361097 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-f0c91395-5fdd-4aff-9271-266568d329c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db4b7bebbd9149d8bd4482e255cbbb7e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:59.361872 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-f0c91395-5fdd-4aff-9271-266568d329c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db4b7bebbd9149d8bd4482e255cbbb7e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:59.371853 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 800/1595] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:03:59 2021] DELETE /identity/v3/users/1e51a415f33f48eb9242beea431d6d28 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:03:59.376407 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1e94e-3a3e-4389-b197-a0ce57c92cd7 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:59.384086 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-f0c91395-5fdd-4aff-9271-266568d329c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db4b7bebbd9149d8bd4482e255cbbb7e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:59.393941 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-06e1e94e-3a3e-4389-b197-a0ce57c92cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:59.398944 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-f0c91395-5fdd-4aff-9271-266568d329c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db4b7bebbd9149d8bd4482e255cbbb7e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:59.445663 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 796/1596] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:03:59 2021] DELETE /identity/v3/users/db4b7bebbd9149d8bd4482e255cbbb7e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:03:59.445663 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3e8a0-75bb-4665-ade2-78a7b01b41db None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:59.445663 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3e8a0-75bb-4665-ade2-78a7b01b41db None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:59.445663 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3e8a0-75bb-4665-ade2-78a7b01b41db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:59.495790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-98b3e8a0-75bb-4665-ade2-78a7b01b41db None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:59.504029 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1e94e-3a3e-4389-b197-a0ce57c92cd7 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:59.504463 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-98b3e8a0-75bb-4665-ade2-78a7b01b41db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:59.605534 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 797/1597] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:59.608946 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febaa84d-7456-44de-aaae-8e4bcf31e5dc None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:59.608946 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febaa84d-7456-44de-aaae-8e4bcf31e5dc None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:59.608946 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febaa84d-7456-44de-aaae-8e4bcf31e5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:59.618030 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924edd9-5ef2-4bf5-87b6-3dac39dc0273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:59.618740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924edd9-5ef2-4bf5-87b6-3dac39dc0273 service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:59.619243 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924edd9-5ef2-4bf5-87b6-3dac39dc0273 service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:59.619556 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924edd9-5ef2-4bf5-87b6-3dac39dc0273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:59.623738 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-9924edd9-5ef2-4bf5-87b6-3dac39dc0273 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:59.639456 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-febaa84d-7456-44de-aaae-8e4bcf31e5dc None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:03:59.652363 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-febaa84d-7456-44de-aaae-8e4bcf31e5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:59.667344 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 798/1598] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:03:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:03:59.668740 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febaa84d-7456-44de-aaae-8e4bcf31e5dc None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:59.670349 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-febaa84d-7456-44de-aaae-8e4bcf31e5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:59.687663 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febaa84d-7456-44de-aaae-8e4bcf31e5dc None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:59.701250 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d72dd5-0c8a-4bcf-ad2e-08d12ef2ba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:59.702437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d72dd5-0c8a-4bcf-ad2e-08d12ef2ba5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:59.702967 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d72dd5-0c8a-4bcf-ad2e-08d12ef2ba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:59.703236 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d72dd5-0c8a-4bcf-ad2e-08d12ef2ba5c admin admin] PATH_INFO: `/v3/projects/2c86e34615414b2ca54ee3779044ffe6` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:59.707311 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d72dd5-0c8a-4bcf-ad2e-08d12ef2ba5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c86e34615414b2ca54ee3779044ffe6)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:59.711451 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d72dd5-0c8a-4bcf-ad2e-08d12ef2ba5c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:59.727982 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924edd9-5ef2-4bf5-87b6-3dac39dc0273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:03:59.731938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924edd9-5ef2-4bf5-87b6-3dac39dc0273 service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:03:59.748409 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 801/1599] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:03:59 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:03:59.750333 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924edd9-5ef2-4bf5-87b6-3dac39dc0273 service nova] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:59.752254 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-9924edd9-5ef2-4bf5-87b6-3dac39dc0273 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:59.781419 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-61d72dd5-0c8a-4bcf-ad2e-08d12ef2ba5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c86e34615414b2ca54ee3779044ffe6', 'request_id': 'req-61d72dd5-0c8a-4bcf-ad2e-08d12ef2ba5c'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:59.788217 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-61d72dd5-0c8a-4bcf-ad2e-08d12ef2ba5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c86e34615414b2ca54ee3779044ffe6', 'request_id': 'req-61d72dd5-0c8a-4bcf-ad2e-08d12ef2ba5c'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:59.801802 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-61d72dd5-0c8a-4bcf-ad2e-08d12ef2ba5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c86e34615414b2ca54ee3779044ffe6', 'request_id': 'req-61d72dd5-0c8a-4bcf-ad2e-08d12ef2ba5c'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:59.819551 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-61d72dd5-0c8a-4bcf-ad2e-08d12ef2ba5c admin admin] The token cache is being invalidate because project 2c86e34615414b2ca54ee3779044ffe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:03:59.819900 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-61d72dd5-0c8a-4bcf-ad2e-08d12ef2ba5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:59.820684 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-61d72dd5-0c8a-4bcf-ad2e-08d12ef2ba5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:03:59.825874 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 799/1600] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:03:59 2021] DELETE /identity/v3/projects/2c86e34615414b2ca54ee3779044ffe6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:03:59.826851 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d72dd5-0c8a-4bcf-ad2e-08d12ef2ba5c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:03:59.829806 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-61d72dd5-0c8a-4bcf-ad2e-08d12ef2ba5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:59.865228 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924edd9-5ef2-4bf5-87b6-3dac39dc0273 service nova] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:59.925751 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d72dd5-0c8a-4bcf-ad2e-08d12ef2ba5c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:03:59.941820 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b007d8-165b-45d1-b1c9-2be4ee6c4c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:59.942902 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b007d8-165b-45d1-b1c9-2be4ee6c4c03 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:59.943254 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b007d8-165b-45d1-b1c9-2be4ee6c4c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:59.943978 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b007d8-165b-45d1-b1c9-2be4ee6c4c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:59.946115 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b3b007d8-165b-45d1-b1c9-2be4ee6c4c03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:03:59.948251 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b8c5d-b135-437a-b9c0-b52515a63bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:03:59.948929 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b8c5d-b135-437a-b9c0-b52515a63bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:03:59.949209 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b8c5d-b135-437a-b9c0-b52515a63bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:03:59.949482 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b8c5d-b135-437a-b9c0-b52515a63bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:03:59.955387 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ee1b8c5d-b135-437a-b9c0-b52515a63bc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:00.030305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b007d8-165b-45d1-b1c9-2be4ee6c4c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:00.032493 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b007d8-165b-45d1-b1c9-2be4ee6c4c03 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:00.047733 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 802/1601] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:03:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:00.048728 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b007d8-165b-45d1-b1c9-2be4ee6c4c03 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:00.050546 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b3b007d8-165b-45d1-b1c9-2be4ee6c4c03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:00.066616 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b007d8-165b-45d1-b1c9-2be4ee6c4c03 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:00.074522 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e087d4-cc5b-4915-b570-d6153c27d578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:00.075845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e087d4-cc5b-4915-b570-d6153c27d578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:00.076238 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e087d4-cc5b-4915-b570-d6153c27d578 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:00.076696 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e087d4-cc5b-4915-b570-d6153c27d578 admin admin] PATH_INFO: `/v3/users/f7891d083fc5468a860e26bf04253eb3` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:00.078594 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e087d4-cc5b-4915-b570-d6153c27d578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7891d083fc5468a860e26bf04253eb3)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:00.081146 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e087d4-cc5b-4915-b570-d6153c27d578 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:00.098142 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b8c5d-b135-437a-b9c0-b52515a63bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:00.100774 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b8c5d-b135-437a-b9c0-b52515a63bc4 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:00.129238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 800/1602] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:03:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:00.137929 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b1f9f-6dbe-45b1-9d48-a38dff444401 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:00.138307 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b1f9f-6dbe-45b1-9d48-a38dff444401 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:00.138595 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b1f9f-6dbe-45b1-9d48-a38dff444401 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:00.140497 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 801/1603] 10.222.0.39 () {54 vars in 912 bytes} [Tue Aug 31 03:04:00 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:04:00.146430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e9cd7-30b6-428c-97de-ed29141616a8 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:00.146716 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e9cd7-30b6-428c-97de-ed29141616a8 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:00.146997 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e9cd7-30b6-428c-97de-ed29141616a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:00.149357 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-57e087d4-cc5b-4915-b570-d6153c27d578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7891d083fc5468a860e26bf04253eb3'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:00.154544 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-57e087d4-cc5b-4915-b570-d6153c27d578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7891d083fc5468a860e26bf04253eb3'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:00.155641 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-57e087d4-cc5b-4915-b570-d6153c27d578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7891d083fc5468a860e26bf04253eb3'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:00.202024 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-57e087d4-cc5b-4915-b570-d6153c27d578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7891d083fc5468a860e26bf04253eb3'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:00.214730 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-57e087d4-cc5b-4915-b570-d6153c27d578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7891d083fc5468a860e26bf04253eb3'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:00.224264 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-440e9cd7-30b6-428c-97de-ed29141616a8 None None] MFA Rules not processed for user `18b73b8e7244410b8f701b2ab43c5979`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:00.225501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-440e9cd7-30b6-428c-97de-ed29141616a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:00.242754 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 802/1604] 10.222.0.39 () {58 vars in 1010 bytes} [Tue Aug 31 03:04:00 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:04:00.246153 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 803/1605] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:04:00 2021] DELETE /identity/v3/users/f7891d083fc5468a860e26bf04253eb3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:00.268450 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e9cd7-30b6-428c-97de-ed29141616a8 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:00.270851 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-440e9cd7-30b6-428c-97de-ed29141616a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:00.296461 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e9cd7-30b6-428c-97de-ed29141616a8 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:00.408733 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c7aa7-5e2b-4d78-b9dc-8733ed03a7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:00.409478 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c7aa7-5e2b-4d78-b9dc-8733ed03a7af service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:00.409826 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c7aa7-5e2b-4d78-b9dc-8733ed03a7af service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:00.410106 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c7aa7-5e2b-4d78-b9dc-8733ed03a7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:00.428824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c7aa7-5e2b-4d78-b9dc-8733ed03a7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:00.430810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c7aa7-5e2b-4d78-b9dc-8733ed03a7af service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:00.456939 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 803/1606] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:00 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:00.608875 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a22fe-98d8-480f-ab81-45ff3a559480 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:00.609149 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a22fe-98d8-480f-ab81-45ff3a559480 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:00.610323 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a22fe-98d8-480f-ab81-45ff3a559480 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:00.613314 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 804/1607] 10.222.0.39 () {54 vars in 912 bytes} [Tue Aug 31 03:04:00 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:04:00.623739 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5afd1-2834-4296-b7ed-55174703ca78 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:00.623940 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5afd1-2834-4296-b7ed-55174703ca78 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:00.624211 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5afd1-2834-4296-b7ed-55174703ca78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:00.666405 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-20b5afd1-2834-4296-b7ed-55174703ca78 None None] MFA Rules not processed for user `18b73b8e7244410b8f701b2ab43c5979`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:00.669592 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-20b5afd1-2834-4296-b7ed-55174703ca78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:00.705311 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 804/1608] 10.222.0.39 () {58 vars in 1010 bytes} [Tue Aug 31 03:04:00 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:00.742318 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a22fe-98d8-480f-ab81-45ff3a559480 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:00.744905 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-fc6a22fe-98d8-480f-ab81-45ff3a559480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:00.773624 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a22fe-98d8-480f-ab81-45ff3a559480 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:00.778913 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e113491-4a89-4808-9d87-c03ac3aa6f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:00.845038 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e113491-4a89-4808-9d87-c03ac3aa6f26 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:00.848233 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e113491-4a89-4808-9d87-c03ac3aa6f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:00.848704 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e113491-4a89-4808-9d87-c03ac3aa6f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:00.877318 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5afd1-2834-4296-b7ed-55174703ca78 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:00.879920 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-20b5afd1-2834-4296-b7ed-55174703ca78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:00.890069 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e113491-4a89-4808-9d87-c03ac3aa6f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:00.904101 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e113491-4a89-4808-9d87-c03ac3aa6f26 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:00.926424 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 805/1609] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:00 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:01.024071 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5afd1-2834-4296-b7ed-55174703ca78 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:01.040330 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c4598-ee1a-4e5b-8459-cb8e9152115c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:01.041284 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c4598-ee1a-4e5b-8459-cb8e9152115c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:01.041766 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c4598-ee1a-4e5b-8459-cb8e9152115c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:01.042112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c4598-ee1a-4e5b-8459-cb8e9152115c admin admin] PATH_INFO: `/v3/projects/d2c271fd1a554e1ab67a94b3ccbc791c` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:01.044054 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c4598-ee1a-4e5b-8459-cb8e9152115c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c271fd1a554e1ab67a94b3ccbc791c)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:01.047218 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c4598-ee1a-4e5b-8459-cb8e9152115c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:01.137899 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4f9c4598-ee1a-4e5b-8459-cb8e9152115c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c271fd1a554e1ab67a94b3ccbc791c', 'request_id': 'req-4f9c4598-ee1a-4e5b-8459-cb8e9152115c'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:01.144327 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4f9c4598-ee1a-4e5b-8459-cb8e9152115c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c271fd1a554e1ab67a94b3ccbc791c', 'request_id': 'req-4f9c4598-ee1a-4e5b-8459-cb8e9152115c'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:01.160556 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4f9c4598-ee1a-4e5b-8459-cb8e9152115c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c271fd1a554e1ab67a94b3ccbc791c', 'request_id': 'req-4f9c4598-ee1a-4e5b-8459-cb8e9152115c'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:01.178773 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4f9c4598-ee1a-4e5b-8459-cb8e9152115c admin admin] The token cache is being invalidate because project d2c271fd1a554e1ab67a94b3ccbc791c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:04:01.179106 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4f9c4598-ee1a-4e5b-8459-cb8e9152115c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:01.179884 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4f9c4598-ee1a-4e5b-8459-cb8e9152115c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:01.181959 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 805/1610] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:04:00 2021] DELETE /identity/v3/projects/d2c271fd1a554e1ab67a94b3ccbc791c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:04:01.186818 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e113491-4a89-4808-9d87-c03ac3aa6f26 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:01.212070 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e113491-4a89-4808-9d87-c03ac3aa6f26 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:01.359382 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828a700-b35a-4156-8975-319c2a620ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:01.361458 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828a700-b35a-4156-8975-319c2a620ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:01.361948 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828a700-b35a-4156-8975-319c2a620ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:01.362420 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828a700-b35a-4156-8975-319c2a620ea0 admin admin] PATH_INFO: `/v3/users/a014f91d57864863a095f4f69c1fea4b` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:01.364436 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828a700-b35a-4156-8975-319c2a620ea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a014f91d57864863a095f4f69c1fea4b)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:01.367050 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828a700-b35a-4156-8975-319c2a620ea0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:01.458245 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c4598-ee1a-4e5b-8459-cb8e9152115c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:01.460050 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-4f9c4598-ee1a-4e5b-8459-cb8e9152115c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:01.554366 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b828a700-b35a-4156-8975-319c2a620ea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a014f91d57864863a095f4f69c1fea4b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:01.554991 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b828a700-b35a-4156-8975-319c2a620ea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a014f91d57864863a095f4f69c1fea4b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:01.555635 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b828a700-b35a-4156-8975-319c2a620ea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a014f91d57864863a095f4f69c1fea4b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:01.592484 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b828a700-b35a-4156-8975-319c2a620ea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a014f91d57864863a095f4f69c1fea4b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:01.609158 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b828a700-b35a-4156-8975-319c2a620ea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a014f91d57864863a095f4f69c1fea4b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:01.663407 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 806/1611] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:04:01 2021] DELETE /identity/v3/users/a014f91d57864863a095f4f69c1fea4b => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:01.669222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828a700-b35a-4156-8975-319c2a620ea0 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:01.672551 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b828a700-b35a-4156-8975-319c2a620ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:01.766720 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c4598-ee1a-4e5b-8459-cb8e9152115c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:01.926932 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828a700-b35a-4156-8975-319c2a620ea0 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:01.946231 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64477cfc-81c4-40f6-aae2-6426c8455f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:01.947244 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64477cfc-81c4-40f6-aae2-6426c8455f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:01.947728 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64477cfc-81c4-40f6-aae2-6426c8455f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:01.948045 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64477cfc-81c4-40f6-aae2-6426c8455f4c admin admin] PATH_INFO: `/v3/projects/65e123f49a16418eb59bd353c6ab19b9` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:01.949391 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64477cfc-81c4-40f6-aae2-6426c8455f4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e123f49a16418eb59bd353c6ab19b9)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:01.950560 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: WARNING py.warnings [None req-64477cfc-81c4-40f6-aae2-6426c8455f4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 03:04:01.950560 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: warnings.warn(msg) Aug 31 03:04:01.950560 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: Aug 31 03:04:01.951897 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64477cfc-81c4-40f6-aae2-6426c8455f4c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:02.059880 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4678fa-84ef-4f3a-8bf6-8033906a6da7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcf0359f8bc4f55be3307f235f8aac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:02.060565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4678fa-84ef-4f3a-8bf6-8033906a6da7 service placement] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:02.060847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4678fa-84ef-4f3a-8bf6-8033906a6da7 service placement] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:02.061124 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4678fa-84ef-4f3a-8bf6-8033906a6da7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:02.090519 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-db4678fa-84ef-4f3a-8bf6-8033906a6da7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:02.137973 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4678fa-84ef-4f3a-8bf6-8033906a6da7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:02.140500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-64477cfc-81c4-40f6-aae2-6426c8455f4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e123f49a16418eb59bd353c6ab19b9', 'request_id': 'req-64477cfc-81c4-40f6-aae2-6426c8455f4c'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:02.141057 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4678fa-84ef-4f3a-8bf6-8033906a6da7 service placement] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:02.184035 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 806/1612] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:01 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 726 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:04:02.186228 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-64477cfc-81c4-40f6-aae2-6426c8455f4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e123f49a16418eb59bd353c6ab19b9', 'request_id': 'req-64477cfc-81c4-40f6-aae2-6426c8455f4c'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:02.209959 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-64477cfc-81c4-40f6-aae2-6426c8455f4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e123f49a16418eb59bd353c6ab19b9', 'request_id': 'req-64477cfc-81c4-40f6-aae2-6426c8455f4c'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:02.237281 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-64477cfc-81c4-40f6-aae2-6426c8455f4c admin admin] The token cache is being invalidate because project 65e123f49a16418eb59bd353c6ab19b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:04:02.237583 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-64477cfc-81c4-40f6-aae2-6426c8455f4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:02.239414 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-64477cfc-81c4-40f6-aae2-6426c8455f4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:02.241486 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 807/1613] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:04:01 2021] DELETE /identity/v3/projects/65e123f49a16418eb59bd353c6ab19b9 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:02.249226 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198e0d4-7706-4252-b2ea-04c667c14f9e None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:02.249517 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198e0d4-7706-4252-b2ea-04c667c14f9e None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:02.249796 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198e0d4-7706-4252-b2ea-04c667c14f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:02.297120 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-a198e0d4-7706-4252-b2ea-04c667c14f9e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:02.298857 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a198e0d4-7706-4252-b2ea-04c667c14f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:02.405444 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 807/1614] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:02.406521 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cb22b-c572-40d8-b35c-b556f97c1cba None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:02.406819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cb22b-c572-40d8-b35c-b556f97c1cba None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:02.407100 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cb22b-c572-40d8-b35c-b556f97c1cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:02.442585 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-747cb22b-c572-40d8-b35c-b556f97c1cba None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:02.443780 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-747cb22b-c572-40d8-b35c-b556f97c1cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:02.465567 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 808/1615] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:04:02.469916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198e0d4-7706-4252-b2ea-04c667c14f9e None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:02.481071 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198e0d4-7706-4252-b2ea-04c667c14f9e None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:02.487270 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df47c3e-8c92-4229-9d50-dcd01f6e2555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:02.488786 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df47c3e-8c92-4229-9d50-dcd01f6e2555 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:02.489526 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df47c3e-8c92-4229-9d50-dcd01f6e2555 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:02.489896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df47c3e-8c92-4229-9d50-dcd01f6e2555 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:02.491671 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df47c3e-8c92-4229-9d50-dcd01f6e2555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:04:02.491981 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df47c3e-8c92-4229-9d50-dcd01f6e2555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:02.494336 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df47c3e-8c92-4229-9d50-dcd01f6e2555 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:02.510581 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 808/1616] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:04:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:04:02.512170 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cb22b-c572-40d8-b35c-b556f97c1cba None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:02.522181 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cb22b-c572-40d8-b35c-b556f97c1cba None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:02.529736 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fba051-35d5-4c58-8b7f-6791129f99fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:02.530392 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fba051-35d5-4c58-8b7f-6791129f99fe admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:02.530851 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fba051-35d5-4c58-8b7f-6791129f99fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:02.531133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fba051-35d5-4c58-8b7f-6791129f99fe admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:02.532254 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fba051-35d5-4c58-8b7f-6791129f99fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:02.534360 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fba051-35d5-4c58-8b7f-6791129f99fe admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:02.585679 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df47c3e-8c92-4229-9d50-dcd01f6e2555 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:02.591077 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 809/1617] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:04:02 2021] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:02.596759 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df47c3e-8c92-4229-9d50-dcd01f6e2555 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:02.716302 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae31d4-a13d-4472-8508-322ad4293c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:02.717166 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae31d4-a13d-4472-8508-322ad4293c31 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:02.719471 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae31d4-a13d-4472-8508-322ad4293c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:02.719471 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae31d4-a13d-4472-8508-322ad4293c31 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:02.719471 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae31d4-a13d-4472-8508-322ad4293c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:02.724870 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae31d4-a13d-4472-8508-322ad4293c31 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:02.777279 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 809/1618] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:04:02 2021] POST /identity/v3/users => generated 286 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:02.782769 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fba051-35d5-4c58-8b7f-6791129f99fe admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:02.799778 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fba051-35d5-4c58-8b7f-6791129f99fe admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:02.813260 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535b38b-5dbc-4d3f-90fd-a0a04668899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:02.813911 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535b38b-5dbc-4d3f-90fd-a0a04668899a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:02.814501 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535b38b-5dbc-4d3f-90fd-a0a04668899a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:02.814773 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535b38b-5dbc-4d3f-90fd-a0a04668899a admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:02.815725 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535b38b-5dbc-4d3f-90fd-a0a04668899a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:02.817503 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535b38b-5dbc-4d3f-90fd-a0a04668899a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:02.841441 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 810/1619] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:02 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:02.847167 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae31d4-a13d-4472-8508-322ad4293c31 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:02.860421 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae31d4-a13d-4472-8508-322ad4293c31 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:02.869662 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096c487-e9d8-43f9-870d-977a7dc8b7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:02.872646 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096c487-e9d8-43f9-870d-977a7dc8b7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:02.873327 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096c487-e9d8-43f9-870d-977a7dc8b7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:02.873678 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096c487-e9d8-43f9-870d-977a7dc8b7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:02.875789 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096c487-e9d8-43f9-870d-977a7dc8b7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:02.878736 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096c487-e9d8-43f9-870d-977a7dc8b7f9 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:02.896952 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 810/1620] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:02 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:02.898327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535b38b-5dbc-4d3f-90fd-a0a04668899a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:02.918193 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535b38b-5dbc-4d3f-90fd-a0a04668899a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:02.936092 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade04e0-acbf-42a0-9e2a-653ff8c0df8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:02.937088 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade04e0-acbf-42a0-9e2a-653ff8c0df8b admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:02.939222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade04e0-acbf-42a0-9e2a-653ff8c0df8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:02.939531 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade04e0-acbf-42a0-9e2a-653ff8c0df8b admin admin] PATH_INFO: `/v3/projects/b2b3016f8355426cb17e1fc15a937b82/users/a69a754edcbb415f81ffd2777af46e2e/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:02.961571 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096c487-e9d8-43f9-870d-977a7dc8b7f9 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:02.966129 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-2096c487-e9d8-43f9-870d-977a7dc8b7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:02.975429 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade04e0-acbf-42a0-9e2a-653ff8c0df8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b3016f8355426cb17e1fc15a937b82, user_id=a69a754edcbb415f81ffd2777af46e2e, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:02.981673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade04e0-acbf-42a0-9e2a-653ff8c0df8b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:03.012313 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 811/1621] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:02 2021] PUT /identity/v3/projects/b2b3016f8355426cb17e1fc15a937b82/users/a69a754edcbb415f81ffd2777af46e2e/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:03.021466 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096c487-e9d8-43f9-870d-977a7dc8b7f9 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:03.022797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046e953-b0ce-464a-bf38-38a39403a1a7 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:03.023094 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046e953-b0ce-464a-bf38-38a39403a1a7 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:03.023396 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046e953-b0ce-464a-bf38-38a39403a1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:03.102247 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-1046e953-b0ce-464a-bf38-38a39403a1a7 None None] MFA Rules not processed for user `a69a754edcbb415f81ffd2777af46e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:03.106032 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1046e953-b0ce-464a-bf38-38a39403a1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:03.242567 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745e8b6-3bfa-4ba3-b967-742eafaad6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:03.246676 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745e8b6-3bfa-4ba3-b967-742eafaad6ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:03.246966 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745e8b6-3bfa-4ba3-b967-742eafaad6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:03.247252 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745e8b6-3bfa-4ba3-b967-742eafaad6ef admin admin] PATH_INFO: `/v3/projects/bc4d86610439462da3118196491824bf` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:03.248807 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745e8b6-3bfa-4ba3-b967-742eafaad6ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc4d86610439462da3118196491824bf)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:03.250764 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745e8b6-3bfa-4ba3-b967-742eafaad6ef admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:03.250935 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 812/1622] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:03 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:04:03.252409 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046e953-b0ce-464a-bf38-38a39403a1a7 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:03.254928 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1046e953-b0ce-464a-bf38-38a39403a1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:03.273708 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046e953-b0ce-464a-bf38-38a39403a1a7 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:03.281349 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a3495-3685-447e-bdfd-8802801a7846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:03.283458 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a3495-3685-447e-bdfd-8802801a7846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:03.287169 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a3495-3685-447e-bdfd-8802801a7846 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:03.287868 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a3495-3685-447e-bdfd-8802801a7846 admin admin] PATH_INFO: `/v3/projects/aea44c7ec85e4429bdceee92e65821e1` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:03.291900 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a3495-3685-447e-bdfd-8802801a7846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea44c7ec85e4429bdceee92e65821e1)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:03.295329 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a3495-3685-447e-bdfd-8802801a7846 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:03.376445 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2745e8b6-3bfa-4ba3-b967-742eafaad6ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc4d86610439462da3118196491824bf', 'request_id': 'req-2745e8b6-3bfa-4ba3-b967-742eafaad6ef'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:03.382711 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2745e8b6-3bfa-4ba3-b967-742eafaad6ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc4d86610439462da3118196491824bf', 'request_id': 'req-2745e8b6-3bfa-4ba3-b967-742eafaad6ef'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:03.401808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2745e8b6-3bfa-4ba3-b967-742eafaad6ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc4d86610439462da3118196491824bf', 'request_id': 'req-2745e8b6-3bfa-4ba3-b967-742eafaad6ef'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:03.431979 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2745e8b6-3bfa-4ba3-b967-742eafaad6ef admin admin] The token cache is being invalidate because project bc4d86610439462da3118196491824bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:04:03.432282 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2745e8b6-3bfa-4ba3-b967-742eafaad6ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:03.434152 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2745e8b6-3bfa-4ba3-b967-742eafaad6ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:03.440106 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 811/1623] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:04:02 2021] DELETE /identity/v3/projects/bc4d86610439462da3118196491824bf => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:04:03.440655 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a90a3495-3685-447e-bdfd-8802801a7846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea44c7ec85e4429bdceee92e65821e1', 'request_id': 'req-a90a3495-3685-447e-bdfd-8802801a7846'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:03.441351 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745e8b6-3bfa-4ba3-b967-742eafaad6ef admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:03.449796 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-2745e8b6-3bfa-4ba3-b967-742eafaad6ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:03.457211 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a90a3495-3685-447e-bdfd-8802801a7846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea44c7ec85e4429bdceee92e65821e1', 'request_id': 'req-a90a3495-3685-447e-bdfd-8802801a7846'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:03.482827 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a90a3495-3685-447e-bdfd-8802801a7846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea44c7ec85e4429bdceee92e65821e1', 'request_id': 'req-a90a3495-3685-447e-bdfd-8802801a7846'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:03.501821 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a90a3495-3685-447e-bdfd-8802801a7846 admin admin] The token cache is being invalidate because project aea44c7ec85e4429bdceee92e65821e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:04:03.502285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a90a3495-3685-447e-bdfd-8802801a7846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:03.503806 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a90a3495-3685-447e-bdfd-8802801a7846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:03.506086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 813/1624] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:04:03 2021] DELETE /identity/v3/projects/aea44c7ec85e4429bdceee92e65821e1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:03.506903 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a3495-3685-447e-bdfd-8802801a7846 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:03.509078 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a90a3495-3685-447e-bdfd-8802801a7846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:03.572250 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745e8b6-3bfa-4ba3-b967-742eafaad6ef admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:03.626756 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a3495-3685-447e-bdfd-8802801a7846 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:03.634264 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fea3fb-e146-4eea-b969-aa17f322e429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:03.634990 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fea3fb-e146-4eea-b969-aa17f322e429 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:03.635326 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fea3fb-e146-4eea-b969-aa17f322e429 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:03.635651 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fea3fb-e146-4eea-b969-aa17f322e429 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:03.637177 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fea3fb-e146-4eea-b969-aa17f322e429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:03.639323 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fea3fb-e146-4eea-b969-aa17f322e429 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:03.690270 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b264533-5e8f-4e16-99e5-d7554611e405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:03.692483 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b264533-5e8f-4e16-99e5-d7554611e405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:03.693101 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b264533-5e8f-4e16-99e5-d7554611e405 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:03.693526 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b264533-5e8f-4e16-99e5-d7554611e405 admin admin] PATH_INFO: `/v3/users/1d482b6ca72b463c9f47b651294b5a75` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:03.697708 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b264533-5e8f-4e16-99e5-d7554611e405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d482b6ca72b463c9f47b651294b5a75)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:03.698218 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 814/1625] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:04:03 2021] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:03.699965 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b264533-5e8f-4e16-99e5-d7554611e405 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:03.701103 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca2a5f-9aa0-4da4-b85f-6b5b3816b1ee None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:03.703827 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca2a5f-9aa0-4da4-b85f-6b5b3816b1ee None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:03.705493 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca2a5f-9aa0-4da4-b85f-6b5b3816b1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:03.762641 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-ecca2a5f-9aa0-4da4-b85f-6b5b3816b1ee None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:03.768024 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-ecca2a5f-9aa0-4da4-b85f-6b5b3816b1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:03.818260 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1b264533-5e8f-4e16-99e5-d7554611e405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d482b6ca72b463c9f47b651294b5a75'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:03.840029 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1b264533-5e8f-4e16-99e5-d7554611e405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d482b6ca72b463c9f47b651294b5a75'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:03.840969 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1b264533-5e8f-4e16-99e5-d7554611e405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d482b6ca72b463c9f47b651294b5a75'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:03.857687 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1b264533-5e8f-4e16-99e5-d7554611e405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d482b6ca72b463c9f47b651294b5a75'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:03.868881 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1b264533-5e8f-4e16-99e5-d7554611e405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d482b6ca72b463c9f47b651294b5a75'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:03.885269 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 812/1626] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:04:03 2021] DELETE /identity/v3/users/1d482b6ca72b463c9f47b651294b5a75 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:03.887036 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5e8ae-cca4-494c-a21f-1927929215eb None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:03.887219 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5e8ae-cca4-494c-a21f-1927929215eb None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:03.887530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5e8ae-cca4-494c-a21f-1927929215eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:03.888351 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 815/1627] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:03.889478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca2a5f-9aa0-4da4-b85f-6b5b3816b1ee None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:03.894777 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-ecca2a5f-9aa0-4da4-b85f-6b5b3816b1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:03.908399 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca2a5f-9aa0-4da4-b85f-6b5b3816b1ee None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:03.928766 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-dbe5e8ae-cca4-494c-a21f-1927929215eb None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:03.933819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-dbe5e8ae-cca4-494c-a21f-1927929215eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:03.987319 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea22cc-08f5-4de0-b88a-7c71636e4d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:03.988099 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea22cc-08f5-4de0-b88a-7c71636e4d7b admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:03.988751 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea22cc-08f5-4de0-b88a-7c71636e4d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:03.989149 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea22cc-08f5-4de0-b88a-7c71636e4d7b admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:03.989916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea22cc-08f5-4de0-b88a-7c71636e4d7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:03.992187 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea22cc-08f5-4de0-b88a-7c71636e4d7b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:04.014625 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 816/1628] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:04:03 2021] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:04.016307 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518fd0-ea55-444c-87c0-f61cb4ec2f66 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:04.016595 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518fd0-ea55-444c-87c0-f61cb4ec2f66 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:04.016876 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518fd0-ea55-444c-87c0-f61cb4ec2f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:04.042461 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 813/1629] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:04.045947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b769e-b0d8-4d68-b4c9-e2e5f027210d None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:04.046384 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b769e-b0d8-4d68-b4c9-e2e5f027210d None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:04.047507 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b769e-b0d8-4d68-b4c9-e2e5f027210d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:04.055611 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-0a518fd0-ea55-444c-87c0-f61cb4ec2f66 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:04.057219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0a518fd0-ea55-444c-87c0-f61cb4ec2f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:04.067278 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 817/1630] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:04.068531 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a518fd0-ea55-444c-87c0-f61cb4ec2f66 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:04.080004 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a518fd0-ea55-444c-87c0-f61cb4ec2f66 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:04.086318 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce9a58-68a6-4791-b2ca-3e74abac5ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:04.087478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce9a58-68a6-4791-b2ca-3e74abac5ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:04.088362 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-4a7b769e-b0d8-4d68-b4c9-e2e5f027210d None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:04.088770 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce9a58-68a6-4791-b2ca-3e74abac5ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:04.089312 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce9a58-68a6-4791-b2ca-3e74abac5ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:04.089661 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-4a7b769e-b0d8-4d68-b4c9-e2e5f027210d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:04.090596 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce9a58-68a6-4791-b2ca-3e74abac5ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:04.092841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce9a58-68a6-4791-b2ca-3e74abac5ee1 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:04.105783 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 818/1631] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:04 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:04.109338 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2cde5-0dd4-475a-a1c1-2dc224abf83e None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:04.109907 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2cde5-0dd4-475a-a1c1-2dc224abf83e None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:04.110625 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2cde5-0dd4-475a-a1c1-2dc224abf83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:04.112760 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 814/1632] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:04.113790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b769e-b0d8-4d68-b4c9-e2e5f027210d None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:04.140337 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b769e-b0d8-4d68-b4c9-e2e5f027210d None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:04.150739 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-0aa2cde5-0dd4-475a-a1c1-2dc224abf83e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:04.152302 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0aa2cde5-0dd4-475a-a1c1-2dc224abf83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:04.157714 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ac5ee-b88c-435b-ab08-9861fd1cf05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:04.158399 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ac5ee-b88c-435b-ab08-9861fd1cf05c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:04.158833 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ac5ee-b88c-435b-ab08-9861fd1cf05c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:04.159003 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ac5ee-b88c-435b-ab08-9861fd1cf05c admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:04.159686 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ac5ee-b88c-435b-ab08-9861fd1cf05c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:04:04.159995 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ac5ee-b88c-435b-ab08-9861fd1cf05c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:04.161627 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ac5ee-b88c-435b-ab08-9861fd1cf05c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:04.162680 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 819/1633] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:04.169746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2cde5-0dd4-475a-a1c1-2dc224abf83e None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:04.180723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2cde5-0dd4-475a-a1c1-2dc224abf83e None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:04.182527 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 815/1634] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:04:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:04:04.183682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ac5ee-b88c-435b-ab08-9861fd1cf05c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:04.187910 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-462ac5ee-b88c-435b-ab08-9861fd1cf05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:04.190167 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65c9dc-b130-444c-93d6-f82bd047a618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:04.191183 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65c9dc-b130-444c-93d6-f82bd047a618 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:04.191570 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65c9dc-b130-444c-93d6-f82bd047a618 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:04.191838 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65c9dc-b130-444c-93d6-f82bd047a618 admin admin] PATH_INFO: `/v3/projects/41634e2bfbd949fa948b9bd187c5583b/users/d4ad53649eeb483794d2517a1426bf04/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:04.208771 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65c9dc-b130-444c-93d6-f82bd047a618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41634e2bfbd949fa948b9bd187c5583b, user_id=d4ad53649eeb483794d2517a1426bf04, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:04.211591 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65c9dc-b130-444c-93d6-f82bd047a618 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:04.228478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 820/1635] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:04 2021] PUT /identity/v3/projects/41634e2bfbd949fa948b9bd187c5583b/users/d4ad53649eeb483794d2517a1426bf04/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:04.229748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65c9dc-b130-444c-93d6-f82bd047a618 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:04.273036 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ac5ee-b88c-435b-ab08-9861fd1cf05c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:04.346042 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035ef2e-d7b6-454e-8521-3a40a2a10aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:04.346708 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035ef2e-d7b6-454e-8521-3a40a2a10aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:04.347051 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035ef2e-d7b6-454e-8521-3a40a2a10aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:04.347337 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035ef2e-d7b6-454e-8521-3a40a2a10aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:04.417556 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035ef2e-d7b6-454e-8521-3a40a2a10aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:04.419032 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035ef2e-d7b6-454e-8521-3a40a2a10aa0 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:04.429984 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 816/1636] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:04.434281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035ef2e-d7b6-454e-8521-3a40a2a10aa0 service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:04.435264 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65c9dc-b130-444c-93d6-f82bd047a618 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:04.470453 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cfdf2-bbd7-4af5-9e5b-c7849bd3909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:04.472834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cfdf2-bbd7-4af5-9e5b-c7849bd3909d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:04.473809 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cfdf2-bbd7-4af5-9e5b-c7849bd3909d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:04.474561 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cfdf2-bbd7-4af5-9e5b-c7849bd3909d admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:04.484506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035ef2e-d7b6-454e-8521-3a40a2a10aa0 service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:04.485554 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cfdf2-bbd7-4af5-9e5b-c7849bd3909d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:04:04.487106 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cfdf2-bbd7-4af5-9e5b-c7849bd3909d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:04.495324 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cfdf2-bbd7-4af5-9e5b-c7849bd3909d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:04.505236 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fb418-a0b6-4904-a780-077c453293d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:04.505909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fb418-a0b6-4904-a780-077c453293d6 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:04.506194 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fb418-a0b6-4904-a780-077c453293d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:04.506470 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fb418-a0b6-4904-a780-077c453293d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:04.510370 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fb418-a0b6-4904-a780-077c453293d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:04.515712 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787fb418-a0b6-4904-a780-077c453293d6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:04.533622 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 821/1637] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:04:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:04:04.534807 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cfdf2-bbd7-4af5-9e5b-c7849bd3909d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:04.554454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cfdf2-bbd7-4af5-9e5b-c7849bd3909d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:04.568312 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221a2c6-a488-49e9-9053-5e0180cfa941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:04.569268 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221a2c6-a488-49e9-9053-5e0180cfa941 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:04.569709 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221a2c6-a488-49e9-9053-5e0180cfa941 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:04.570165 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221a2c6-a488-49e9-9053-5e0180cfa941 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:04.571044 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221a2c6-a488-49e9-9053-5e0180cfa941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:04.573133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221a2c6-a488-49e9-9053-5e0180cfa941 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:04.581858 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 817/1638] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:04:04 2021] POST /identity/v3/projects => generated 405 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:04.585824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95986427-699f-40ab-a372-dc46d60125df None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:04.586595 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95986427-699f-40ab-a372-dc46d60125df None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:04.586891 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95986427-699f-40ab-a372-dc46d60125df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:04.600247 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 822/1639] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:04 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:04.601330 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221a2c6-a488-49e9-9053-5e0180cfa941 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:04.620518 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221a2c6-a488-49e9-9053-5e0180cfa941 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:04.658359 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-95986427-699f-40ab-a372-dc46d60125df None None] MFA Rules not processed for user `029cbdf4fa7340549518b28e20c9328d`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:04.660001 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-95986427-699f-40ab-a372-dc46d60125df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:04.731500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe3aac-6592-415f-9708-cdea959259bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:04.732755 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe3aac-6592-415f-9708-cdea959259bc admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:04.733141 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe3aac-6592-415f-9708-cdea959259bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:04.733428 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe3aac-6592-415f-9708-cdea959259bc admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:04.734308 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe3aac-6592-415f-9708-cdea959259bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:04.736704 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe3aac-6592-415f-9708-cdea959259bc admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:04.795046 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 823/1640] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:04:04 2021] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:04.804807 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe3aac-6592-415f-9708-cdea959259bc admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:04.820488 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 818/1641] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:04 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:04.821575 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95986427-699f-40ab-a372-dc46d60125df None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:04.836010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95986427-699f-40ab-a372-dc46d60125df None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:04.916097 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b513e5-0813-4a96-bfed-aa47faad8f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:04.917500 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b513e5-0813-4a96-bfed-aa47faad8f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:04.918010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b513e5-0813-4a96-bfed-aa47faad8f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:04.918548 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b513e5-0813-4a96-bfed-aa47faad8f45 admin admin] PATH_INFO: `/v3/projects/41634e2bfbd949fa948b9bd187c5583b/users/d4ad53649eeb483794d2517a1426bf04/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:04.921238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b513e5-0813-4a96-bfed-aa47faad8f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41634e2bfbd949fa948b9bd187c5583b, user_id=d4ad53649eeb483794d2517a1426bf04, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:04.925233 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b513e5-0813-4a96-bfed-aa47faad8f45 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:04.947567 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 819/1642] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:04 2021] PUT /identity/v3/projects/41634e2bfbd949fa948b9bd187c5583b/users/d4ad53649eeb483794d2517a1426bf04/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:04.949278 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b513e5-0813-4a96-bfed-aa47faad8f45 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:04.958124 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe3aac-6592-415f-9708-cdea959259bc admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:05.075868 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b513e5-0813-4a96-bfed-aa47faad8f45 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:05.082048 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeefa4b-efb9-4210-9ef4-1153e3e0132d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:05.082893 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeefa4b-efb9-4210-9ef4-1153e3e0132d admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:05.083314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeefa4b-efb9-4210-9ef4-1153e3e0132d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:05.083817 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeefa4b-efb9-4210-9ef4-1153e3e0132d admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:05.084635 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeefa4b-efb9-4210-9ef4-1153e3e0132d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:05.086779 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeefa4b-efb9-4210-9ef4-1153e3e0132d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:05.132131 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 820/1643] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:04:04 2021] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:05.133933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387c686-ffa9-46c0-9d0d-042443d9b172 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:05.134480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387c686-ffa9-46c0-9d0d-042443d9b172 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:05.134991 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387c686-ffa9-46c0-9d0d-042443d9b172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:05.175353 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4cbfd-de82-4e12-8151-dae15a07637b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:05.176123 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4cbfd-de82-4e12-8151-dae15a07637b admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:05.176560 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4cbfd-de82-4e12-8151-dae15a07637b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:05.176845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4cbfd-de82-4e12-8151-dae15a07637b admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:05.177538 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4cbfd-de82-4e12-8151-dae15a07637b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:05.188506 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4cbfd-de82-4e12-8151-dae15a07637b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:05.191862 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-4387c686-ffa9-46c0-9d0d-042443d9b172 None None] MFA Rules not processed for user `029cbdf4fa7340549518b28e20c9328d`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:05.193876 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-4387c686-ffa9-46c0-9d0d-042443d9b172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:05.224293 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 824/1644] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:04:04 2021] POST /identity/v3/users => generated 303 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:05.225715 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b7a12-947e-42b7-b277-9269bc27933a None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:05.226092 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b7a12-947e-42b7-b277-9269bc27933a None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:05.226377 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b7a12-947e-42b7-b277-9269bc27933a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:05.262074 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-779b7a12-947e-42b7-b277-9269bc27933a None None] MFA Rules not processed for user `d4ad53649eeb483794d2517a1426bf04`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:05.263527 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-779b7a12-947e-42b7-b277-9269bc27933a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:05.328997 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 821/1645] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:05 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:05.331352 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387c686-ffa9-46c0-9d0d-042443d9b172 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:05.343141 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-4387c686-ffa9-46c0-9d0d-042443d9b172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:05.377010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387c686-ffa9-46c0-9d0d-042443d9b172 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:05.387597 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317b206-3273-4533-aa78-e1a39aff6531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:05.389560 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317b206-3273-4533-aa78-e1a39aff6531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:05.389875 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317b206-3273-4533-aa78-e1a39aff6531 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:05.390156 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317b206-3273-4533-aa78-e1a39aff6531 admin admin] PATH_INFO: `/v3/projects/f3387a68ed744356ae7a2815ae8ef970` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:05.393157 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317b206-3273-4533-aa78-e1a39aff6531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3387a68ed744356ae7a2815ae8ef970)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:05.395103 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317b206-3273-4533-aa78-e1a39aff6531 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:05.416584 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 825/1646] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:05 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:05.417528 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b7a12-947e-42b7-b277-9269bc27933a None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:05.443996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b7a12-947e-42b7-b277-9269bc27933a None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:05.457139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307920c-8994-4f83-9e52-c9d0ec2666db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:05.457831 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307920c-8994-4f83-9e52-c9d0ec2666db admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:05.458113 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307920c-8994-4f83-9e52-c9d0ec2666db admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:05.458392 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307920c-8994-4f83-9e52-c9d0ec2666db admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:05.459748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307920c-8994-4f83-9e52-c9d0ec2666db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:05.468745 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307920c-8994-4f83-9e52-c9d0ec2666db admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:05.494041 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1317b206-3273-4533-aa78-e1a39aff6531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3387a68ed744356ae7a2815ae8ef970', 'request_id': 'req-1317b206-3273-4533-aa78-e1a39aff6531'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:05.495692 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 826/1647] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:05 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:05.498307 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b398c3b-441b-43a2-9a6f-23879ad9c7e3 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:05.498602 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b398c3b-441b-43a2-9a6f-23879ad9c7e3 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:05.499997 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b398c3b-441b-43a2-9a6f-23879ad9c7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:05.515216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1317b206-3273-4533-aa78-e1a39aff6531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3387a68ed744356ae7a2815ae8ef970', 'request_id': 'req-1317b206-3273-4533-aa78-e1a39aff6531'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:05.544717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1317b206-3273-4533-aa78-e1a39aff6531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3387a68ed744356ae7a2815ae8ef970', 'request_id': 'req-1317b206-3273-4533-aa78-e1a39aff6531'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:05.562191 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1317b206-3273-4533-aa78-e1a39aff6531 admin admin] The token cache is being invalidate because project f3387a68ed744356ae7a2815ae8ef970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:04:05.562497 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1317b206-3273-4533-aa78-e1a39aff6531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:05.567459 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1317b206-3273-4533-aa78-e1a39aff6531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:05.569167 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 822/1648] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:04:05 2021] DELETE /identity/v3/projects/f3387a68ed744356ae7a2815ae8ef970 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:05.571375 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-0b398c3b-441b-43a2-9a6f-23879ad9c7e3 None None] MFA Rules not processed for user `b1918e2aa8f24655875480ef52df324d`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:05.575665 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317b206-3273-4533-aa78-e1a39aff6531 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:05.577047 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-1317b206-3273-4533-aa78-e1a39aff6531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:05.579272 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0b398c3b-441b-43a2-9a6f-23879ad9c7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:05.686155 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 827/1649] 10.222.0.39 () {58 vars in 1010 bytes} [Tue Aug 31 03:04:05 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:05.688078 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b398c3b-441b-43a2-9a6f-23879ad9c7e3 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:05.690526 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0b398c3b-441b-43a2-9a6f-23879ad9c7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:05.708291 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317b206-3273-4533-aa78-e1a39aff6531 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:05.720930 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a49a2a-e695-4986-9d3e-4eb6b5b54b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:05.721714 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a49a2a-e695-4986-9d3e-4eb6b5b54b77 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:05.721992 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a49a2a-e695-4986-9d3e-4eb6b5b54b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:05.722266 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a49a2a-e695-4986-9d3e-4eb6b5b54b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:05.723296 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a49a2a-e695-4986-9d3e-4eb6b5b54b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:05.726118 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a49a2a-e695-4986-9d3e-4eb6b5b54b77 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:05.748218 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 823/1650] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:05 2021] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:05.752054 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a49a2a-e695-4986-9d3e-4eb6b5b54b77 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:05.758170 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b4a49a2a-e695-4986-9d3e-4eb6b5b54b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:05.822919 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b398c3b-441b-43a2-9a6f-23879ad9c7e3 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:05.833873 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ea46d-ce35-4c18-9933-b68b702b7cba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:05.834605 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ea46d-ce35-4c18-9933-b68b702b7cba service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:05.834889 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ea46d-ce35-4c18-9933-b68b702b7cba service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:05.835165 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ea46d-ce35-4c18-9933-b68b702b7cba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:05.841711 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d81ea46d-ce35-4c18-9933-b68b702b7cba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:05.906700 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a49a2a-e695-4986-9d3e-4eb6b5b54b77 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:05.925701 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad4360-38e1-40aa-a6ed-05e21f8e0931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:05.932259 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad4360-38e1-40aa-a6ed-05e21f8e0931 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:05.932603 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad4360-38e1-40aa-a6ed-05e21f8e0931 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:05.932893 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad4360-38e1-40aa-a6ed-05e21f8e0931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:05.937233 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b3ad4360-38e1-40aa-a6ed-05e21f8e0931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:05.966439 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ea46d-ce35-4c18-9933-b68b702b7cba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:05.968141 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ea46d-ce35-4c18-9933-b68b702b7cba service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:05.983863 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 828/1651] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:05 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:05.984785 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ea46d-ce35-4c18-9933-b68b702b7cba service nova] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:05.986732 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d81ea46d-ce35-4c18-9933-b68b702b7cba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:06.023039 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ea46d-ce35-4c18-9933-b68b702b7cba service nova] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:06.038733 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea6912-7fd2-4a15-bd03-009d491b7bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:06.039245 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea6912-7fd2-4a15-bd03-009d491b7bce admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:06.041382 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea6912-7fd2-4a15-bd03-009d491b7bce admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:06.042022 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea6912-7fd2-4a15-bd03-009d491b7bce admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:06.042792 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea6912-7fd2-4a15-bd03-009d491b7bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:06.049272 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea6912-7fd2-4a15-bd03-009d491b7bce admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:06.068547 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad4360-38e1-40aa-a6ed-05e21f8e0931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:06.070025 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad4360-38e1-40aa-a6ed-05e21f8e0931 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:06.085778 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 829/1652] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:05 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:06.087251 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976486dd-1cea-4ede-abec-9d913c22d34d None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:06.088229 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976486dd-1cea-4ede-abec-9d913c22d34d None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:06.093232 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976486dd-1cea-4ede-abec-9d913c22d34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:06.097687 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 824/1653] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:05 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:06.098571 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad4360-38e1-40aa-a6ed-05e21f8e0931 service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:06.126537 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad4360-38e1-40aa-a6ed-05e21f8e0931 service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:06.135216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118872fc-6df3-4dae-a62b-40ffc873a6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:06.137036 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118872fc-6df3-4dae-a62b-40ffc873a6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:06.137590 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118872fc-6df3-4dae-a62b-40ffc873a6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:06.137989 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118872fc-6df3-4dae-a62b-40ffc873a6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:06.138916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118872fc-6df3-4dae-a62b-40ffc873a6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:06.145111 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118872fc-6df3-4dae-a62b-40ffc873a6c3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:06.148358 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-976486dd-1cea-4ede-abec-9d913c22d34d None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:06.149588 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-976486dd-1cea-4ede-abec-9d913c22d34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:06.168721 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 825/1654] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:06 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:06.168721 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118872fc-6df3-4dae-a62b-40ffc873a6c3 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:06.172433 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-118872fc-6df3-4dae-a62b-40ffc873a6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:06.181487 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 830/1655] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:06.182841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976486dd-1cea-4ede-abec-9d913c22d34d None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:06.202842 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976486dd-1cea-4ede-abec-9d913c22d34d None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:06.223293 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca118d94-c1a6-4d6a-ac98-5411cda08a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:06.226552 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca118d94-c1a6-4d6a-ac98-5411cda08a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:06.227851 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca118d94-c1a6-4d6a-ac98-5411cda08a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:06.228769 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca118d94-c1a6-4d6a-ac98-5411cda08a78 admin admin] PATH_INFO: `/v3/projects/7d0b34513bea463fbcb6c8ef81c7ce46/users/2be000ffca5e44caa853a43a97449ba6/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:06.266896 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca118d94-c1a6-4d6a-ac98-5411cda08a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d0b34513bea463fbcb6c8ef81c7ce46, user_id=2be000ffca5e44caa853a43a97449ba6, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:06.279063 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca118d94-c1a6-4d6a-ac98-5411cda08a78 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:06.330686 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 831/1656] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:06 2021] PUT /identity/v3/projects/7d0b34513bea463fbcb6c8ef81c7ce46/users/2be000ffca5e44caa853a43a97449ba6/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:06.331727 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca118d94-c1a6-4d6a-ac98-5411cda08a78 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:06.358520 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118872fc-6df3-4dae-a62b-40ffc873a6c3 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:06.441926 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca118d94-c1a6-4d6a-ac98-5411cda08a78 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:06.448815 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48768d9-f5a6-4ccd-bf91-66e2271d1313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:06.450830 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48768d9-f5a6-4ccd-bf91-66e2271d1313 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:06.451430 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48768d9-f5a6-4ccd-bf91-66e2271d1313 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:06.451852 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19f03b-af31-468d-98fd-5fa96c763461 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ed84d2e3ce4c85b552732f3294aac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:06.452188 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48768d9-f5a6-4ccd-bf91-66e2271d1313 admin admin] PATH_INFO: `/v3/projects/d15e58bb98b14b0293713d923f684a59/users/4e8c9da5c9eb44e79b59f76050389105/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:06.452516 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19f03b-af31-468d-98fd-5fa96c763461 service swift] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:06.452802 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19f03b-af31-468d-98fd-5fa96c763461 service swift] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:06.453081 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19f03b-af31-468d-98fd-5fa96c763461 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:06.479473 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48768d9-f5a6-4ccd-bf91-66e2271d1313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15e58bb98b14b0293713d923f684a59, user_id=4e8c9da5c9eb44e79b59f76050389105, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:06.482644 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48768d9-f5a6-4ccd-bf91-66e2271d1313 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:06.531245 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 832/1657] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:06 2021] PUT /identity/v3/projects/d15e58bb98b14b0293713d923f684a59/users/4e8c9da5c9eb44e79b59f76050389105/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:06.542836 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954290c-f3de-42cf-9aa6-20c06b190456 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:06.544024 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19f03b-af31-468d-98fd-5fa96c763461 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:06.546051 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19f03b-af31-468d-98fd-5fa96c763461 service swift] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:06.546680 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954290c-f3de-42cf-9aa6-20c06b190456 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:06.547816 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954290c-f3de-42cf-9aa6-20c06b190456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:06.558270 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 826/1658] 10.222.0.39 () {60 vars in 1385 bytes} [Tue Aug 31 03:04:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 03:04:06.560052 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19f03b-af31-468d-98fd-5fa96c763461 service swift] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:06.625426 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-c954290c-f3de-42cf-9aa6-20c06b190456 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:06.626604 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c954290c-f3de-42cf-9aa6-20c06b190456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:06.748399 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19f03b-af31-468d-98fd-5fa96c763461 service swift] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:06.860902 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 833/1659] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:06.866323 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e27dc-a978-41eb-9c40-5b96759d6a1a None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:06.866630 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e27dc-a978-41eb-9c40-5b96759d6a1a None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:06.866955 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e27dc-a978-41eb-9c40-5b96759d6a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:07.001108 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db2dca-ab57-4585-9cf7-cb957e649c1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:07.005671 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db2dca-ab57-4585-9cf7-cb957e649c1c service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:07.005671 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db2dca-ab57-4585-9cf7-cb957e649c1c service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:07.005671 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db2dca-ab57-4585-9cf7-cb957e649c1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:07.007548 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-632e27dc-a978-41eb-9c40-5b96759d6a1a None None] MFA Rules not processed for user `2be000ffca5e44caa853a43a97449ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:07.011247 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-632e27dc-a978-41eb-9c40-5b96759d6a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:07.016991 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-95db2dca-ab57-4585-9cf7-cb957e649c1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:07.221227 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db2dca-ab57-4585-9cf7-cb957e649c1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:07.223002 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db2dca-ab57-4585-9cf7-cb957e649c1c service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:07.247592 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 827/1660] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:06 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:07.253177 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 834/1661] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:06 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:07.253177 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e27dc-a978-41eb-9c40-5b96759d6a1a None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:07.254330 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d3bda-fde9-40a0-a680-7322643b40f0 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:07.256590 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d3bda-fde9-40a0-a680-7322643b40f0 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:07.256834 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d3bda-fde9-40a0-a680-7322643b40f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:07.300170 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e27dc-a978-41eb-9c40-5b96759d6a1a None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:07.307128 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c1dc7-5ff4-4ebc-968b-069b4532e6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:07.307681 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c1dc7-5ff4-4ebc-968b-069b4532e6ed admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:07.308096 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c1dc7-5ff4-4ebc-968b-069b4532e6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:07.308444 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c1dc7-5ff4-4ebc-968b-069b4532e6ed admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:07.309265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c1dc7-5ff4-4ebc-968b-069b4532e6ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:04:07.311660 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c1dc7-5ff4-4ebc-968b-069b4532e6ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:07.312463 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-c30d3bda-fde9-40a0-a680-7322643b40f0 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:07.315627 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c1dc7-5ff4-4ebc-968b-069b4532e6ed admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:07.316699 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c30d3bda-fde9-40a0-a680-7322643b40f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:07.331341 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 828/1662] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:07.331341 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d3bda-fde9-40a0-a680-7322643b40f0 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:07.342823 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 835/1663] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:04:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:04:07.343811 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c1dc7-5ff4-4ebc-968b-069b4532e6ed admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:07.355608 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d3bda-fde9-40a0-a680-7322643b40f0 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:07.358086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c1dc7-5ff4-4ebc-968b-069b4532e6ed admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:07.362723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a24b0-44ce-4eb3-9222-393af032df69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:07.363421 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a24b0-44ce-4eb3-9222-393af032df69 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:07.363713 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a24b0-44ce-4eb3-9222-393af032df69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:07.363997 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a24b0-44ce-4eb3-9222-393af032df69 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:07.364695 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a24b0-44ce-4eb3-9222-393af032df69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:07.366857 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a24b0-44ce-4eb3-9222-393af032df69 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:07.372869 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607a633-6fe1-410d-81ed-945f1616534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:07.372869 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607a633-6fe1-410d-81ed-945f1616534b admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:07.372869 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607a633-6fe1-410d-81ed-945f1616534b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:07.372869 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607a633-6fe1-410d-81ed-945f1616534b admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:07.373733 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607a633-6fe1-410d-81ed-945f1616534b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:07.380938 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607a633-6fe1-410d-81ed-945f1616534b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:07.408887 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 836/1664] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:04:07 2021] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:07.410688 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a24b0-44ce-4eb3-9222-393af032df69 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:07.413065 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-452a24b0-44ce-4eb3-9222-393af032df69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:07.458912 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 829/1665] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:04:07 2021] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:07.458912 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607a633-6fe1-410d-81ed-945f1616534b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:07.822741 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a24b0-44ce-4eb3-9222-393af032df69 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:07.825484 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607a633-6fe1-410d-81ed-945f1616534b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:07.825484 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c921e-b340-4b79-a191-e8a609f1c6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:07.825484 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c921e-b340-4b79-a191-e8a609f1c6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:07.825484 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c921e-b340-4b79-a191-e8a609f1c6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:07.826323 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c921e-b340-4b79-a191-e8a609f1c6e3 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:07.826323 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c921e-b340-4b79-a191-e8a609f1c6e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:07.826323 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c921e-b340-4b79-a191-e8a609f1c6e3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:07.827947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5786af-bd1d-434a-abbc-7f92dd37704a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:07.827947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5786af-bd1d-434a-abbc-7f92dd37704a service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:07.827947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5786af-bd1d-434a-abbc-7f92dd37704a service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:07.827947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5786af-bd1d-434a-abbc-7f92dd37704a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:07.829318 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 830/1666] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:04:07 2021] POST /identity/v3/users => generated 283 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:07.830351 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c921e-b340-4b79-a191-e8a609f1c6e3 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:07.837674 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5786af-bd1d-434a-abbc-7f92dd37704a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:07.845149 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5786af-bd1d-434a-abbc-7f92dd37704a service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:07.854217 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c921e-b340-4b79-a191-e8a609f1c6e3 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:07.868131 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4892f8b-a201-4eb8-97d9-16aa2d7f47f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:07.869645 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4892f8b-a201-4eb8-97d9-16aa2d7f47f2 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:07.869839 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4892f8b-a201-4eb8-97d9-16aa2d7f47f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:07.870089 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4892f8b-a201-4eb8-97d9-16aa2d7f47f2 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:07.870843 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4892f8b-a201-4eb8-97d9-16aa2d7f47f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:07.872957 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4892f8b-a201-4eb8-97d9-16aa2d7f47f2 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:07.891544 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 837/1667] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:07.895293 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5786af-bd1d-434a-abbc-7f92dd37704a service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:07.923709 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 831/1668] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:04:07 2021] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:07.924822 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4892f8b-a201-4eb8-97d9-16aa2d7f47f2 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:07.945919 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4892f8b-a201-4eb8-97d9-16aa2d7f47f2 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:07.960332 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5786af-bd1d-434a-abbc-7f92dd37704a service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:07.961626 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80a3a7-7473-49e3-afb8-49bdc2c4ddd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:07.962336 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80a3a7-7473-49e3-afb8-49bdc2c4ddd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:07.962653 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80a3a7-7473-49e3-afb8-49bdc2c4ddd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:07.963048 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80a3a7-7473-49e3-afb8-49bdc2c4ddd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:07.963879 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80a3a7-7473-49e3-afb8-49bdc2c4ddd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:07.965704 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80a3a7-7473-49e3-afb8-49bdc2c4ddd0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:07.982031 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ef02e-d193-4170-970d-4abbdccb92f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:07.984422 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ef02e-d193-4170-970d-4abbdccb92f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:07.984762 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ef02e-d193-4170-970d-4abbdccb92f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:07.985104 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ef02e-d193-4170-970d-4abbdccb92f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:07.985887 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ef02e-d193-4170-970d-4abbdccb92f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:08.004193 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ef02e-d193-4170-970d-4abbdccb92f2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:08.005831 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 832/1669] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:07 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:08.010634 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea616d-728b-4e24-ba27-04733db991ea None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:08.011158 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea616d-728b-4e24-ba27-04733db991ea None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:08.011647 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea616d-728b-4e24-ba27-04733db991ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:08.067395 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 838/1670] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:07 2021] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:08.068872 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ef02e-d193-4170-970d-4abbdccb92f2 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:08.076127 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-70ea616d-728b-4e24-ba27-04733db991ea None None] MFA Rules not processed for user `18b73b8e7244410b8f701b2ab43c5979`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:08.077278 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-70ea616d-728b-4e24-ba27-04733db991ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:08.112374 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ef02e-d193-4170-970d-4abbdccb92f2 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:08.114248 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 833/1671] 10.222.0.45 () {58 vars in 1016 bytes} [Tue Aug 31 03:04:08 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:08.115261 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea616d-728b-4e24-ba27-04733db991ea None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:08.127230 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690f933-f8cf-4efc-b9a2-c71a441d1067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:08.128814 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690f933-f8cf-4efc-b9a2-c71a441d1067 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:08.129172 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690f933-f8cf-4efc-b9a2-c71a441d1067 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:08.129451 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690f933-f8cf-4efc-b9a2-c71a441d1067 admin admin] PATH_INFO: `/v3/projects/446056fd28a14a9b8fc7640117fcba8a/users/dcd464aa8d5043cbba6a9f00a73e0799/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:08.162481 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690f933-f8cf-4efc-b9a2-c71a441d1067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=446056fd28a14a9b8fc7640117fcba8a, user_id=dcd464aa8d5043cbba6a9f00a73e0799, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:08.163436 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea616d-728b-4e24-ba27-04733db991ea None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:08.168076 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690f933-f8cf-4efc-b9a2-c71a441d1067 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:08.189010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e82a6c-57bd-41ec-a61f-8e20744dad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:08.189701 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e82a6c-57bd-41ec-a61f-8e20744dad77 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:08.190393 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e82a6c-57bd-41ec-a61f-8e20744dad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:08.190393 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e82a6c-57bd-41ec-a61f-8e20744dad77 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:08.191104 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e82a6c-57bd-41ec-a61f-8e20744dad77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:08.193358 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e82a6c-57bd-41ec-a61f-8e20744dad77 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:08.194388 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 839/1672] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:08 2021] PUT /identity/v3/projects/446056fd28a14a9b8fc7640117fcba8a/users/dcd464aa8d5043cbba6a9f00a73e0799/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:08.198639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690f933-f8cf-4efc-b9a2-c71a441d1067 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:08.225194 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 834/1673] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:08 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:08.230245 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e82a6c-57bd-41ec-a61f-8e20744dad77 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:08.271246 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e82a6c-57bd-41ec-a61f-8e20744dad77 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:08.435120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690f933-f8cf-4efc-b9a2-c71a441d1067 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:08.447559 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51238904-7b82-42f8-8bd0-465ebdced7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:08.449922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51238904-7b82-42f8-8bd0-465ebdced7b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:08.450720 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51238904-7b82-42f8-8bd0-465ebdced7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:08.451311 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51238904-7b82-42f8-8bd0-465ebdced7b4 admin admin] PATH_INFO: `/v3/projects/4cc80741ea8247689e3ef518b108ec95/users/d9b42298908542d7a6428330c0525e3f/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:08.453354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555206dc-43c0-4d2d-bc6b-c12d6005b6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:08.454049 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555206dc-43c0-4d2d-bc6b-c12d6005b6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:08.455234 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555206dc-43c0-4d2d-bc6b-c12d6005b6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:08.455547 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555206dc-43c0-4d2d-bc6b-c12d6005b6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:08.456303 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555206dc-43c0-4d2d-bc6b-c12d6005b6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:08.460193 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555206dc-43c0-4d2d-bc6b-c12d6005b6c0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:08.503708 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 840/1674] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:08 2021] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:08.506478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555206dc-43c0-4d2d-bc6b-c12d6005b6c0 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:08.512816 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51238904-7b82-42f8-8bd0-465ebdced7b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc80741ea8247689e3ef518b108ec95, user_id=d9b42298908542d7a6428330c0525e3f, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:08.521086 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51238904-7b82-42f8-8bd0-465ebdced7b4 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:08.537535 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555206dc-43c0-4d2d-bc6b-c12d6005b6c0 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:08.555480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 835/1675] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:08 2021] PUT /identity/v3/projects/4cc80741ea8247689e3ef518b108ec95/users/d9b42298908542d7a6428330c0525e3f/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:08.561098 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a1aa5-04fa-467e-9e7f-a8efafd42d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:08.562011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a1aa5-04fa-467e-9e7f-a8efafd42d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:08.562299 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a1aa5-04fa-467e-9e7f-a8efafd42d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:08.562579 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a1aa5-04fa-467e-9e7f-a8efafd42d6f admin admin] PATH_INFO: `/v3/projects/446056fd28a14a9b8fc7640117fcba8a/users/dcd464aa8d5043cbba6a9f00a73e0799/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:08.566170 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf798d4e-8a97-4a4d-81c7-7c4fee23aa7b None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:08.566917 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf798d4e-8a97-4a4d-81c7-7c4fee23aa7b None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:08.567119 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a1aa5-04fa-467e-9e7f-a8efafd42d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=446056fd28a14a9b8fc7640117fcba8a, user_id=dcd464aa8d5043cbba6a9f00a73e0799, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:08.567886 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf798d4e-8a97-4a4d-81c7-7c4fee23aa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:08.573372 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a1aa5-04fa-467e-9e7f-a8efafd42d6f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:08.588541 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 841/1676] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:08 2021] PUT /identity/v3/projects/446056fd28a14a9b8fc7640117fcba8a/users/dcd464aa8d5043cbba6a9f00a73e0799/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:08.598529 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0885f9-070e-4094-ba8d-1f8aebe65d05 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:08.602326 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0885f9-070e-4094-ba8d-1f8aebe65d05 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:08.604086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0885f9-070e-4094-ba8d-1f8aebe65d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:08.691450 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-bf798d4e-8a97-4a4d-81c7-7c4fee23aa7b None None] MFA Rules not processed for user `d9b42298908542d7a6428330c0525e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:08.692733 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-bf798d4e-8a97-4a4d-81c7-7c4fee23aa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:08.713576 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-2f0885f9-070e-4094-ba8d-1f8aebe65d05 None None] MFA Rules not processed for user `dcd464aa8d5043cbba6a9f00a73e0799`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:08.713576 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-2f0885f9-070e-4094-ba8d-1f8aebe65d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:08.942841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 836/1677] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:08 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:04:08.942841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f1dd4-714e-4a1d-a9d5-e2b4979bc166 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:08.942841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f1dd4-714e-4a1d-a9d5-e2b4979bc166 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:08.942841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f1dd4-714e-4a1d-a9d5-e2b4979bc166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:09.015421 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-078f1dd4-714e-4a1d-a9d5-e2b4979bc166 None None] MFA Rules not processed for user `029cbdf4fa7340549518b28e20c9328d`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:09.016685 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-078f1dd4-714e-4a1d-a9d5-e2b4979bc166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:09.107840 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 842/1678] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:08 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:09.110362 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0885f9-070e-4094-ba8d-1f8aebe65d05 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:09.245847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 837/1679] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:08 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:09.246884 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f1dd4-714e-4a1d-a9d5-e2b4979bc166 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:09.256536 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-078f1dd4-714e-4a1d-a9d5-e2b4979bc166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:09.420335 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0885f9-070e-4094-ba8d-1f8aebe65d05 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:09.423018 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f1dd4-714e-4a1d-a9d5-e2b4979bc166 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:09.439311 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a1fcf-70d3-453a-9526-ff0b5d8cd3d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:09.440132 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a1fcf-70d3-453a-9526-ff0b5d8cd3d9 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:09.440364 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a1fcf-70d3-453a-9526-ff0b5d8cd3d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:09.445546 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a1fcf-70d3-453a-9526-ff0b5d8cd3d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:09.466632 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a1fcf-70d3-453a-9526-ff0b5d8cd3d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:09.468137 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a1fcf-70d3-453a-9526-ff0b5d8cd3d9 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:09.468409 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da434d7e-f58c-4b07-9d69-9f17f42ece2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:09.469138 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da434d7e-f58c-4b07-9d69-9f17f42ece2e admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:09.469422 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da434d7e-f58c-4b07-9d69-9f17f42ece2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:09.469698 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da434d7e-f58c-4b07-9d69-9f17f42ece2e admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:09.470402 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da434d7e-f58c-4b07-9d69-9f17f42ece2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:09.472430 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da434d7e-f58c-4b07-9d69-9f17f42ece2e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:09.502567 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 838/1680] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:09 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:09.507198 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a1fcf-70d3-453a-9526-ff0b5d8cd3d9 service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:09.555122 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 843/1681] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:04:09 2021] POST /identity/v3/projects => generated 363 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:09.557493 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da434d7e-f58c-4b07-9d69-9f17f42ece2e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:09.700379 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a1fcf-70d3-453a-9526-ff0b5d8cd3d9 service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:09.729943 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da434d7e-f58c-4b07-9d69-9f17f42ece2e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:09.772100 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5b232-b11b-40b7-9267-6f62d522fc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:09.772800 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5b232-b11b-40b7-9267-6f62d522fc78 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:09.773091 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5b232-b11b-40b7-9267-6f62d522fc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:09.773755 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5b232-b11b-40b7-9267-6f62d522fc78 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:09.774675 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5b232-b11b-40b7-9267-6f62d522fc78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:09.785510 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5b232-b11b-40b7-9267-6f62d522fc78 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:09.830194 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def62a2e-7f3b-46b6-8618-e6e16759f739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:09.831565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def62a2e-7f3b-46b6-8618-e6e16759f739 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:09.831862 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def62a2e-7f3b-46b6-8618-e6e16759f739 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:09.832143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def62a2e-7f3b-46b6-8618-e6e16759f739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:09.910473 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 844/1682] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:04:09 2021] POST /identity/v3/users => generated 288 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:04:09.921394 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5b232-b11b-40b7-9267-6f62d522fc78 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:10.017655 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def62a2e-7f3b-46b6-8618-e6e16759f739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:10.019416 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def62a2e-7f3b-46b6-8618-e6e16759f739 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:10.047270 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 839/1683] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:09 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:10.048407 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def62a2e-7f3b-46b6-8618-e6e16759f739 service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:10.084904 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def62a2e-7f3b-46b6-8618-e6e16759f739 service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:10.096770 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6a9e6-bede-43d3-84cc-764d032facf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:10.097735 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6a9e6-bede-43d3-84cc-764d032facf9 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:10.098194 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6a9e6-bede-43d3-84cc-764d032facf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:10.098640 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6a9e6-bede-43d3-84cc-764d032facf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:10.099593 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6a9e6-bede-43d3-84cc-764d032facf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:10.102092 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6a9e6-bede-43d3-84cc-764d032facf9 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:10.143265 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 840/1684] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:10 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:10.147666 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6a9e6-bede-43d3-84cc-764d032facf9 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:10.180298 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6a9e6-bede-43d3-84cc-764d032facf9 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:10.188581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5b232-b11b-40b7-9267-6f62d522fc78 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:10.204745 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515274a3-7d4c-4090-9b67-6cfda496c604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:10.205705 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515274a3-7d4c-4090-9b67-6cfda496c604 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:10.206160 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515274a3-7d4c-4090-9b67-6cfda496c604 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:10.206597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515274a3-7d4c-4090-9b67-6cfda496c604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:10.210142 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b02bfc-c89e-4bd8-a7b4-2457c9b90fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:10.211307 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b02bfc-c89e-4bd8-a7b4-2457c9b90fae admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:10.214970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b02bfc-c89e-4bd8-a7b4-2457c9b90fae admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:10.215600 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b02bfc-c89e-4bd8-a7b4-2457c9b90fae admin admin] PATH_INFO: `/v3/projects/08db450460d44308947a5641c758b72a/users/b23598bfdbf34aaa8fb3c3ee4e6bcda0/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:10.231695 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515274a3-7d4c-4090-9b67-6cfda496c604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:10.233360 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515274a3-7d4c-4090-9b67-6cfda496c604 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:10.276841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b02bfc-c89e-4bd8-a7b4-2457c9b90fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=08db450460d44308947a5641c758b72a, user_id=b23598bfdbf34aaa8fb3c3ee4e6bcda0, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:10.286306 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b02bfc-c89e-4bd8-a7b4-2457c9b90fae admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:10.291547 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 845/1685] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:09 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:10.348925 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 841/1686] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:10 2021] PUT /identity/v3/projects/08db450460d44308947a5641c758b72a/users/b23598bfdbf34aaa8fb3c3ee4e6bcda0/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:10.354234 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515274a3-7d4c-4090-9b67-6cfda496c604 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:10.373407 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515274a3-7d4c-4090-9b67-6cfda496c604 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:10.625096 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116dcaff-edbe-4cbb-95b6-d83abd021d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:10.626085 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116dcaff-edbe-4cbb-95b6-d83abd021d1c admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:10.626537 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116dcaff-edbe-4cbb-95b6-d83abd021d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:10.626970 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116dcaff-edbe-4cbb-95b6-d83abd021d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:10.628178 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116dcaff-edbe-4cbb-95b6-d83abd021d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:10.630002 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116dcaff-edbe-4cbb-95b6-d83abd021d1c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:10.648230 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 846/1687] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:10 2021] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:04:10.653015 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b02bfc-c89e-4bd8-a7b4-2457c9b90fae admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:10.671189 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b02bfc-c89e-4bd8-a7b4-2457c9b90fae admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:10.712893 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a2de5-e5d8-4e20-b39f-407c43c093c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:10.720371 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a2de5-e5d8-4e20-b39f-407c43c093c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:10.720683 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a2de5-e5d8-4e20-b39f-407c43c093c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:10.734275 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a2de5-e5d8-4e20-b39f-407c43c093c7 admin admin] PATH_INFO: `/v3/projects/08db450460d44308947a5641c758b72a/users/b23598bfdbf34aaa8fb3c3ee4e6bcda0/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:10.760392 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a2de5-e5d8-4e20-b39f-407c43c093c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08db450460d44308947a5641c758b72a, user_id=b23598bfdbf34aaa8fb3c3ee4e6bcda0, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:10.767736 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a2de5-e5d8-4e20-b39f-407c43c093c7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:10.823108 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 842/1688] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:10 2021] PUT /identity/v3/projects/08db450460d44308947a5641c758b72a/users/b23598bfdbf34aaa8fb3c3ee4e6bcda0/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:10.834576 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e6967-a45f-4e6f-8a7c-7324e36f1a98 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:10.835270 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e6967-a45f-4e6f-8a7c-7324e36f1a98 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:10.835805 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e6967-a45f-4e6f-8a7c-7324e36f1a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:10.891767 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-021e6967-a45f-4e6f-8a7c-7324e36f1a98 None None] MFA Rules not processed for user `b23598bfdbf34aaa8fb3c3ee4e6bcda0`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:10.893554 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-021e6967-a45f-4e6f-8a7c-7324e36f1a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:11.072469 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 847/1689] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:10 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:11.132791 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a2de5-e5d8-4e20-b39f-407c43c093c7 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:11.139161 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ef6a2de5-e5d8-4e20-b39f-407c43c093c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:11.310982 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a2de5-e5d8-4e20-b39f-407c43c093c7 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:11.320856 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100e463-ebad-4a1d-8894-54cc26ca02c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:11.322751 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100e463-ebad-4a1d-8894-54cc26ca02c7 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:11.323229 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100e463-ebad-4a1d-8894-54cc26ca02c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:11.323700 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100e463-ebad-4a1d-8894-54cc26ca02c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:11.349824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100e463-ebad-4a1d-8894-54cc26ca02c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:11.361448 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100e463-ebad-4a1d-8894-54cc26ca02c7 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:11.395968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 843/1690] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:11 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:11.612448 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e6967-a45f-4e6f-8a7c-7324e36f1a98 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:11.616656 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e6967-a45f-4e6f-8a7c-7324e36f1a98 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:11.643796 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4028e71-c008-44e8-8e6e-f7d098429ec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:11.645689 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4028e71-c008-44e8-8e6e-f7d098429ec3 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:11.646404 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4028e71-c008-44e8-8e6e-f7d098429ec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:11.655029 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4028e71-c008-44e8-8e6e-f7d098429ec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:11.893360 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4028e71-c008-44e8-8e6e-f7d098429ec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:11.898679 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4028e71-c008-44e8-8e6e-f7d098429ec3 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:11.951965 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 848/1691] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:11 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:12.777288 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98030c3e-cf7c-481c-afc1-1dfdd942e53d None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:12.777860 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98030c3e-cf7c-481c-afc1-1dfdd942e53d None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:12.777860 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98030c3e-cf7c-481c-afc1-1dfdd942e53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:12.855280 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-98030c3e-cf7c-481c-afc1-1dfdd942e53d None None] MFA Rules not processed for user `4e8c9da5c9eb44e79b59f76050389105`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:12.856692 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-98030c3e-cf7c-481c-afc1-1dfdd942e53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:13.080633 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 844/1692] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:12 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:13.081813 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4028e71-c008-44e8-8e6e-f7d098429ec3 service cinder] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:13.266950 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4028e71-c008-44e8-8e6e-f7d098429ec3 service cinder] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:13.300070 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4dcd1-b550-436f-b157-6f9a8dae1547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:13.300764 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4dcd1-b550-436f-b157-6f9a8dae1547 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:13.301053 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4dcd1-b550-436f-b157-6f9a8dae1547 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:13.301334 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4dcd1-b550-436f-b157-6f9a8dae1547 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:13.302054 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4dcd1-b550-436f-b157-6f9a8dae1547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:13.311741 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4dcd1-b550-436f-b157-6f9a8dae1547 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:13.403983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 849/1693] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:04:13 2021] POST /identity/v3/projects => generated 405 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:13.417542 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98030c3e-cf7c-481c-afc1-1dfdd942e53d None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:13.461073 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98030c3e-cf7c-481c-afc1-1dfdd942e53d None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:13.696632 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576adc1-76dc-4045-beea-872fe2d4b126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:13.697690 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576adc1-76dc-4045-beea-872fe2d4b126 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:13.698148 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576adc1-76dc-4045-beea-872fe2d4b126 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:13.698558 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576adc1-76dc-4045-beea-872fe2d4b126 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:13.700212 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576adc1-76dc-4045-beea-872fe2d4b126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:13.706433 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576adc1-76dc-4045-beea-872fe2d4b126 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:13.792377 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4dcd1-b550-436f-b157-6f9a8dae1547 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:13.801140 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 845/1694] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:04:13 2021] POST /identity/v3/users => generated 309 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:13.809003 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4dcd1-b550-436f-b157-6f9a8dae1547 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:13.828200 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f981e31-9d75-426f-a7cf-70ce7e67f3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:13.830438 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f981e31-9d75-426f-a7cf-70ce7e67f3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:13.837127 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f981e31-9d75-426f-a7cf-70ce7e67f3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:13.841810 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f981e31-9d75-426f-a7cf-70ce7e67f3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:13.843437 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f981e31-9d75-426f-a7cf-70ce7e67f3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:13.848592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f981e31-9d75-426f-a7cf-70ce7e67f3e5 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:13.895255 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 850/1695] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:13 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:13.899541 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576adc1-76dc-4045-beea-872fe2d4b126 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:13.918440 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576adc1-76dc-4045-beea-872fe2d4b126 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:13.934296 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ea16a-de40-4631-9d51-2835b6f45bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:13.935396 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ea16a-de40-4631-9d51-2835b6f45bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:13.935725 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ea16a-de40-4631-9d51-2835b6f45bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:13.936049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ea16a-de40-4631-9d51-2835b6f45bbf admin admin] PATH_INFO: `/v3/projects/20e3b04fce88431d83c1fd5be9417f07/users/89c93e8601c444f89d1a8d8049fa776d/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:13.996428 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ea16a-de40-4631-9d51-2835b6f45bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e3b04fce88431d83c1fd5be9417f07, user_id=89c93e8601c444f89d1a8d8049fa776d, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:13.999171 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ea16a-de40-4631-9d51-2835b6f45bbf admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:14.041102 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 846/1696] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:13 2021] PUT /identity/v3/projects/20e3b04fce88431d83c1fd5be9417f07/users/89c93e8601c444f89d1a8d8049fa776d/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:04:14.045066 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f981e31-9d75-426f-a7cf-70ce7e67f3e5 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:14.061527 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f981e31-9d75-426f-a7cf-70ce7e67f3e5 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:14.283724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a5f55-2e42-4dcb-a3d1-149a394f123b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:14.286176 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a5f55-2e42-4dcb-a3d1-149a394f123b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:14.286474 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a5f55-2e42-4dcb-a3d1-149a394f123b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:14.286742 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a5f55-2e42-4dcb-a3d1-149a394f123b admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:14.289710 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a5f55-2e42-4dcb-a3d1-149a394f123b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:14.294427 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a5f55-2e42-4dcb-a3d1-149a394f123b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:14.339384 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 851/1697] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:14 2021] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:14.348962 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ea16a-de40-4631-9d51-2835b6f45bbf admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:14.365259 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ea16a-de40-4631-9d51-2835b6f45bbf admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:14.380846 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006b2da-df17-4f89-baab-845e89d45ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:14.382264 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006b2da-df17-4f89-baab-845e89d45ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:14.382621 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006b2da-df17-4f89-baab-845e89d45ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:14.382901 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006b2da-df17-4f89-baab-845e89d45ca5 admin admin] PATH_INFO: `/v3/projects/20e3b04fce88431d83c1fd5be9417f07/users/89c93e8601c444f89d1a8d8049fa776d/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:14.409448 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006b2da-df17-4f89-baab-845e89d45ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e3b04fce88431d83c1fd5be9417f07, user_id=89c93e8601c444f89d1a8d8049fa776d, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:14.425796 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006b2da-df17-4f89-baab-845e89d45ca5 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:14.479212 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 847/1698] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:14 2021] PUT /identity/v3/projects/20e3b04fce88431d83c1fd5be9417f07/users/89c93e8601c444f89d1a8d8049fa776d/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:14.933584 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc9425-5f7f-4542-8b51-4e63a9bced8f None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:14.933584 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc9425-5f7f-4542-8b51-4e63a9bced8f None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:14.933845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc9425-5f7f-4542-8b51-4e63a9bced8f None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:14.938576 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 852/1699] 10.222.0.39 () {54 vars in 921 bytes} [Tue Aug 31 03:04:14 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:04:14.949991 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb11d45-0f32-4ece-b31f-21fb3181c741 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:14.950585 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb11d45-0f32-4ece-b31f-21fb3181c741 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:14.950585 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb11d45-0f32-4ece-b31f-21fb3181c741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:14.994456 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-5eb11d45-0f32-4ece-b31f-21fb3181c741 None None] MFA Rules not processed for user `a6bb852fc4394f88800ec9616cb65416`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:14.997380 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-5eb11d45-0f32-4ece-b31f-21fb3181c741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:15.111119 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 848/1700] 10.222.0.39 () {58 vars in 1019 bytes} [Tue Aug 31 03:04:14 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:15.219653 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc9425-5f7f-4542-8b51-4e63a9bced8f None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:15.221840 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a7dc9425-5f7f-4542-8b51-4e63a9bced8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:15.227137 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be5d0-78f9-4946-bb4d-b916367b97e5 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:15.227465 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be5d0-78f9-4946-bb4d-b916367b97e5 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:15.227747 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be5d0-78f9-4946-bb4d-b916367b97e5 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:15.230466 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 849/1701] 10.222.0.39 () {54 vars in 921 bytes} [Tue Aug 31 03:04:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:04:15.241907 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d7942-ba05-49a4-b503-080bac6fb6f7 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:15.242398 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d7942-ba05-49a4-b503-080bac6fb6f7 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:15.242821 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d7942-ba05-49a4-b503-080bac6fb6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:15.255862 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc9425-5f7f-4542-8b51-4e63a9bced8f None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:15.267729 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46866e0e-7d0b-4957-b19f-c29a7335b347 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:15.268822 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46866e0e-7d0b-4957-b19f-c29a7335b347 service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:15.269334 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46866e0e-7d0b-4957-b19f-c29a7335b347 service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:15.269758 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46866e0e-7d0b-4957-b19f-c29a7335b347 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:15.289054 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-751d7942-ba05-49a4-b503-080bac6fb6f7 None None] MFA Rules not processed for user `a6bb852fc4394f88800ec9616cb65416`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:15.290420 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-751d7942-ba05-49a4-b503-080bac6fb6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:15.296081 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46866e0e-7d0b-4957-b19f-c29a7335b347 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:15.300799 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46866e0e-7d0b-4957-b19f-c29a7335b347 service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:15.315837 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 853/1702] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:15 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:15.327774 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 850/1703] 10.222.0.39 () {58 vars in 1019 bytes} [Tue Aug 31 03:04:15 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:04:15.526385 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46866e0e-7d0b-4957-b19f-c29a7335b347 service nova] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:15.548812 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46866e0e-7d0b-4957-b19f-c29a7335b347 service nova] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:15.556881 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f20a1a-b34e-4e02-9df1-6ce772cb630b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:15.558127 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f20a1a-b34e-4e02-9df1-6ce772cb630b service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:15.558617 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f20a1a-b34e-4e02-9df1-6ce772cb630b service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:15.559123 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f20a1a-b34e-4e02-9df1-6ce772cb630b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:15.571316 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f20a1a-b34e-4e02-9df1-6ce772cb630b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:15.574356 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f20a1a-b34e-4e02-9df1-6ce772cb630b service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:15.612792 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 854/1704] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:15 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:15.849334 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacae8f-d4f9-4ea6-b704-2a84c81d81d2 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:15.849846 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacae8f-d4f9-4ea6-b704-2a84c81d81d2 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:15.850363 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacae8f-d4f9-4ea6-b704-2a84c81d81d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:15.925330 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-bbacae8f-d4f9-4ea6-b704-2a84c81d81d2 None None] MFA Rules not processed for user `562353a14c284dcda0f7fdba85a418ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:15.926539 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-bbacae8f-d4f9-4ea6-b704-2a84c81d81d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:16.025863 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 851/1705] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:15 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:16.044861 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f20a1a-b34e-4e02-9df1-6ce772cb630b service nova] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:16.057023 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f20a1a-b34e-4e02-9df1-6ce772cb630b service nova] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:16.065137 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dc740-a402-4d39-99c7-7d7d937fb187 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:16.065811 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dc740-a402-4d39-99c7-7d7d937fb187 service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:16.066272 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dc740-a402-4d39-99c7-7d7d937fb187 service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:16.066549 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dc740-a402-4d39-99c7-7d7d937fb187 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:16.077655 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dc740-a402-4d39-99c7-7d7d937fb187 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:16.079695 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dc740-a402-4d39-99c7-7d7d937fb187 service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:16.106432 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 855/1706] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:16 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:04:16.859241 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4278e7d-2725-4954-89d6-1ba5aff7e973 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:16.860009 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4278e7d-2725-4954-89d6-1ba5aff7e973 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:16.860447 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4278e7d-2725-4954-89d6-1ba5aff7e973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:16.910787 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-a4278e7d-2725-4954-89d6-1ba5aff7e973 None None] MFA Rules not processed for user `89c93e8601c444f89d1a8d8049fa776d`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:16.913677 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a4278e7d-2725-4954-89d6-1ba5aff7e973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:17.072308 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 852/1707] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:16 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:04:19.640973 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803cc7b-7dbc-4740-b8d7-0a1d68e4c442 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:19.641456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803cc7b-7dbc-4740-b8d7-0a1d68e4c442 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:19.641665 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803cc7b-7dbc-4740-b8d7-0a1d68e4c442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:19.666236 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-8803cc7b-7dbc-4740-b8d7-0a1d68e4c442 None None] MFA Rules not processed for user `562353a14c284dcda0f7fdba85a418ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:19.667578 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-8803cc7b-7dbc-4740-b8d7-0a1d68e4c442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:19.675395 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 856/1708] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:19 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:19.818288 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4278e7d-2725-4954-89d6-1ba5aff7e973 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:19.940505 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4278e7d-2725-4954-89d6-1ba5aff7e973 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:19.947203 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c1795-6bd5-4dcc-96f2-347b3528322f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:19.948838 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c1795-6bd5-4dcc-96f2-347b3528322f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:19.948838 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c1795-6bd5-4dcc-96f2-347b3528322f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:19.948838 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c1795-6bd5-4dcc-96f2-347b3528322f admin admin] PATH_INFO: `/v3/users/4e8c9da5c9eb44e79b59f76050389105` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:19.952202 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c1795-6bd5-4dcc-96f2-347b3528322f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8c9da5c9eb44e79b59f76050389105)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:19.955424 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c1795-6bd5-4dcc-96f2-347b3528322f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:20.017738 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-874c1795-6bd5-4dcc-96f2-347b3528322f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8c9da5c9eb44e79b59f76050389105'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:20.047611 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-874c1795-6bd5-4dcc-96f2-347b3528322f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8c9da5c9eb44e79b59f76050389105'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:20.048474 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-874c1795-6bd5-4dcc-96f2-347b3528322f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8c9da5c9eb44e79b59f76050389105'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:20.058991 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-874c1795-6bd5-4dcc-96f2-347b3528322f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8c9da5c9eb44e79b59f76050389105'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:20.071287 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-874c1795-6bd5-4dcc-96f2-347b3528322f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8c9da5c9eb44e79b59f76050389105'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:20.079469 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 853/1709] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:04:19 2021] DELETE /identity/v3/users/4e8c9da5c9eb44e79b59f76050389105 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:20.392996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803cc7b-7dbc-4740-b8d7-0a1d68e4c442 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:20.413186 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803cc7b-7dbc-4740-b8d7-0a1d68e4c442 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:20.481859 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff24e6-7931-44b3-9953-c5c2165ad54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:20.482728 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff24e6-7931-44b3-9953-c5c2165ad54f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:20.483009 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff24e6-7931-44b3-9953-c5c2165ad54f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:20.483282 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff24e6-7931-44b3-9953-c5c2165ad54f admin admin] PATH_INFO: `/v3/projects/d15e58bb98b14b0293713d923f684a59` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:20.484686 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff24e6-7931-44b3-9953-c5c2165ad54f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d15e58bb98b14b0293713d923f684a59)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:20.486932 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff24e6-7931-44b3-9953-c5c2165ad54f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:20.539632 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-28ff24e6-7931-44b3-9953-c5c2165ad54f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd15e58bb98b14b0293713d923f684a59', 'request_id': 'req-28ff24e6-7931-44b3-9953-c5c2165ad54f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:20.547537 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-28ff24e6-7931-44b3-9953-c5c2165ad54f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd15e58bb98b14b0293713d923f684a59', 'request_id': 'req-28ff24e6-7931-44b3-9953-c5c2165ad54f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:20.552979 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-28ff24e6-7931-44b3-9953-c5c2165ad54f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd15e58bb98b14b0293713d923f684a59', 'request_id': 'req-28ff24e6-7931-44b3-9953-c5c2165ad54f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:20.565796 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-28ff24e6-7931-44b3-9953-c5c2165ad54f admin admin] The token cache is being invalidate because project d15e58bb98b14b0293713d923f684a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:04:20.566072 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-28ff24e6-7931-44b3-9953-c5c2165ad54f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:20.566733 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-28ff24e6-7931-44b3-9953-c5c2165ad54f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:20.571954 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 857/1710] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:04:20 2021] DELETE /identity/v3/projects/d15e58bb98b14b0293713d923f684a59 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:20.574972 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c1795-6bd5-4dcc-96f2-347b3528322f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:20.576446 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-874c1795-6bd5-4dcc-96f2-347b3528322f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:20.593425 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c1795-6bd5-4dcc-96f2-347b3528322f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:20.674476 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71255b-ef9c-4c3a-be8b-b6d6739ea7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:20.675376 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71255b-ef9c-4c3a-be8b-b6d6739ea7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:20.675671 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71255b-ef9c-4c3a-be8b-b6d6739ea7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:20.675944 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71255b-ef9c-4c3a-be8b-b6d6739ea7e0 admin admin] PATH_INFO: `/v3/users/89c93e8601c444f89d1a8d8049fa776d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:20.677392 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71255b-ef9c-4c3a-be8b-b6d6739ea7e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89c93e8601c444f89d1a8d8049fa776d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:20.679348 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71255b-ef9c-4c3a-be8b-b6d6739ea7e0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:20.740629 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5b71255b-ef9c-4c3a-be8b-b6d6739ea7e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89c93e8601c444f89d1a8d8049fa776d'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:20.760058 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5b71255b-ef9c-4c3a-be8b-b6d6739ea7e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89c93e8601c444f89d1a8d8049fa776d'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:20.760837 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5b71255b-ef9c-4c3a-be8b-b6d6739ea7e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89c93e8601c444f89d1a8d8049fa776d'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:20.768845 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5b71255b-ef9c-4c3a-be8b-b6d6739ea7e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89c93e8601c444f89d1a8d8049fa776d'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:20.778492 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5b71255b-ef9c-4c3a-be8b-b6d6739ea7e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89c93e8601c444f89d1a8d8049fa776d'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:20.785844 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 854/1711] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:04:20 2021] DELETE /identity/v3/users/89c93e8601c444f89d1a8d8049fa776d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:20.982962 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff24e6-7931-44b3-9953-c5c2165ad54f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:20.985175 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-28ff24e6-7931-44b3-9953-c5c2165ad54f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:21.019351 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff24e6-7931-44b3-9953-c5c2165ad54f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:21.075087 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317d0fb-7211-45fb-8566-16c6626efb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:21.075981 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317d0fb-7211-45fb-8566-16c6626efb03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:21.076264 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317d0fb-7211-45fb-8566-16c6626efb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:21.076539 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317d0fb-7211-45fb-8566-16c6626efb03 admin admin] PATH_INFO: `/v3/projects/20e3b04fce88431d83c1fd5be9417f07` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:21.077730 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317d0fb-7211-45fb-8566-16c6626efb03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e3b04fce88431d83c1fd5be9417f07)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:21.079660 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317d0fb-7211-45fb-8566-16c6626efb03 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:21.122984 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a317d0fb-7211-45fb-8566-16c6626efb03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e3b04fce88431d83c1fd5be9417f07', 'request_id': 'req-a317d0fb-7211-45fb-8566-16c6626efb03'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:21.129317 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a317d0fb-7211-45fb-8566-16c6626efb03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e3b04fce88431d83c1fd5be9417f07', 'request_id': 'req-a317d0fb-7211-45fb-8566-16c6626efb03'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:21.134616 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a317d0fb-7211-45fb-8566-16c6626efb03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e3b04fce88431d83c1fd5be9417f07', 'request_id': 'req-a317d0fb-7211-45fb-8566-16c6626efb03'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:21.145787 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a317d0fb-7211-45fb-8566-16c6626efb03 admin admin] The token cache is being invalidate because project 20e3b04fce88431d83c1fd5be9417f07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:04:21.146076 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a317d0fb-7211-45fb-8566-16c6626efb03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:21.146729 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a317d0fb-7211-45fb-8566-16c6626efb03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:21.148332 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 858/1712] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:04:20 2021] DELETE /identity/v3/projects/20e3b04fce88431d83c1fd5be9417f07 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:04:21.156301 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee52a24-dea6-4e75-9d2a-0128e0db4a94 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:21.156790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee52a24-dea6-4e75-9d2a-0128e0db4a94 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:21.156886 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee52a24-dea6-4e75-9d2a-0128e0db4a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:21.176870 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-bee52a24-dea6-4e75-9d2a-0128e0db4a94 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:21.178106 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-bee52a24-dea6-4e75-9d2a-0128e0db4a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:21.239067 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 855/1713] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:21.246615 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc695b3-4116-44b4-9242-2654031374d7 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:21.247113 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc695b3-4116-44b4-9242-2654031374d7 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:21.247587 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc695b3-4116-44b4-9242-2654031374d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:21.275354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-4bc695b3-4116-44b4-9242-2654031374d7 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:21.276746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-4bc695b3-4116-44b4-9242-2654031374d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:21.284845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 859/1714] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:04:21.289041 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee52a24-dea6-4e75-9d2a-0128e0db4a94 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:21.309542 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee52a24-dea6-4e75-9d2a-0128e0db4a94 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:21.314859 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fba170-cfc0-4bd3-832f-a84c55934a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:21.315565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fba170-cfc0-4bd3-832f-a84c55934a14 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:21.315887 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fba170-cfc0-4bd3-832f-a84c55934a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:21.316250 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fba170-cfc0-4bd3-832f-a84c55934a14 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:21.317094 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fba170-cfc0-4bd3-832f-a84c55934a14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:04:21.317427 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fba170-cfc0-4bd3-832f-a84c55934a14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:21.319185 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fba170-cfc0-4bd3-832f-a84c55934a14 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:21.333220 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 856/1715] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:04:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:04:21.337863 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc695b3-4116-44b4-9242-2654031374d7 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:21.348498 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc695b3-4116-44b4-9242-2654031374d7 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:21.364906 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c3fe6-24aa-4e6f-80a6-055496b574f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:21.365604 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c3fe6-24aa-4e6f-80a6-055496b574f4 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:21.365888 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c3fe6-24aa-4e6f-80a6-055496b574f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:21.366164 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c3fe6-24aa-4e6f-80a6-055496b574f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:21.366900 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c3fe6-24aa-4e6f-80a6-055496b574f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:21.369540 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c3fe6-24aa-4e6f-80a6-055496b574f4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:21.396803 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 860/1716] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:04:21 2021] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:21.401307 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fba170-cfc0-4bd3-832f-a84c55934a14 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:21.412826 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fba170-cfc0-4bd3-832f-a84c55934a14 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:21.512376 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41266b2f-471b-431a-8055-a939579cf3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:21.513074 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41266b2f-471b-431a-8055-a939579cf3a7 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:21.513365 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41266b2f-471b-431a-8055-a939579cf3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:21.513691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41266b2f-471b-431a-8055-a939579cf3a7 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:21.514382 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41266b2f-471b-431a-8055-a939579cf3a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:21.517125 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41266b2f-471b-431a-8055-a939579cf3a7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:21.540014 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 857/1717] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:04:21 2021] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:21.544280 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c3fe6-24aa-4e6f-80a6-055496b574f4 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:21.554627 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c3fe6-24aa-4e6f-80a6-055496b574f4 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:21.559512 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d6b83-5881-473b-ba56-168dbff51592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:21.560169 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d6b83-5881-473b-ba56-168dbff51592 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:21.560452 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d6b83-5881-473b-ba56-168dbff51592 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:21.560727 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d6b83-5881-473b-ba56-168dbff51592 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:21.561445 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d6b83-5881-473b-ba56-168dbff51592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:21.563035 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d6b83-5881-473b-ba56-168dbff51592 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:21.580306 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 861/1718] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:21 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:04:21.584143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41266b2f-471b-431a-8055-a939579cf3a7 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:21.595771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41266b2f-471b-431a-8055-a939579cf3a7 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:21.600842 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cfe1d-6a88-4216-bc11-8f5941342976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:21.601518 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cfe1d-6a88-4216-bc11-8f5941342976 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:21.601805 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cfe1d-6a88-4216-bc11-8f5941342976 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:21.602075 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cfe1d-6a88-4216-bc11-8f5941342976 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:21.602899 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386cfe1d-6a88-4216-bc11-8f5941342976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:21.604585 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386cfe1d-6a88-4216-bc11-8f5941342976 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:21.615045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 858/1719] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:21 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:21.619665 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d6b83-5881-473b-ba56-168dbff51592 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:21.630031 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d6b83-5881-473b-ba56-168dbff51592 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:21.635491 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ce9c9-357d-4f14-bb60-0f6e4ea653c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:21.636643 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ce9c9-357d-4f14-bb60-0f6e4ea653c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:21.636929 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ce9c9-357d-4f14-bb60-0f6e4ea653c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:21.637208 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ce9c9-357d-4f14-bb60-0f6e4ea653c3 admin admin] PATH_INFO: `/v3/projects/7877d317eb2f4fc1ab79b2734c63deda/users/d703f54f78934643bf6f23df49a5f2d4/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:21.661519 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ce9c9-357d-4f14-bb60-0f6e4ea653c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7877d317eb2f4fc1ab79b2734c63deda, user_id=d703f54f78934643bf6f23df49a5f2d4, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:21.664237 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ce9c9-357d-4f14-bb60-0f6e4ea653c3 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:21.687403 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 862/1720] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:21 2021] PUT /identity/v3/projects/7877d317eb2f4fc1ab79b2734c63deda/users/d703f54f78934643bf6f23df49a5f2d4/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:04:21.695006 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87205a34-c6b5-4f3e-9299-9c5d0ebb0236 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:21.695461 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87205a34-c6b5-4f3e-9299-9c5d0ebb0236 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:21.695740 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87205a34-c6b5-4f3e-9299-9c5d0ebb0236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:21.726427 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-87205a34-c6b5-4f3e-9299-9c5d0ebb0236 None None] MFA Rules not processed for user `d703f54f78934643bf6f23df49a5f2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:21.729043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-87205a34-c6b5-4f3e-9299-9c5d0ebb0236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:21.811595 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 859/1721] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:21 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:04:21.816501 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ce9c9-357d-4f14-bb60-0f6e4ea653c3 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:21.889074 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ce9c9-357d-4f14-bb60-0f6e4ea653c3 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:21.893770 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414d12a-4946-4593-99e6-f1ee7e520412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:21.894435 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414d12a-4946-4593-99e6-f1ee7e520412 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:21.894722 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414d12a-4946-4593-99e6-f1ee7e520412 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:21.895002 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414d12a-4946-4593-99e6-f1ee7e520412 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:21.895726 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414d12a-4946-4593-99e6-f1ee7e520412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:21.897629 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414d12a-4946-4593-99e6-f1ee7e520412 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:21.934513 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 863/1722] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:04:21 2021] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:04:21.936594 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87205a34-c6b5-4f3e-9299-9c5d0ebb0236 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:21.957307 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87205a34-c6b5-4f3e-9299-9c5d0ebb0236 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:22.013157 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414d12a-4946-4593-99e6-f1ee7e520412 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:22.015019 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-e414d12a-4946-4593-99e6-f1ee7e520412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:22.027536 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b665f0-df8e-4cda-9a55-a94b2c93ca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:22.028254 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b665f0-df8e-4cda-9a55-a94b2c93ca52 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:22.031430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b665f0-df8e-4cda-9a55-a94b2c93ca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:22.031430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b665f0-df8e-4cda-9a55-a94b2c93ca52 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:22.031430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b665f0-df8e-4cda-9a55-a94b2c93ca52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:22.031430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b665f0-df8e-4cda-9a55-a94b2c93ca52 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:22.054490 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 860/1723] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:04:21 2021] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:22.058887 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b665f0-df8e-4cda-9a55-a94b2c93ca52 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:22.068684 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b665f0-df8e-4cda-9a55-a94b2c93ca52 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:22.073464 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed2117-d599-4238-922a-6f6fe8989c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:22.074208 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed2117-d599-4238-922a-6f6fe8989c4c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:22.074664 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed2117-d599-4238-922a-6f6fe8989c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:22.074915 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed2117-d599-4238-922a-6f6fe8989c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:22.075950 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed2117-d599-4238-922a-6f6fe8989c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:22.079407 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed2117-d599-4238-922a-6f6fe8989c4c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:22.087008 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414d12a-4946-4593-99e6-f1ee7e520412 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:22.087869 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 861/1724] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:22 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:22.091664 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee261af-3491-4979-8f16-1f2719d598a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:22.091999 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed2117-d599-4238-922a-6f6fe8989c4c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:22.092309 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee261af-3491-4979-8f16-1f2719d598a7 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:22.092589 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee261af-3491-4979-8f16-1f2719d598a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:22.092859 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee261af-3491-4979-8f16-1f2719d598a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:22.094631 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-cee261af-3491-4979-8f16-1f2719d598a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:22.102122 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed2117-d599-4238-922a-6f6fe8989c4c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:22.107928 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9e4f9-d5e7-45e8-a333-4e6f8a36022f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:22.109023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9e4f9-d5e7-45e8-a333-4e6f8a36022f admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:22.109384 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9e4f9-d5e7-45e8-a333-4e6f8a36022f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:22.109733 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9e4f9-d5e7-45e8-a333-4e6f8a36022f admin admin] PATH_INFO: `/v3/projects/804a3aaa73aa410aaa34b3a9da5bafe2/users/60a45d8701674aad8b982ced0a9005b9/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:22.125866 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9e4f9-d5e7-45e8-a333-4e6f8a36022f admin admin] RBAC: Authorizing `identity:create_grant(project_id=804a3aaa73aa410aaa34b3a9da5bafe2, user_id=60a45d8701674aad8b982ced0a9005b9, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:22.128999 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9e4f9-d5e7-45e8-a333-4e6f8a36022f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:22.142785 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 862/1725] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:22 2021] PUT /identity/v3/projects/804a3aaa73aa410aaa34b3a9da5bafe2/users/60a45d8701674aad8b982ced0a9005b9/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:04:22.148152 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9e4f9-d5e7-45e8-a333-4e6f8a36022f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:22.168818 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee261af-3491-4979-8f16-1f2719d598a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:22.170257 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee261af-3491-4979-8f16-1f2719d598a7 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:22.183653 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 864/1726] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:22 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:04:22.226031 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9e4f9-d5e7-45e8-a333-4e6f8a36022f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:22.234450 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c11509-4063-4802-9c58-d55f65384f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:22.235202 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c11509-4063-4802-9c58-d55f65384f46 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:22.235609 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c11509-4063-4802-9c58-d55f65384f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:22.235953 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c11509-4063-4802-9c58-d55f65384f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:22.236697 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c11509-4063-4802-9c58-d55f65384f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:22.239462 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c11509-4063-4802-9c58-d55f65384f46 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:22.267009 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 863/1727] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:22 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:04:22.270611 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee261af-3491-4979-8f16-1f2719d598a7 service cinder] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:22.282911 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee261af-3491-4979-8f16-1f2719d598a7 service cinder] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:22.292094 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62c1d1-a0b7-4840-a12c-cde07d91fb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:22.293043 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62c1d1-a0b7-4840-a12c-cde07d91fb9f admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:22.293326 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62c1d1-a0b7-4840-a12c-cde07d91fb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:22.293602 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62c1d1-a0b7-4840-a12c-cde07d91fb9f admin admin] PATH_INFO: `/v3/projects/804a3aaa73aa410aaa34b3a9da5bafe2/users/60a45d8701674aad8b982ced0a9005b9/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:22.297919 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62c1d1-a0b7-4840-a12c-cde07d91fb9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=804a3aaa73aa410aaa34b3a9da5bafe2, user_id=60a45d8701674aad8b982ced0a9005b9, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:22.302191 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62c1d1-a0b7-4840-a12c-cde07d91fb9f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:22.316408 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 865/1728] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:22 2021] PUT /identity/v3/projects/804a3aaa73aa410aaa34b3a9da5bafe2/users/60a45d8701674aad8b982ced0a9005b9/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:22.327917 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517c974-9de8-4e71-b071-260fed6f75f1 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:22.327917 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517c974-9de8-4e71-b071-260fed6f75f1 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:22.328202 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517c974-9de8-4e71-b071-260fed6f75f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:22.389071 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-3517c974-9de8-4e71-b071-260fed6f75f1 None None] MFA Rules not processed for user `60a45d8701674aad8b982ced0a9005b9`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:22.393216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-3517c974-9de8-4e71-b071-260fed6f75f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:22.596687 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 864/1729] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:22 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:22.637854 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62c1d1-a0b7-4840-a12c-cde07d91fb9f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:22.639908 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-ad62c1d1-a0b7-4840-a12c-cde07d91fb9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:22.810621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62c1d1-a0b7-4840-a12c-cde07d91fb9f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:22.820083 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca85272-fb74-4720-b086-2babebf4b47c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:22.820743 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca85272-fb74-4720-b086-2babebf4b47c service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:22.821025 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca85272-fb74-4720-b086-2babebf4b47c service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:22.821299 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca85272-fb74-4720-b086-2babebf4b47c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:22.841140 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca85272-fb74-4720-b086-2babebf4b47c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:22.842615 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca85272-fb74-4720-b086-2babebf4b47c service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:22.865290 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 866/1730] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:22 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:04:23.994583 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517c974-9de8-4e71-b071-260fed6f75f1 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:24.146325 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517c974-9de8-4e71-b071-260fed6f75f1 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:24.155479 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfd366-6568-4334-80ba-9ba79ef16003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:24.156369 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfd366-6568-4334-80ba-9ba79ef16003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:24.158209 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfd366-6568-4334-80ba-9ba79ef16003 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:24.158516 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfd366-6568-4334-80ba-9ba79ef16003 admin admin] PATH_INFO: `/v3/users/d703f54f78934643bf6f23df49a5f2d4` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:24.166181 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfd366-6568-4334-80ba-9ba79ef16003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d703f54f78934643bf6f23df49a5f2d4)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:24.168173 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfd366-6568-4334-80ba-9ba79ef16003 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:24.280045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-9bdfd366-6568-4334-80ba-9ba79ef16003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd703f54f78934643bf6f23df49a5f2d4'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:24.299389 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-9bdfd366-6568-4334-80ba-9ba79ef16003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd703f54f78934643bf6f23df49a5f2d4'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:24.300139 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-9bdfd366-6568-4334-80ba-9ba79ef16003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd703f54f78934643bf6f23df49a5f2d4'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:24.312451 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-9bdfd366-6568-4334-80ba-9ba79ef16003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd703f54f78934643bf6f23df49a5f2d4'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:24.329957 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-9bdfd366-6568-4334-80ba-9ba79ef16003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd703f54f78934643bf6f23df49a5f2d4'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:24.344771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 865/1731] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:04:23 2021] DELETE /identity/v3/users/d703f54f78934643bf6f23df49a5f2d4 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:24.346522 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d2bd0-f15c-4bd8-bf30-b00e7c7f41ef None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:24.346965 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d2bd0-f15c-4bd8-bf30-b00e7c7f41ef None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:24.347116 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d2bd0-f15c-4bd8-bf30-b00e7c7f41ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:24.395197 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-b95d2bd0-f15c-4bd8-bf30-b00e7c7f41ef None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:24.396924 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b95d2bd0-f15c-4bd8-bf30-b00e7c7f41ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:24.483110 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 867/1732] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:04:24.518117 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfd366-6568-4334-80ba-9ba79ef16003 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:24.519942 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-9bdfd366-6568-4334-80ba-9ba79ef16003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:24.621612 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfd366-6568-4334-80ba-9ba79ef16003 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:24.627214 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9b2d0-2cae-462f-b68f-23e7b4965261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:24.629111 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9b2d0-2cae-462f-b68f-23e7b4965261 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:24.629593 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9b2d0-2cae-462f-b68f-23e7b4965261 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:24.630077 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9b2d0-2cae-462f-b68f-23e7b4965261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:24.647984 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9b2d0-2cae-462f-b68f-23e7b4965261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:24.663860 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9b2d0-2cae-462f-b68f-23e7b4965261 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:24.687106 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 866/1733] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:25.595133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d2bd0-f15c-4bd8-bf30-b00e7c7f41ef None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:25.598916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b95d2bd0-f15c-4bd8-bf30-b00e7c7f41ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:25.617237 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d2bd0-f15c-4bd8-bf30-b00e7c7f41ef None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:25.632111 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00130f52-628c-430a-9a31-1fe2316edb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:25.633319 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00130f52-628c-430a-9a31-1fe2316edb22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:25.633673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00130f52-628c-430a-9a31-1fe2316edb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:25.634099 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00130f52-628c-430a-9a31-1fe2316edb22 admin admin] PATH_INFO: `/v3/users/d9b42298908542d7a6428330c0525e3f` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:25.635777 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00130f52-628c-430a-9a31-1fe2316edb22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9b42298908542d7a6428330c0525e3f)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:25.638003 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00130f52-628c-430a-9a31-1fe2316edb22 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:25.712744 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-00130f52-628c-430a-9a31-1fe2316edb22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9b42298908542d7a6428330c0525e3f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:25.713745 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-00130f52-628c-430a-9a31-1fe2316edb22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9b42298908542d7a6428330c0525e3f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:25.714791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-00130f52-628c-430a-9a31-1fe2316edb22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9b42298908542d7a6428330c0525e3f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:25.736149 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-00130f52-628c-430a-9a31-1fe2316edb22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9b42298908542d7a6428330c0525e3f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:25.746451 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-00130f52-628c-430a-9a31-1fe2316edb22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9b42298908542d7a6428330c0525e3f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:25.763716 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 868/1734] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:04:25 2021] DELETE /identity/v3/users/d9b42298908542d7a6428330c0525e3f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:25.767987 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c6d55-107f-4f8f-9aa5-349e92ccfa28 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:25.768460 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c6d55-107f-4f8f-9aa5-349e92ccfa28 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:25.768535 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c6d55-107f-4f8f-9aa5-349e92ccfa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:25.788770 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-1f7c6d55-107f-4f8f-9aa5-349e92ccfa28 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:25.790479 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-1f7c6d55-107f-4f8f-9aa5-349e92ccfa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:25.874550 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 867/1735] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:25.893663 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00130f52-628c-430a-9a31-1fe2316edb22 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:25.895517 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-00130f52-628c-430a-9a31-1fe2316edb22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:25.926774 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c6d55-107f-4f8f-9aa5-349e92ccfa28 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:25.932165 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-1f7c6d55-107f-4f8f-9aa5-349e92ccfa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:25.957553 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c6d55-107f-4f8f-9aa5-349e92ccfa28 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:25.966012 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8355b-0263-451c-8bb4-f3fdbfaeb678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:25.966891 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8355b-0263-451c-8bb4-f3fdbfaeb678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:25.967174 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8355b-0263-451c-8bb4-f3fdbfaeb678 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:25.967513 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8355b-0263-451c-8bb4-f3fdbfaeb678 admin admin] PATH_INFO: `/v3/projects/7877d317eb2f4fc1ab79b2734c63deda` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:25.972217 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8355b-0263-451c-8bb4-f3fdbfaeb678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7877d317eb2f4fc1ab79b2734c63deda)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:25.974159 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8355b-0263-451c-8bb4-f3fdbfaeb678 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:25.992364 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00130f52-628c-430a-9a31-1fe2316edb22 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:25.999712 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57514b-0e57-40ee-a45b-bc5a3bb8d784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:26.000564 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57514b-0e57-40ee-a45b-bc5a3bb8d784 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:26.001068 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57514b-0e57-40ee-a45b-bc5a3bb8d784 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:26.001486 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57514b-0e57-40ee-a45b-bc5a3bb8d784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:26.032521 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57514b-0e57-40ee-a45b-bc5a3bb8d784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:26.033892 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57514b-0e57-40ee-a45b-bc5a3bb8d784 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:26.060280 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 869/1736] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:26.085000 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c8f8355b-0263-451c-8bb4-f3fdbfaeb678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7877d317eb2f4fc1ab79b2734c63deda', 'request_id': 'req-c8f8355b-0263-451c-8bb4-f3fdbfaeb678'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:26.089143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c8f8355b-0263-451c-8bb4-f3fdbfaeb678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7877d317eb2f4fc1ab79b2734c63deda', 'request_id': 'req-c8f8355b-0263-451c-8bb4-f3fdbfaeb678'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:26.101426 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c8f8355b-0263-451c-8bb4-f3fdbfaeb678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7877d317eb2f4fc1ab79b2734c63deda', 'request_id': 'req-c8f8355b-0263-451c-8bb4-f3fdbfaeb678'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:26.123643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c8f8355b-0263-451c-8bb4-f3fdbfaeb678 admin admin] The token cache is being invalidate because project 7877d317eb2f4fc1ab79b2734c63deda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:04:26.123952 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c8f8355b-0263-451c-8bb4-f3fdbfaeb678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:26.124611 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c8f8355b-0263-451c-8bb4-f3fdbfaeb678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:26.126660 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 868/1737] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:04:25 2021] DELETE /identity/v3/projects/7877d317eb2f4fc1ab79b2734c63deda => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:26.130945 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57514b-0e57-40ee-a45b-bc5a3bb8d784 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:26.143798 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57514b-0e57-40ee-a45b-bc5a3bb8d784 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:26.210281 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7b87a-c0b7-438b-b016-d62bc7007c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:26.211194 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7b87a-c0b7-438b-b016-d62bc7007c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:26.211503 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7b87a-c0b7-438b-b016-d62bc7007c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:26.212533 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7b87a-c0b7-438b-b016-d62bc7007c1b admin admin] PATH_INFO: `/v3/users/60a45d8701674aad8b982ced0a9005b9` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:26.214031 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7b87a-c0b7-438b-b016-d62bc7007c1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=60a45d8701674aad8b982ced0a9005b9)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:26.216163 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7b87a-c0b7-438b-b016-d62bc7007c1b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:26.277689 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-61c7b87a-c0b7-438b-b016-d62bc7007c1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60a45d8701674aad8b982ced0a9005b9'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:26.278467 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-61c7b87a-c0b7-438b-b016-d62bc7007c1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60a45d8701674aad8b982ced0a9005b9'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:26.279201 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-61c7b87a-c0b7-438b-b016-d62bc7007c1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60a45d8701674aad8b982ced0a9005b9'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:26.293901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-61c7b87a-c0b7-438b-b016-d62bc7007c1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60a45d8701674aad8b982ced0a9005b9'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:26.302003 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-61c7b87a-c0b7-438b-b016-d62bc7007c1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60a45d8701674aad8b982ced0a9005b9'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:26.316891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 870/1738] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:04:26 2021] DELETE /identity/v3/users/60a45d8701674aad8b982ced0a9005b9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:04:27.554974 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8355b-0263-451c-8bb4-f3fdbfaeb678 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:27.557576 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c8f8355b-0263-451c-8bb4-f3fdbfaeb678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:27.574892 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8355b-0263-451c-8bb4-f3fdbfaeb678 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:27.703465 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56e079-2c43-4ce1-b589-f8671cc37741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:27.704844 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56e079-2c43-4ce1-b589-f8671cc37741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:27.705131 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56e079-2c43-4ce1-b589-f8671cc37741 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:27.705423 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56e079-2c43-4ce1-b589-f8671cc37741 admin admin] PATH_INFO: `/v3/projects/4cc80741ea8247689e3ef518b108ec95` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:27.715238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56e079-2c43-4ce1-b589-f8671cc37741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc80741ea8247689e3ef518b108ec95)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:27.715238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56e079-2c43-4ce1-b589-f8671cc37741 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:27.789106 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7b87a-c0b7-438b-b016-d62bc7007c1b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:27.791427 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-61c7b87a-c0b7-438b-b016-d62bc7007c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:27.802070 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-cd56e079-2c43-4ce1-b589-f8671cc37741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc80741ea8247689e3ef518b108ec95', 'request_id': 'req-cd56e079-2c43-4ce1-b589-f8671cc37741'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:27.809638 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7b87a-c0b7-438b-b016-d62bc7007c1b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:27.809929 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-cd56e079-2c43-4ce1-b589-f8671cc37741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc80741ea8247689e3ef518b108ec95', 'request_id': 'req-cd56e079-2c43-4ce1-b589-f8671cc37741'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:27.830296 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-cd56e079-2c43-4ce1-b589-f8671cc37741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc80741ea8247689e3ef518b108ec95', 'request_id': 'req-cd56e079-2c43-4ce1-b589-f8671cc37741'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:27.860554 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-cd56e079-2c43-4ce1-b589-f8671cc37741 admin admin] The token cache is being invalidate because project 4cc80741ea8247689e3ef518b108ec95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:04:27.860979 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-cd56e079-2c43-4ce1-b589-f8671cc37741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:27.861736 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-cd56e079-2c43-4ce1-b589-f8671cc37741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:27.867233 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 869/1739] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:04:27 2021] DELETE /identity/v3/projects/4cc80741ea8247689e3ef518b108ec95 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:27.868795 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56e079-2c43-4ce1-b589-f8671cc37741 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:27.870430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-cd56e079-2c43-4ce1-b589-f8671cc37741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:27.929690 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab18d17-2a2e-4f3d-801e-108ae7ddce07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:27.933543 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab18d17-2a2e-4f3d-801e-108ae7ddce07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:27.934414 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab18d17-2a2e-4f3d-801e-108ae7ddce07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:27.934915 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab18d17-2a2e-4f3d-801e-108ae7ddce07 admin admin] PATH_INFO: `/v3/projects/804a3aaa73aa410aaa34b3a9da5bafe2` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:27.936604 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab18d17-2a2e-4f3d-801e-108ae7ddce07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=804a3aaa73aa410aaa34b3a9da5bafe2)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:27.938754 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab18d17-2a2e-4f3d-801e-108ae7ddce07 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:27.984189 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56e079-2c43-4ce1-b589-f8671cc37741 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:27.990509 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2947015-1955-4ed3-a18c-23e16fcdd214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:27.991571 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2947015-1955-4ed3-a18c-23e16fcdd214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:27.992033 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2947015-1955-4ed3-a18c-23e16fcdd214 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:27.992896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2947015-1955-4ed3-a18c-23e16fcdd214 admin admin] PATH_INFO: `/v3/users/2be000ffca5e44caa853a43a97449ba6` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:27.994496 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2947015-1955-4ed3-a18c-23e16fcdd214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be000ffca5e44caa853a43a97449ba6)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:27.997524 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2947015-1955-4ed3-a18c-23e16fcdd214 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:28.046140 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-fab18d17-2a2e-4f3d-801e-108ae7ddce07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '804a3aaa73aa410aaa34b3a9da5bafe2', 'request_id': 'req-fab18d17-2a2e-4f3d-801e-108ae7ddce07'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:28.060893 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-fab18d17-2a2e-4f3d-801e-108ae7ddce07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '804a3aaa73aa410aaa34b3a9da5bafe2', 'request_id': 'req-fab18d17-2a2e-4f3d-801e-108ae7ddce07'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:28.068767 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-fab18d17-2a2e-4f3d-801e-108ae7ddce07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '804a3aaa73aa410aaa34b3a9da5bafe2', 'request_id': 'req-fab18d17-2a2e-4f3d-801e-108ae7ddce07'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:28.069699 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-f2947015-1955-4ed3-a18c-23e16fcdd214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be000ffca5e44caa853a43a97449ba6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:28.097700 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-f2947015-1955-4ed3-a18c-23e16fcdd214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be000ffca5e44caa853a43a97449ba6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:28.098578 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-f2947015-1955-4ed3-a18c-23e16fcdd214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be000ffca5e44caa853a43a97449ba6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:28.099994 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-fab18d17-2a2e-4f3d-801e-108ae7ddce07 admin admin] The token cache is being invalidate because project 804a3aaa73aa410aaa34b3a9da5bafe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:04:28.100455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-fab18d17-2a2e-4f3d-801e-108ae7ddce07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:28.101401 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-fab18d17-2a2e-4f3d-801e-108ae7ddce07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:28.114635 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 871/1740] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:04:27 2021] DELETE /identity/v3/projects/804a3aaa73aa410aaa34b3a9da5bafe2 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:28.121530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-f2947015-1955-4ed3-a18c-23e16fcdd214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be000ffca5e44caa853a43a97449ba6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:28.125876 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab18d17-2a2e-4f3d-801e-108ae7ddce07 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:28.127633 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-fab18d17-2a2e-4f3d-801e-108ae7ddce07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:28.135689 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-f2947015-1955-4ed3-a18c-23e16fcdd214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be000ffca5e44caa853a43a97449ba6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:28.154166 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 870/1741] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:04:27 2021] DELETE /identity/v3/users/2be000ffca5e44caa853a43a97449ba6 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:28.156636 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc3505-ac00-451b-936a-11ef438b77e5 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:28.158929 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc3505-ac00-451b-936a-11ef438b77e5 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:28.160276 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc3505-ac00-451b-936a-11ef438b77e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:28.220467 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-f7cc3505-ac00-451b-936a-11ef438b77e5 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:28.223245 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f7cc3505-ac00-451b-936a-11ef438b77e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:28.247640 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab18d17-2a2e-4f3d-801e-108ae7ddce07 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:28.296143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 871/1742] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:28.297754 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e6996-f868-496e-a04e-e82c785b2b6c None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:28.298059 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e6996-f868-496e-a04e-e82c785b2b6c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:28.298325 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e6996-f868-496e-a04e-e82c785b2b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:28.316258 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87c6a1-fb04-44e3-8981-6ebe5157bd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:28.317201 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87c6a1-fb04-44e3-8981-6ebe5157bd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:28.317486 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87c6a1-fb04-44e3-8981-6ebe5157bd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:28.317756 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87c6a1-fb04-44e3-8981-6ebe5157bd61 admin admin] PATH_INFO: `/v3/users/b23598bfdbf34aaa8fb3c3ee4e6bcda0` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:28.320000 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87c6a1-fb04-44e3-8981-6ebe5157bd61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23598bfdbf34aaa8fb3c3ee4e6bcda0)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:28.322641 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-591e6996-f868-496e-a04e-e82c785b2b6c None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:28.322767 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87c6a1-fb04-44e3-8981-6ebe5157bd61 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:28.323909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-591e6996-f868-496e-a04e-e82c785b2b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:28.341024 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 872/1743] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:28.345762 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26da91-5c7a-494d-aad2-00bfe97886ad None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:28.346056 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26da91-5c7a-494d-aad2-00bfe97886ad None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:28.346339 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26da91-5c7a-494d-aad2-00bfe97886ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:28.391207 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-6b26da91-5c7a-494d-aad2-00bfe97886ad None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:28.393674 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-6b26da91-5c7a-494d-aad2-00bfe97886ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:28.423604 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 873/1744] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:28.424920 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26da91-5c7a-494d-aad2-00bfe97886ad None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:28.426793 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-cc87c6a1-fb04-44e3-8981-6ebe5157bd61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23598bfdbf34aaa8fb3c3ee4e6bcda0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:28.427028 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-6b26da91-5c7a-494d-aad2-00bfe97886ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:28.427716 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-cc87c6a1-fb04-44e3-8981-6ebe5157bd61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23598bfdbf34aaa8fb3c3ee4e6bcda0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:28.429110 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-cc87c6a1-fb04-44e3-8981-6ebe5157bd61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23598bfdbf34aaa8fb3c3ee4e6bcda0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:28.454192 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-cc87c6a1-fb04-44e3-8981-6ebe5157bd61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23598bfdbf34aaa8fb3c3ee4e6bcda0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:28.464978 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-cc87c6a1-fb04-44e3-8981-6ebe5157bd61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23598bfdbf34aaa8fb3c3ee4e6bcda0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:28.482821 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 872/1745] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:04:28 2021] DELETE /identity/v3/users/b23598bfdbf34aaa8fb3c3ee4e6bcda0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:28.484228 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87c6a1-fb04-44e3-8981-6ebe5157bd61 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:28.486265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-cc87c6a1-fb04-44e3-8981-6ebe5157bd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:28.502262 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26da91-5c7a-494d-aad2-00bfe97886ad None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:28.563944 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c13c4e-068d-4f36-b698-74d49d278d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:28.565107 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c13c4e-068d-4f36-b698-74d49d278d7b service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:28.565397 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c13c4e-068d-4f36-b698-74d49d278d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:28.565674 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c13c4e-068d-4f36-b698-74d49d278d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:28.567764 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f3c13c4e-068d-4f36-b698-74d49d278d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:28.569066 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87c6a1-fb04-44e3-8981-6ebe5157bd61 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:28.574714 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b6508-639c-4b2a-9521-0bea1acb5c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:28.575922 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b6508-639c-4b2a-9521-0bea1acb5c26 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:28.576368 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b6508-639c-4b2a-9521-0bea1acb5c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:28.577249 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b6508-639c-4b2a-9521-0bea1acb5c26 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:28.578126 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b6508-639c-4b2a-9521-0bea1acb5c26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:04:28.578592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b6508-639c-4b2a-9521-0bea1acb5c26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:28.580262 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b6508-639c-4b2a-9521-0bea1acb5c26 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:28.582283 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c13c4e-068d-4f36-b698-74d49d278d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:28.583745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c13c4e-068d-4f36-b698-74d49d278d7b service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:28.593444 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 873/1746] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:04:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:04:28.595164 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 874/1747] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:28.597508 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b6508-639c-4b2a-9521-0bea1acb5c26 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:28.607328 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b6508-639c-4b2a-9521-0bea1acb5c26 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:28.612072 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d3460-3cfc-4cd1-a9f4-9b6df76c7bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:28.612733 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d3460-3cfc-4cd1-a9f4-9b6df76c7bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:28.613014 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d3460-3cfc-4cd1-a9f4-9b6df76c7bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:28.613288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d3460-3cfc-4cd1-a9f4-9b6df76c7bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:28.613976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d3460-3cfc-4cd1-a9f4-9b6df76c7bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:28.615922 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d3460-3cfc-4cd1-a9f4-9b6df76c7bb5 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:28.660749 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 874/1748] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:04:28 2021] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:04:28.665351 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c13c4e-068d-4f36-b698-74d49d278d7b service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:28.676976 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c13c4e-068d-4f36-b698-74d49d278d7b service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:28.776223 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e3e25-31a8-4b17-b9ed-d5e6dd194484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:28.777662 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e3e25-31a8-4b17-b9ed-d5e6dd194484 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:28.777780 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e3e25-31a8-4b17-b9ed-d5e6dd194484 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:28.778023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e3e25-31a8-4b17-b9ed-d5e6dd194484 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:28.778737 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e3e25-31a8-4b17-b9ed-d5e6dd194484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:28.782491 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e3e25-31a8-4b17-b9ed-d5e6dd194484 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:28.810561 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 875/1749] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:04:28 2021] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:28.814276 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d3460-3cfc-4cd1-a9f4-9b6df76c7bb5 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:28.828690 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d3460-3cfc-4cd1-a9f4-9b6df76c7bb5 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:28.844435 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db7944-8dcd-4097-b80d-efb20480ad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:28.845275 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db7944-8dcd-4097-b80d-efb20480ad9e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:28.845660 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db7944-8dcd-4097-b80d-efb20480ad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:28.846031 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db7944-8dcd-4097-b80d-efb20480ad9e admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:28.846871 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db7944-8dcd-4097-b80d-efb20480ad9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:28.854283 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db7944-8dcd-4097-b80d-efb20480ad9e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:28.874382 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 875/1750] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:28 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:28.878742 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e3e25-31a8-4b17-b9ed-d5e6dd194484 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:28.897722 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e3e25-31a8-4b17-b9ed-d5e6dd194484 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:28.910259 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11026a-aa20-483b-9047-c3cafb47f6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:28.910963 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11026a-aa20-483b-9047-c3cafb47f6dc admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:28.911616 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11026a-aa20-483b-9047-c3cafb47f6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:28.911616 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11026a-aa20-483b-9047-c3cafb47f6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:28.912328 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11026a-aa20-483b-9047-c3cafb47f6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:28.917885 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11026a-aa20-483b-9047-c3cafb47f6dc admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:28.953764 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 876/1751] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:28 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:28.958251 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db7944-8dcd-4097-b80d-efb20480ad9e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:28.991213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db7944-8dcd-4097-b80d-efb20480ad9e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:29.006326 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d65eb-15f1-450c-b26c-698dbf474d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:29.020428 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d65eb-15f1-450c-b26c-698dbf474d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:29.020849 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d65eb-15f1-450c-b26c-698dbf474d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:29.021194 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d65eb-15f1-450c-b26c-698dbf474d91 admin admin] PATH_INFO: `/v3/projects/b969381b31514174b4a28e1c0d43f737/users/39c19d1dc2734b3fbf827de84bfba57d/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:29.045923 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d65eb-15f1-450c-b26c-698dbf474d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b969381b31514174b4a28e1c0d43f737, user_id=39c19d1dc2734b3fbf827de84bfba57d, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:29.049069 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d65eb-15f1-450c-b26c-698dbf474d91 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:29.075513 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 876/1752] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:28 2021] PUT /identity/v3/projects/b969381b31514174b4a28e1c0d43f737/users/39c19d1dc2734b3fbf827de84bfba57d/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:29.080472 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82209b82-2428-40ec-acff-28907c2c1294 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:29.081159 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82209b82-2428-40ec-acff-28907c2c1294 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:29.081766 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82209b82-2428-40ec-acff-28907c2c1294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:29.130338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-82209b82-2428-40ec-acff-28907c2c1294 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:29.132928 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-82209b82-2428-40ec-acff-28907c2c1294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:29.323270 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 877/1753] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:29.358958 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d65eb-15f1-450c-b26c-698dbf474d91 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:29.360494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d72d65eb-15f1-450c-b26c-698dbf474d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:29.371035 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82209b82-2428-40ec-acff-28907c2c1294 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:29.377555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-82209b82-2428-40ec-acff-28907c2c1294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:29.395804 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d65eb-15f1-450c-b26c-698dbf474d91 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:29.409569 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a6818-5502-4af9-9c73-aac414e29001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:29.410607 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a6818-5502-4af9-9c73-aac414e29001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:29.410894 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a6818-5502-4af9-9c73-aac414e29001 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:29.411166 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a6818-5502-4af9-9c73-aac414e29001 admin admin] PATH_INFO: `/v3/projects/08db450460d44308947a5641c758b72a` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:29.413038 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a6818-5502-4af9-9c73-aac414e29001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08db450460d44308947a5641c758b72a)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:29.415678 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a6818-5502-4af9-9c73-aac414e29001 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:29.520644 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82209b82-2428-40ec-acff-28907c2c1294 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:29.537389 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-361a6818-5502-4af9-9c73-aac414e29001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08db450460d44308947a5641c758b72a', 'request_id': 'req-361a6818-5502-4af9-9c73-aac414e29001'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:29.546460 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-361a6818-5502-4af9-9c73-aac414e29001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08db450460d44308947a5641c758b72a', 'request_id': 'req-361a6818-5502-4af9-9c73-aac414e29001'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:29.553860 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-361a6818-5502-4af9-9c73-aac414e29001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08db450460d44308947a5641c758b72a', 'request_id': 'req-361a6818-5502-4af9-9c73-aac414e29001'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:29.575226 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-361a6818-5502-4af9-9c73-aac414e29001 admin admin] The token cache is being invalidate because project 08db450460d44308947a5641c758b72a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:04:29.575688 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-361a6818-5502-4af9-9c73-aac414e29001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:29.581112 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-361a6818-5502-4af9-9c73-aac414e29001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:29.583976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 877/1754] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:04:29 2021] DELETE /identity/v3/projects/08db450460d44308947a5641c758b72a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:29.585290 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a6818-5502-4af9-9c73-aac414e29001 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:29.588906 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-361a6818-5502-4af9-9c73-aac414e29001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:29.623935 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd93fda-bfe9-4247-ab24-1cb33716accc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:29.624865 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd93fda-bfe9-4247-ab24-1cb33716accc service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:29.625231 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd93fda-bfe9-4247-ab24-1cb33716accc service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:29.625896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd93fda-bfe9-4247-ab24-1cb33716accc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:29.628625 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-9cd93fda-bfe9-4247-ab24-1cb33716accc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:29.692329 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a6818-5502-4af9-9c73-aac414e29001 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:29.697957 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b9b96-5056-4158-9442-e1d00dc44867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:29.698966 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b9b96-5056-4158-9442-e1d00dc44867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:29.699262 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b9b96-5056-4158-9442-e1d00dc44867 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:29.699577 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b9b96-5056-4158-9442-e1d00dc44867 admin admin] PATH_INFO: `/v3/projects/7d0b34513bea463fbcb6c8ef81c7ce46` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:29.700824 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b9b96-5056-4158-9442-e1d00dc44867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d0b34513bea463fbcb6c8ef81c7ce46)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:29.702853 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b9b96-5056-4158-9442-e1d00dc44867 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:29.704086 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd93fda-bfe9-4247-ab24-1cb33716accc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:29.705753 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd93fda-bfe9-4247-ab24-1cb33716accc service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:29.715912 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 878/1755] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:04:29.717188 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bc5b2-adae-479a-8791-838ce4ec584d None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:29.717746 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bc5b2-adae-479a-8791-838ce4ec584d None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:29.717746 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bc5b2-adae-479a-8791-838ce4ec584d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:29.740281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-405bc5b2-adae-479a-8791-838ce4ec584d None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:29.741850 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-405bc5b2-adae-479a-8791-838ce4ec584d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:29.760933 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-447b9b96-5056-4158-9442-e1d00dc44867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d0b34513bea463fbcb6c8ef81c7ce46', 'request_id': 'req-447b9b96-5056-4158-9442-e1d00dc44867'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:29.768113 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-447b9b96-5056-4158-9442-e1d00dc44867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d0b34513bea463fbcb6c8ef81c7ce46', 'request_id': 'req-447b9b96-5056-4158-9442-e1d00dc44867'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:29.774813 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-447b9b96-5056-4158-9442-e1d00dc44867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d0b34513bea463fbcb6c8ef81c7ce46', 'request_id': 'req-447b9b96-5056-4158-9442-e1d00dc44867'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:29.797963 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-447b9b96-5056-4158-9442-e1d00dc44867 admin admin] The token cache is being invalidate because project 7d0b34513bea463fbcb6c8ef81c7ce46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:04:29.798286 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-447b9b96-5056-4158-9442-e1d00dc44867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:29.799198 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-447b9b96-5056-4158-9442-e1d00dc44867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:29.804711 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 878/1756] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:04:29 2021] DELETE /identity/v3/projects/7d0b34513bea463fbcb6c8ef81c7ce46 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:29.806893 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b9b96-5056-4158-9442-e1d00dc44867 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:29.810757 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-447b9b96-5056-4158-9442-e1d00dc44867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:29.817192 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 879/1757] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:29.823207 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f06a0-b58a-4d5e-ba94-792db0b20d20 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:29.823545 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f06a0-b58a-4d5e-ba94-792db0b20d20 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:29.823838 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f06a0-b58a-4d5e-ba94-792db0b20d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:29.835217 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b9b96-5056-4158-9442-e1d00dc44867 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:29.840761 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667c7d9-ad38-4b0c-8122-882fefbe34a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:29.841777 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667c7d9-ad38-4b0c-8122-882fefbe34a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:29.842066 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667c7d9-ad38-4b0c-8122-882fefbe34a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:29.842380 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667c7d9-ad38-4b0c-8122-882fefbe34a0 admin admin] PATH_INFO: `/v3/users/dcd464aa8d5043cbba6a9f00a73e0799` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:29.843709 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667c7d9-ad38-4b0c-8122-882fefbe34a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd464aa8d5043cbba6a9f00a73e0799)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:29.856489 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-d17f06a0-b58a-4d5e-ba94-792db0b20d20 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:29.857112 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667c7d9-ad38-4b0c-8122-882fefbe34a0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:29.857627 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-d17f06a0-b58a-4d5e-ba94-792db0b20d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:29.870506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 880/1758] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:04:29.872504 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f06a0-b58a-4d5e-ba94-792db0b20d20 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:29.883320 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f06a0-b58a-4d5e-ba94-792db0b20d20 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:29.891831 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53beac-4de3-4e46-bf51-3b1984a10851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:29.892671 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53beac-4de3-4e46-bf51-3b1984a10851 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:29.893215 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53beac-4de3-4e46-bf51-3b1984a10851 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:29.893571 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53beac-4de3-4e46-bf51-3b1984a10851 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:29.894447 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53beac-4de3-4e46-bf51-3b1984a10851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:04:29.894893 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53beac-4de3-4e46-bf51-3b1984a10851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:29.897239 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53beac-4de3-4e46-bf51-3b1984a10851 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:29.915516 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 881/1759] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:04:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:04:29.919407 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53beac-4de3-4e46-bf51-3b1984a10851 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:29.936655 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53beac-4de3-4e46-bf51-3b1984a10851 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:29.936790 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2667c7d9-ad38-4b0c-8122-882fefbe34a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd464aa8d5043cbba6a9f00a73e0799'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:29.937499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2667c7d9-ad38-4b0c-8122-882fefbe34a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd464aa8d5043cbba6a9f00a73e0799'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:29.938144 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2667c7d9-ad38-4b0c-8122-882fefbe34a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd464aa8d5043cbba6a9f00a73e0799'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:29.945808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302149e-141c-4156-a66a-a293381fe3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:29.947704 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302149e-141c-4156-a66a-a293381fe3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:29.948208 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302149e-141c-4156-a66a-a293381fe3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:29.948887 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302149e-141c-4156-a66a-a293381fe3e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:29.949898 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302149e-141c-4156-a66a-a293381fe3e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:29.952268 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2667c7d9-ad38-4b0c-8122-882fefbe34a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd464aa8d5043cbba6a9f00a73e0799'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:29.952406 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302149e-141c-4156-a66a-a293381fe3e6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:29.961533 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2667c7d9-ad38-4b0c-8122-882fefbe34a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd464aa8d5043cbba6a9f00a73e0799'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:29.981092 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 879/1760] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:04:29 2021] DELETE /identity/v3/users/dcd464aa8d5043cbba6a9f00a73e0799 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:29.992289 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 882/1761] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:04:29 2021] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:04:29.996488 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667c7d9-ad38-4b0c-8122-882fefbe34a0 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:29.998353 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-2667c7d9-ad38-4b0c-8122-882fefbe34a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:30.092515 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667c7d9-ad38-4b0c-8122-882fefbe34a0 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:30.168122 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19e419-b04d-4141-a1e4-74d09654454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:30.168913 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19e419-b04d-4141-a1e4-74d09654454a admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:30.169300 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19e419-b04d-4141-a1e4-74d09654454a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:30.169809 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19e419-b04d-4141-a1e4-74d09654454a admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:30.171358 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19e419-b04d-4141-a1e4-74d09654454a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:30.174208 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19e419-b04d-4141-a1e4-74d09654454a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:30.218180 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 880/1762] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:04:29 2021] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:04:30.222206 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302149e-141c-4156-a66a-a293381fe3e6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:30.235122 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302149e-141c-4156-a66a-a293381fe3e6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:30.241452 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814ee9f-2f70-4e24-8d4d-400384a10bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:30.242435 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814ee9f-2f70-4e24-8d4d-400384a10bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:30.242881 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814ee9f-2f70-4e24-8d4d-400384a10bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:30.243993 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814ee9f-2f70-4e24-8d4d-400384a10bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:30.245107 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814ee9f-2f70-4e24-8d4d-400384a10bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:30.252079 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814ee9f-2f70-4e24-8d4d-400384a10bd9 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:30.269446 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 883/1763] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:30 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:04:30.270691 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19e419-b04d-4141-a1e4-74d09654454a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:30.280819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19e419-b04d-4141-a1e4-74d09654454a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:30.285951 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488aa93-b857-484f-a9c6-578936258ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:30.286623 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488aa93-b857-484f-a9c6-578936258ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:30.286905 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488aa93-b857-484f-a9c6-578936258ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:30.287180 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488aa93-b857-484f-a9c6-578936258ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:30.287938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488aa93-b857-484f-a9c6-578936258ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:30.289649 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488aa93-b857-484f-a9c6-578936258ff5 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:30.304075 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 881/1764] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:30 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:30.305352 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814ee9f-2f70-4e24-8d4d-400384a10bd9 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:30.316110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814ee9f-2f70-4e24-8d4d-400384a10bd9 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:30.321051 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2f935-6d2a-47c3-adb0-162e5fd50c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:30.322522 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2f935-6d2a-47c3-adb0-162e5fd50c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:30.322801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2f935-6d2a-47c3-adb0-162e5fd50c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:30.323078 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2f935-6d2a-47c3-adb0-162e5fd50c10 admin admin] PATH_INFO: `/v3/projects/02a2e04e6fe947c4b0bcc76255ec0e15/users/e42aedf589394bb3b7382d53ef25f22f/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:30.338818 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2f935-6d2a-47c3-adb0-162e5fd50c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a2e04e6fe947c4b0bcc76255ec0e15, user_id=e42aedf589394bb3b7382d53ef25f22f, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:30.341759 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2f935-6d2a-47c3-adb0-162e5fd50c10 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:30.356480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 884/1765] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:30 2021] PUT /identity/v3/projects/02a2e04e6fe947c4b0bcc76255ec0e15/users/e42aedf589394bb3b7382d53ef25f22f/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:30.366665 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca7268-0acf-4f52-a5af-588e1bad6b22 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:30.366959 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca7268-0acf-4f52-a5af-588e1bad6b22 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:30.367261 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca7268-0acf-4f52-a5af-588e1bad6b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:30.409357 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-2eca7268-0acf-4f52-a5af-588e1bad6b22 None None] MFA Rules not processed for user `e42aedf589394bb3b7382d53ef25f22f`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:30.410610 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-2eca7268-0acf-4f52-a5af-588e1bad6b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:30.523972 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 882/1766] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:30 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:30.526056 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2f935-6d2a-47c3-adb0-162e5fd50c10 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:30.539509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca7268-0acf-4f52-a5af-588e1bad6b22 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:30.540988 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-2eca7268-0acf-4f52-a5af-588e1bad6b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:30.675952 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca7268-0acf-4f52-a5af-588e1bad6b22 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:30.678952 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2f935-6d2a-47c3-adb0-162e5fd50c10 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:30.681114 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05663152-9630-4b4a-b208-f97130af643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:30.681995 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05663152-9630-4b4a-b208-f97130af643f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:30.682582 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05663152-9630-4b4a-b208-f97130af643f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:30.683011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05663152-9630-4b4a-b208-f97130af643f admin admin] PATH_INFO: `/v3/projects/446056fd28a14a9b8fc7640117fcba8a` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:30.684388 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05663152-9630-4b4a-b208-f97130af643f admin admin] RBAC: Authorizing `identity:delete_project(project_id=446056fd28a14a9b8fc7640117fcba8a)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:30.686376 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05663152-9630-4b4a-b208-f97130af643f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:30.694556 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bd8ab-a427-4763-b3ad-506aee6d7359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:30.695419 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bd8ab-a427-4763-b3ad-506aee6d7359 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:30.695789 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bd8ab-a427-4763-b3ad-506aee6d7359 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:30.696177 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bd8ab-a427-4763-b3ad-506aee6d7359 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:30.697490 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bd8ab-a427-4763-b3ad-506aee6d7359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:30.701190 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bd8ab-a427-4763-b3ad-506aee6d7359 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:30.736860 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 885/1767] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:04:30 2021] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:30.738161 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bd8ab-a427-4763-b3ad-506aee6d7359 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:30.772617 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-05663152-9630-4b4a-b208-f97130af643f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '446056fd28a14a9b8fc7640117fcba8a', 'request_id': 'req-05663152-9630-4b4a-b208-f97130af643f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:30.781189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-05663152-9630-4b4a-b208-f97130af643f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '446056fd28a14a9b8fc7640117fcba8a', 'request_id': 'req-05663152-9630-4b4a-b208-f97130af643f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:30.788616 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-05663152-9630-4b4a-b208-f97130af643f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '446056fd28a14a9b8fc7640117fcba8a', 'request_id': 'req-05663152-9630-4b4a-b208-f97130af643f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:30.818087 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-05663152-9630-4b4a-b208-f97130af643f admin admin] The token cache is being invalidate because project 446056fd28a14a9b8fc7640117fcba8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:04:30.818555 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-05663152-9630-4b4a-b208-f97130af643f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:30.820924 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-05663152-9630-4b4a-b208-f97130af643f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:30.834015 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bd8ab-a427-4763-b3ad-506aee6d7359 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:30.838850 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 883/1768] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:04:30 2021] DELETE /identity/v3/projects/446056fd28a14a9b8fc7640117fcba8a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:04:30.845923 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c288cbe-e87d-470b-9652-6afff872e9e7 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:30.847427 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c288cbe-e87d-470b-9652-6afff872e9e7 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:30.848266 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c288cbe-e87d-470b-9652-6afff872e9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:30.881312 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-4c288cbe-e87d-470b-9652-6afff872e9e7 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:30.882918 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-4c288cbe-e87d-470b-9652-6afff872e9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:30.987777 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18334c-44b7-4bba-84d2-5f1cebf4ed22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:30.987919 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18334c-44b7-4bba-84d2-5f1cebf4ed22 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:30.988216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18334c-44b7-4bba-84d2-5f1cebf4ed22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:30.988698 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18334c-44b7-4bba-84d2-5f1cebf4ed22 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:30.989395 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18334c-44b7-4bba-84d2-5f1cebf4ed22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:30.991560 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18334c-44b7-4bba-84d2-5f1cebf4ed22 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:31.008492 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 884/1769] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:31.016941 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ccc3b-20f6-4fb7-bb6d-43c5fea9a8ba None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.017497 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ccc3b-20f6-4fb7-bb6d-43c5fea9a8ba None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.018148 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ccc3b-20f6-4fb7-bb6d-43c5fea9a8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.046383 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 886/1770] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:04:30 2021] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:31.047758 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94503d0b-9032-4148-9581-01de31902b6a None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.048053 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94503d0b-9032-4148-9581-01de31902b6a None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.048333 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94503d0b-9032-4148-9581-01de31902b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.059338 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-1e4ccc3b-20f6-4fb7-bb6d-43c5fea9a8ba None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:31.060922 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1e4ccc3b-20f6-4fb7-bb6d-43c5fea9a8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:31.081757 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 885/1771] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:31.083459 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ccc3b-20f6-4fb7-bb6d-43c5fea9a8ba None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:31.085762 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1e4ccc3b-20f6-4fb7-bb6d-43c5fea9a8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:31.089061 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-94503d0b-9032-4148-9581-01de31902b6a None None] MFA Rules not processed for user `39c19d1dc2734b3fbf827de84bfba57d`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:31.090273 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-94503d0b-9032-4148-9581-01de31902b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:31.107980 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ccc3b-20f6-4fb7-bb6d-43c5fea9a8ba None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:31.117174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c0a36-52c9-463d-b639-04e11deffc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:31.117174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c0a36-52c9-463d-b639-04e11deffc03 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.117174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c0a36-52c9-463d-b639-04e11deffc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.118088 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c0a36-52c9-463d-b639-04e11deffc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.118949 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c0a36-52c9-463d-b639-04e11deffc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:31.122421 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c0a36-52c9-463d-b639-04e11deffc03 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:31.139876 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 886/1772] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:31 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:31.139876 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c0a36-52c9-463d-b639-04e11deffc03 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:31.147841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c0a36-52c9-463d-b639-04e11deffc03 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:31.153334 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21a751-09aa-45b9-a82f-033797eafcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:31.153855 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21a751-09aa-45b9-a82f-033797eafcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.154138 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21a751-09aa-45b9-a82f-033797eafcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.154411 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21a751-09aa-45b9-a82f-033797eafcf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.155123 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21a751-09aa-45b9-a82f-033797eafcf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:04:31.155562 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21a751-09aa-45b9-a82f-033797eafcf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:31.157099 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21a751-09aa-45b9-a82f-033797eafcf7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:31.170407 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 887/1773] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:04:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:04:31.171235 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21a751-09aa-45b9-a82f-033797eafcf7 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:31.177476 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 887/1774] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:31 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:31.177476 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94503d0b-9032-4148-9581-01de31902b6a None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:31.182819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21a751-09aa-45b9-a82f-033797eafcf7 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:31.189014 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97832f0f-3df2-4c41-a9fa-ea3c47aa4524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:31.189909 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97832f0f-3df2-4c41-a9fa-ea3c47aa4524 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.190408 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97832f0f-3df2-4c41-a9fa-ea3c47aa4524 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.190689 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97832f0f-3df2-4c41-a9fa-ea3c47aa4524 admin admin] PATH_INFO: `/v3/projects/f39f60257c7248e9b2da1aa464ab16e3/users/bf48e1a2f70546f8ae95994a3de8999e/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.192201 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94503d0b-9032-4148-9581-01de31902b6a None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:31.197950 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba625f-327b-43f1-af60-ca658d53b872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:31.198807 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba625f-327b-43f1-af60-ca658d53b872 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.199211 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba625f-327b-43f1-af60-ca658d53b872 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.199820 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba625f-327b-43f1-af60-ca658d53b872 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.200638 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba625f-327b-43f1-af60-ca658d53b872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:31.202735 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba625f-327b-43f1-af60-ca658d53b872 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:31.207426 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97832f0f-3df2-4c41-a9fa-ea3c47aa4524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39f60257c7248e9b2da1aa464ab16e3, user_id=bf48e1a2f70546f8ae95994a3de8999e, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:31.210949 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97832f0f-3df2-4c41-a9fa-ea3c47aa4524 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:31.231790 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 888/1775] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:31 2021] PUT /identity/v3/projects/f39f60257c7248e9b2da1aa464ab16e3/users/bf48e1a2f70546f8ae95994a3de8999e/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:31.234758 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97832f0f-3df2-4c41-a9fa-ea3c47aa4524 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:31.237789 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-97832f0f-3df2-4c41-a9fa-ea3c47aa4524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:31.239636 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 888/1776] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:04:31 2021] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:31.244306 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba625f-327b-43f1-af60-ca658d53b872 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:31.318856 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97832f0f-3df2-4c41-a9fa-ea3c47aa4524 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:31.324113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba625f-327b-43f1-af60-ca658d53b872 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:31.324669 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c623eaa-5b7c-45cb-bc1e-045d8d3eee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:31.326288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c623eaa-5b7c-45cb-bc1e-045d8d3eee14 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.326288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c623eaa-5b7c-45cb-bc1e-045d8d3eee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.326288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c623eaa-5b7c-45cb-bc1e-045d8d3eee14 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.326903 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c623eaa-5b7c-45cb-bc1e-045d8d3eee14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:31.328980 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c623eaa-5b7c-45cb-bc1e-045d8d3eee14 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:31.331627 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e340c-b4a7-4350-9648-40eca83bf01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:31.332485 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e340c-b4a7-4350-9648-40eca83bf01f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.332908 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e340c-b4a7-4350-9648-40eca83bf01f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.333322 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e340c-b4a7-4350-9648-40eca83bf01f admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.334181 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e340c-b4a7-4350-9648-40eca83bf01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:31.335941 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e340c-b4a7-4350-9648-40eca83bf01f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:31.347344 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 889/1777] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:31 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:31.348469 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e340c-b4a7-4350-9648-40eca83bf01f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:31.361216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e340c-b4a7-4350-9648-40eca83bf01f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:31.366449 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c5aad-a77d-4239-8097-9571b32416ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:31.367225 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c5aad-a77d-4239-8097-9571b32416ae admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.367546 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c5aad-a77d-4239-8097-9571b32416ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.367827 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c5aad-a77d-4239-8097-9571b32416ae admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.368779 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c5aad-a77d-4239-8097-9571b32416ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:31.369772 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 889/1778] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:04:31 2021] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:31.370617 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c623eaa-5b7c-45cb-bc1e-045d8d3eee14 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:31.370736 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c5aad-a77d-4239-8097-9571b32416ae admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:31.411571 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 890/1779] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:04:31 2021] POST /identity/v3/users => generated 292 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:31.411571 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c5aad-a77d-4239-8097-9571b32416ae admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:31.422031 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c5aad-a77d-4239-8097-9571b32416ae admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:31.445090 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c623eaa-5b7c-45cb-bc1e-045d8d3eee14 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:31.450178 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831ec4b-589d-481f-b3fd-947d4686d5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:31.451086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831ec4b-589d-481f-b3fd-947d4686d5e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.451402 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831ec4b-589d-481f-b3fd-947d4686d5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.452300 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831ec4b-589d-481f-b3fd-947d4686d5e6 admin admin] PATH_INFO: `/v3/projects/f39f60257c7248e9b2da1aa464ab16e3/users/bf48e1a2f70546f8ae95994a3de8999e/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.454734 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831ec4b-589d-481f-b3fd-947d4686d5e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39f60257c7248e9b2da1aa464ab16e3, user_id=bf48e1a2f70546f8ae95994a3de8999e, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:31.457875 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831ec4b-589d-481f-b3fd-947d4686d5e6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:31.470899 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 890/1780] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:31 2021] PUT /identity/v3/projects/f39f60257c7248e9b2da1aa464ab16e3/users/bf48e1a2f70546f8ae95994a3de8999e/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:31.472107 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831ec4b-589d-481f-b3fd-947d4686d5e6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:31.486800 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f9b23-cbda-426f-a79c-a0db8f7c6ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:31.487775 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f9b23-cbda-426f-a79c-a0db8f7c6ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.488275 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f9b23-cbda-426f-a79c-a0db8f7c6ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.488853 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f9b23-cbda-426f-a79c-a0db8f7c6ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.489890 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f9b23-cbda-426f-a79c-a0db8f7c6ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:31.492305 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f9b23-cbda-426f-a79c-a0db8f7c6ff3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:31.514438 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 891/1781] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:04:31 2021] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:31.516222 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cb9fb-be43-433d-b63b-10593a2477a4 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.516617 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cb9fb-be43-433d-b63b-10593a2477a4 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.516959 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cb9fb-be43-433d-b63b-10593a2477a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.545056 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-370cb9fb-be43-433d-b63b-10593a2477a4 None None] MFA Rules not processed for user `bf48e1a2f70546f8ae95994a3de8999e`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:31.545931 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831ec4b-589d-481f-b3fd-947d4686d5e6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:31.546398 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-370cb9fb-be43-433d-b63b-10593a2477a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:31.551405 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac9cdf-346e-4f49-b020-02a07cd033d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:31.552594 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac9cdf-346e-4f49-b020-02a07cd033d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.552881 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac9cdf-346e-4f49-b020-02a07cd033d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.553160 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac9cdf-346e-4f49-b020-02a07cd033d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.554037 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac9cdf-346e-4f49-b020-02a07cd033d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:31.556188 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac9cdf-346e-4f49-b020-02a07cd033d3 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:31.567222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 891/1782] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:31 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:31.567995 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac9cdf-346e-4f49-b020-02a07cd033d3 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:31.578436 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac9cdf-346e-4f49-b020-02a07cd033d3 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:31.583348 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934301a-c6b2-4da5-9e77-0f2e39e30a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:31.584156 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934301a-c6b2-4da5-9e77-0f2e39e30a7e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.584539 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934301a-c6b2-4da5-9e77-0f2e39e30a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.585140 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934301a-c6b2-4da5-9e77-0f2e39e30a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.585969 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934301a-c6b2-4da5-9e77-0f2e39e30a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:31.587932 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934301a-c6b2-4da5-9e77-0f2e39e30a7e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:31.601244 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 892/1783] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:31.601244 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011b875-87a9-40cd-8390-2da47316b511 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.601244 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011b875-87a9-40cd-8390-2da47316b511 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.601244 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011b875-87a9-40cd-8390-2da47316b511 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.602282 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 893/1784] 10.222.0.39 () {54 vars in 921 bytes} [Tue Aug 31 03:04:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:04:31.603487 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011b875-87a9-40cd-8390-2da47316b511 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:31.616391 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011b875-87a9-40cd-8390-2da47316b511 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:31.623004 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad7ebd-8c3a-42ef-b48b-345c1484fbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:31.623912 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad7ebd-8c3a-42ef-b48b-345c1484fbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.627841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad7ebd-8c3a-42ef-b48b-345c1484fbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.627972 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 892/1785] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:31 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:31.628326 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad7ebd-8c3a-42ef-b48b-345c1484fbe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.628412 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cb9fb-be43-433d-b63b-10593a2477a4 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:31.628514 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad7ebd-8c3a-42ef-b48b-345c1484fbe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:31.628514 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad7ebd-8c3a-42ef-b48b-345c1484fbe8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:31.639330 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cb9fb-be43-433d-b63b-10593a2477a4 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:31.642920 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 894/1786] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:31 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:31.642920 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a77587-81b8-4fd6-a957-275eae747185 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.642920 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a77587-81b8-4fd6-a957-275eae747185 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.642920 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a77587-81b8-4fd6-a957-275eae747185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.655426 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6700dda-f519-4bcb-a075-11a294a18448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:31.658112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6700dda-f519-4bcb-a075-11a294a18448 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.658340 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6700dda-f519-4bcb-a075-11a294a18448 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.658623 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6700dda-f519-4bcb-a075-11a294a18448 admin admin] PATH_INFO: `/v3/projects/efd3f22e12e34dfb817144eefc2e9746/users/66d91fc430944e94bd501d3f87a000d7/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.675836 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-c0a77587-81b8-4fd6-a957-275eae747185 None None] MFA Rules not processed for user `a6bb852fc4394f88800ec9616cb65416`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:31.677066 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c0a77587-81b8-4fd6-a957-275eae747185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:31.677498 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6700dda-f519-4bcb-a075-11a294a18448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd3f22e12e34dfb817144eefc2e9746, user_id=66d91fc430944e94bd501d3f87a000d7, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:31.680234 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6700dda-f519-4bcb-a075-11a294a18448 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:31.697022 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 893/1787] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:31 2021] PUT /identity/v3/projects/efd3f22e12e34dfb817144eefc2e9746/users/66d91fc430944e94bd501d3f87a000d7/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:31.697622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6700dda-f519-4bcb-a075-11a294a18448 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:31.699217 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c6700dda-f519-4bcb-a075-11a294a18448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:31.754577 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 895/1788] 10.222.0.39 () {58 vars in 1019 bytes} [Tue Aug 31 03:04:31 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:31.755337 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a77587-81b8-4fd6-a957-275eae747185 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:31.759155 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6700dda-f519-4bcb-a075-11a294a18448 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:31.763600 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b07b86-deb6-43ec-8295-9d1f3c0b3502 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:31.764329 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b07b86-deb6-43ec-8295-9d1f3c0b3502 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.764687 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b07b86-deb6-43ec-8295-9d1f3c0b3502 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.765037 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b07b86-deb6-43ec-8295-9d1f3c0b3502 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.768747 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f3b07b86-deb6-43ec-8295-9d1f3c0b3502 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:31.771274 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a77587-81b8-4fd6-a957-275eae747185 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:31.841241 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b07b86-deb6-43ec-8295-9d1f3c0b3502 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:31.843094 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b07b86-deb6-43ec-8295-9d1f3c0b3502 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:31.858338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 894/1789] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:31 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:31.861919 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df53fd-5804-4c24-ad0a-e0539705bb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:31.862760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df53fd-5804-4c24-ad0a-e0539705bb58 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.863086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df53fd-5804-4c24-ad0a-e0539705bb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.863479 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df53fd-5804-4c24-ad0a-e0539705bb58 admin admin] PATH_INFO: `/v3/projects/7f71434943d1456aa3c9f90c6bad0ed1/users/ce1d6bfcdebf468daf07a7da8b72aebb/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.869933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b07b86-deb6-43ec-8295-9d1f3c0b3502 service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:31.883348 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df53fd-5804-4c24-ad0a-e0539705bb58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f71434943d1456aa3c9f90c6bad0ed1, user_id=ce1d6bfcdebf468daf07a7da8b72aebb, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:31.886144 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df53fd-5804-4c24-ad0a-e0539705bb58 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:31.896221 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b07b86-deb6-43ec-8295-9d1f3c0b3502 service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:31.911492 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 896/1790] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:31 2021] PUT /identity/v3/projects/7f71434943d1456aa3c9f90c6bad0ed1/users/ce1d6bfcdebf468daf07a7da8b72aebb/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:31.912549 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df53fd-5804-4c24-ad0a-e0539705bb58 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:31.914881 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b5df53fd-5804-4c24-ad0a-e0539705bb58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:31.988289 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0ff66-8b88-4a27-93e5-2ad9e49095da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:31.988972 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0ff66-8b88-4a27-93e5-2ad9e49095da admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:31.989661 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0ff66-8b88-4a27-93e5-2ad9e49095da admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:31.990074 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0ff66-8b88-4a27-93e5-2ad9e49095da admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:31.990816 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0ff66-8b88-4a27-93e5-2ad9e49095da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:31.992666 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0ff66-8b88-4a27-93e5-2ad9e49095da admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:32.005405 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 895/1791] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:31 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:32.006667 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afa0fe-e28b-44df-a6b9-33611018c1be None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:32.006961 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afa0fe-e28b-44df-a6b9-33611018c1be None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:32.007243 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afa0fe-e28b-44df-a6b9-33611018c1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:32.020953 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df53fd-5804-4c24-ad0a-e0539705bb58 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:32.032474 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21589f4-c8be-4aea-917d-def56f439a4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:32.033293 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21589f4-c8be-4aea-917d-def56f439a4f service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:32.033581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21589f4-c8be-4aea-917d-def56f439a4f service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:32.033855 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21589f4-c8be-4aea-917d-def56f439a4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:32.044807 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21589f4-c8be-4aea-917d-def56f439a4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:32.046401 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21589f4-c8be-4aea-917d-def56f439a4f service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:32.059207 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-33afa0fe-e28b-44df-a6b9-33611018c1be None None] MFA Rules not processed for user `ce1d6bfcdebf468daf07a7da8b72aebb`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:32.059658 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 897/1792] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:31 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:32.060491 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21589f4-c8be-4aea-917d-def56f439a4f service nova] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:32.064981 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-33afa0fe-e28b-44df-a6b9-33611018c1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:32.071144 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21589f4-c8be-4aea-917d-def56f439a4f service nova] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:32.077689 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5311d5c-6733-4ed1-a6ef-3e008dbf3258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:32.078701 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5311d5c-6733-4ed1-a6ef-3e008dbf3258 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:32.079449 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5311d5c-6733-4ed1-a6ef-3e008dbf3258 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:32.079449 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5311d5c-6733-4ed1-a6ef-3e008dbf3258 admin admin] PATH_INFO: `/v3/projects/efd3f22e12e34dfb817144eefc2e9746/users/66d91fc430944e94bd501d3f87a000d7/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:32.081769 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5311d5c-6733-4ed1-a6ef-3e008dbf3258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd3f22e12e34dfb817144eefc2e9746, user_id=66d91fc430944e94bd501d3f87a000d7, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:32.086452 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5311d5c-6733-4ed1-a6ef-3e008dbf3258 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:32.103073 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 898/1793] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:32 2021] PUT /identity/v3/projects/efd3f22e12e34dfb817144eefc2e9746/users/66d91fc430944e94bd501d3f87a000d7/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:32.314832 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 896/1794] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:32 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:32.370311 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5311d5c-6733-4ed1-a6ef-3e008dbf3258 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:32.373264 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d5311d5c-6733-4ed1-a6ef-3e008dbf3258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:32.490773 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5311d5c-6733-4ed1-a6ef-3e008dbf3258 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:32.507983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b9966-55c4-48ad-8c7e-64e1969255a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:32.508654 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b9966-55c4-48ad-8c7e-64e1969255a8 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:32.509108 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b9966-55c4-48ad-8c7e-64e1969255a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:32.509305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b9966-55c4-48ad-8c7e-64e1969255a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:32.634867 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b9966-55c4-48ad-8c7e-64e1969255a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:32.636831 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b9966-55c4-48ad-8c7e-64e1969255a8 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:32.655751 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 899/1795] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:32 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:32.674269 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afa0fe-e28b-44df-a6b9-33611018c1be None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:32.686414 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afa0fe-e28b-44df-a6b9-33611018c1be None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:32.761408 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e5707-fdc8-4749-ba5d-ab9304226d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:32.762435 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e5707-fdc8-4749-ba5d-ab9304226d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:32.762823 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e5707-fdc8-4749-ba5d-ab9304226d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:32.763207 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e5707-fdc8-4749-ba5d-ab9304226d72 admin admin] PATH_INFO: `/v3/users/ce1d6bfcdebf468daf07a7da8b72aebb` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:32.764729 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e5707-fdc8-4749-ba5d-ab9304226d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce1d6bfcdebf468daf07a7da8b72aebb)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:32.766884 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e5707-fdc8-4749-ba5d-ab9304226d72 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:32.824209 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-9b9e5707-fdc8-4749-ba5d-ab9304226d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce1d6bfcdebf468daf07a7da8b72aebb'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:32.835836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-9b9e5707-fdc8-4749-ba5d-ab9304226d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce1d6bfcdebf468daf07a7da8b72aebb'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:32.836740 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-9b9e5707-fdc8-4749-ba5d-ab9304226d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce1d6bfcdebf468daf07a7da8b72aebb'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:32.845682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-9b9e5707-fdc8-4749-ba5d-ab9304226d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce1d6bfcdebf468daf07a7da8b72aebb'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:32.852967 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-9b9e5707-fdc8-4749-ba5d-ab9304226d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce1d6bfcdebf468daf07a7da8b72aebb'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:32.862691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 897/1796] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:04:32 2021] DELETE /identity/v3/users/ce1d6bfcdebf468daf07a7da8b72aebb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:32.867257 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c059c-5812-4d30-aa52-f3ca1b21bfa8 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:32.867908 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c059c-5812-4d30-aa52-f3ca1b21bfa8 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:32.868235 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c059c-5812-4d30-aa52-f3ca1b21bfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:32.886550 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-790c059c-5812-4d30-aa52-f3ca1b21bfa8 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:32.887798 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-790c059c-5812-4d30-aa52-f3ca1b21bfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:32.970349 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 900/1797] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:32.981161 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e5707-fdc8-4749-ba5d-ab9304226d72 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:32.982680 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-9b9e5707-fdc8-4749-ba5d-ab9304226d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:33.054129 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e5707-fdc8-4749-ba5d-ab9304226d72 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:33.058517 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bc262-c78e-4e74-baf2-4514f4a2e03e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:33.059172 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bc262-c78e-4e74-baf2-4514f4a2e03e service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:33.059488 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bc262-c78e-4e74-baf2-4514f4a2e03e service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:33.059763 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bc262-c78e-4e74-baf2-4514f4a2e03e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:33.069237 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bc262-c78e-4e74-baf2-4514f4a2e03e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:33.070670 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bc262-c78e-4e74-baf2-4514f4a2e03e service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:33.081244 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 898/1798] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:33.436270 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21eade-3262-405e-a850-2af92b3d0c66 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:33.437064 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21eade-3262-405e-a850-2af92b3d0c66 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:33.437353 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21eade-3262-405e-a850-2af92b3d0c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:33.483072 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-bd21eade-3262-405e-a850-2af92b3d0c66 None None] MFA Rules not processed for user `66d91fc430944e94bd501d3f87a000d7`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:33.484531 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-bd21eade-3262-405e-a850-2af92b3d0c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:33.640666 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 901/1799] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:33 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:33.698316 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bc262-c78e-4e74-baf2-4514f4a2e03e service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:33.699922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f37bc262-c78e-4e74-baf2-4514f4a2e03e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:33.774503 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21eade-3262-405e-a850-2af92b3d0c66 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:33.776203 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-bd21eade-3262-405e-a850-2af92b3d0c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:33.800462 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21eade-3262-405e-a850-2af92b3d0c66 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:33.816239 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16610a5-b196-4cff-aa8a-ef736127ab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:33.817962 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16610a5-b196-4cff-aa8a-ef736127ab1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:33.818302 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16610a5-b196-4cff-aa8a-ef736127ab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:33.818648 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16610a5-b196-4cff-aa8a-ef736127ab1f admin admin] PATH_INFO: `/v3/projects/7f71434943d1456aa3c9f90c6bad0ed1` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:33.821182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16610a5-b196-4cff-aa8a-ef736127ab1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f71434943d1456aa3c9f90c6bad0ed1)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:33.825690 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16610a5-b196-4cff-aa8a-ef736127ab1f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:33.851273 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bc262-c78e-4e74-baf2-4514f4a2e03e service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:33.856678 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ed2ff-8f4d-45ac-8479-c09bf3bb793d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:33.857698 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ed2ff-8f4d-45ac-8479-c09bf3bb793d service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:33.858167 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ed2ff-8f4d-45ac-8479-c09bf3bb793d service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:33.858596 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ed2ff-8f4d-45ac-8479-c09bf3bb793d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:33.861951 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-3b8ed2ff-8f4d-45ac-8479-c09bf3bb793d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:33.931199 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f16610a5-b196-4cff-aa8a-ef736127ab1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f71434943d1456aa3c9f90c6bad0ed1', 'request_id': 'req-f16610a5-b196-4cff-aa8a-ef736127ab1f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:33.939633 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f16610a5-b196-4cff-aa8a-ef736127ab1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f71434943d1456aa3c9f90c6bad0ed1', 'request_id': 'req-f16610a5-b196-4cff-aa8a-ef736127ab1f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:33.948790 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f16610a5-b196-4cff-aa8a-ef736127ab1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f71434943d1456aa3c9f90c6bad0ed1', 'request_id': 'req-f16610a5-b196-4cff-aa8a-ef736127ab1f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:33.966808 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f16610a5-b196-4cff-aa8a-ef736127ab1f admin admin] The token cache is being invalidate because project 7f71434943d1456aa3c9f90c6bad0ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:04:33.967341 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f16610a5-b196-4cff-aa8a-ef736127ab1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:33.968359 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f16610a5-b196-4cff-aa8a-ef736127ab1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:04:33.971437 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 902/1800] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:04:33 2021] DELETE /identity/v3/projects/7f71434943d1456aa3c9f90c6bad0ed1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:04:33.977172 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f7d7f-d176-4660-af88-7c94b53590c2 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:33.978710 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f7d7f-d176-4660-af88-7c94b53590c2 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:33.979013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f7d7f-d176-4660-af88-7c94b53590c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:34.028396 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-d24f7d7f-d176-4660-af88-7c94b53590c2 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:34.033079 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d24f7d7f-d176-4660-af88-7c94b53590c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:34.034957 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ed2ff-8f4d-45ac-8479-c09bf3bb793d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:34.037653 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ed2ff-8f4d-45ac-8479-c09bf3bb793d service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:34.053766 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 899/1801] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:33 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:34.135982 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 903/1802] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:04:34.144503 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a09eca-9141-4a4e-8219-6318f043121c None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:34.144798 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a09eca-9141-4a4e-8219-6318f043121c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:34.145094 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a09eca-9141-4a4e-8219-6318f043121c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:34.179198 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-94a09eca-9141-4a4e-8219-6318f043121c None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:34.181637 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-94a09eca-9141-4a4e-8219-6318f043121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:34.191276 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 900/1803] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:04:34.195494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f7d7f-d176-4660-af88-7c94b53590c2 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:34.206663 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f7d7f-d176-4660-af88-7c94b53590c2 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:34.214813 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1dc6b-93be-4dd3-a895-ecec8a3ae2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:34.215790 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1dc6b-93be-4dd3-a895-ecec8a3ae2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:34.216421 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1dc6b-93be-4dd3-a895-ecec8a3ae2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:34.216774 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1dc6b-93be-4dd3-a895-ecec8a3ae2c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:34.217759 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1dc6b-93be-4dd3-a895-ecec8a3ae2c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:04:34.218375 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1dc6b-93be-4dd3-a895-ecec8a3ae2c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:34.220363 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1dc6b-93be-4dd3-a895-ecec8a3ae2c3 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:34.237456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 904/1804] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:04:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:04:34.242011 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a09eca-9141-4a4e-8219-6318f043121c None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:34.252013 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a09eca-9141-4a4e-8219-6318f043121c None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:34.257975 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be0f59-dbd6-408d-bbe2-dbd5b265fed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:34.258691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be0f59-dbd6-408d-bbe2-dbd5b265fed3 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:34.259350 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be0f59-dbd6-408d-bbe2-dbd5b265fed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:34.259828 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be0f59-dbd6-408d-bbe2-dbd5b265fed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:34.260540 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be0f59-dbd6-408d-bbe2-dbd5b265fed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:34.262438 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be0f59-dbd6-408d-bbe2-dbd5b265fed3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:34.288552 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 901/1805] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:04:34 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:34.294105 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1dc6b-93be-4dd3-a895-ecec8a3ae2c3 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:34.304366 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1dc6b-93be-4dd3-a895-ecec8a3ae2c3 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:34.417010 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790309d8-fb77-4670-a611-d8a9a138fda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:34.417688 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790309d8-fb77-4670-a611-d8a9a138fda9 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:34.417974 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790309d8-fb77-4670-a611-d8a9a138fda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:34.418253 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790309d8-fb77-4670-a611-d8a9a138fda9 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:34.418948 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790309d8-fb77-4670-a611-d8a9a138fda9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:34.420954 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790309d8-fb77-4670-a611-d8a9a138fda9 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:34.441740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 905/1806] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:04:34 2021] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:04:34.445849 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be0f59-dbd6-408d-bbe2-dbd5b265fed3 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:34.456343 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be0f59-dbd6-408d-bbe2-dbd5b265fed3 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:34.461146 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7a20e-7253-43b7-bd5d-434e52734a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:34.462404 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7a20e-7253-43b7-bd5d-434e52734a9c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:34.462691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7a20e-7253-43b7-bd5d-434e52734a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:34.462994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7a20e-7253-43b7-bd5d-434e52734a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:34.464069 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7a20e-7253-43b7-bd5d-434e52734a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:34.465887 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7a20e-7253-43b7-bd5d-434e52734a9c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:34.476002 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 902/1807] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:34 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:34.480722 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790309d8-fb77-4670-a611-d8a9a138fda9 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:34.490726 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790309d8-fb77-4670-a611-d8a9a138fda9 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:34.495658 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d46af-de7b-4983-a550-5ff998198afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:34.496309 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d46af-de7b-4983-a550-5ff998198afb admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:34.496598 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d46af-de7b-4983-a550-5ff998198afb admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:34.496878 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d46af-de7b-4983-a550-5ff998198afb admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:34.497638 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d46af-de7b-4983-a550-5ff998198afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:34.499219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d46af-de7b-4983-a550-5ff998198afb admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:34.509777 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 906/1808] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:04:34 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:04:34.514008 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7a20e-7253-43b7-bd5d-434e52734a9c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:34.523768 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7a20e-7253-43b7-bd5d-434e52734a9c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:34.528968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d6ae1-e9fd-4d33-830c-6bb660aeaddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:34.529824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d6ae1-e9fd-4d33-830c-6bb660aeaddf admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:34.530106 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d6ae1-e9fd-4d33-830c-6bb660aeaddf admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:34.530380 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d6ae1-e9fd-4d33-830c-6bb660aeaddf admin admin] PATH_INFO: `/v3/projects/0b83cf6947e84bd288bbe7ae3d8a51ee/users/c7bbc84e02454949a8936c856f19bace/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:34.545328 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d6ae1-e9fd-4d33-830c-6bb660aeaddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b83cf6947e84bd288bbe7ae3d8a51ee, user_id=c7bbc84e02454949a8936c856f19bace, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:34.548058 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d6ae1-e9fd-4d33-830c-6bb660aeaddf admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:34.561013 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 903/1809] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:04:34 2021] PUT /identity/v3/projects/0b83cf6947e84bd288bbe7ae3d8a51ee/users/c7bbc84e02454949a8936c856f19bace/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:04:34.566166 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4517e6d-b156-4885-96f3-66b9c1dcd998 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:34.566464 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4517e6d-b156-4885-96f3-66b9c1dcd998 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:34.566745 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4517e6d-b156-4885-96f3-66b9c1dcd998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:34.584090 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-b4517e6d-b156-4885-96f3-66b9c1dcd998 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:34.585273 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b4517e6d-b156-4885-96f3-66b9c1dcd998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:34.642590 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 907/1810] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:34.653568 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d6ae1-e9fd-4d33-830c-6bb660aeaddf admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:34.655541 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-8c0d6ae1-e9fd-4d33-830c-6bb660aeaddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:34.711114 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d6ae1-e9fd-4d33-830c-6bb660aeaddf admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:34.715643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966c769-bbe8-4862-897e-c95c08a9b3d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:34.716296 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966c769-bbe8-4862-897e-c95c08a9b3d5 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:34.716580 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966c769-bbe8-4862-897e-c95c08a9b3d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:34.716855 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966c769-bbe8-4862-897e-c95c08a9b3d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:34.726077 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966c769-bbe8-4862-897e-c95c08a9b3d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:34.728308 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966c769-bbe8-4862-897e-c95c08a9b3d5 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:34.738244 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 904/1811] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:35.497455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8a1dd-5de2-416b-ae83-2845bb195fbc None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:35.497946 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8a1dd-5de2-416b-ae83-2845bb195fbc None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:35.498053 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8a1dd-5de2-416b-ae83-2845bb195fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:35.528281 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-83e8a1dd-5de2-416b-ae83-2845bb195fbc None None] MFA Rules not processed for user `c7bbc84e02454949a8936c856f19bace`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:35.529643 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-83e8a1dd-5de2-416b-ae83-2845bb195fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:35.599733 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 908/1812] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:35 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:04:35.614869 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966c769-bbe8-4862-897e-c95c08a9b3d5 service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:35.616693 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f966c769-bbe8-4862-897e-c95c08a9b3d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:35.687882 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966c769-bbe8-4862-897e-c95c08a9b3d5 service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:35.695013 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca94fcc-e787-42bd-b0d0-9845a1d5780f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:35.695709 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca94fcc-e787-42bd-b0d0-9845a1d5780f service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:35.696016 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca94fcc-e787-42bd-b0d0-9845a1d5780f service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:35.696432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca94fcc-e787-42bd-b0d0-9845a1d5780f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:35.705589 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca94fcc-e787-42bd-b0d0-9845a1d5780f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:35.707025 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca94fcc-e787-42bd-b0d0-9845a1d5780f service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:35.715911 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 905/1813] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:35 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:36.975555 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8a1dd-5de2-416b-ae83-2845bb195fbc None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:36.986812 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8a1dd-5de2-416b-ae83-2845bb195fbc None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:36.990989 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44823d97-61f6-4f15-9140-664f74168ced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:36.991875 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44823d97-61f6-4f15-9140-664f74168ced service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:36.992319 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44823d97-61f6-4f15-9140-664f74168ced service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:36.992740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44823d97-61f6-4f15-9140-664f74168ced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:36.995932 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-44823d97-61f6-4f15-9140-664f74168ced service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:37.097842 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44823d97-61f6-4f15-9140-664f74168ced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:37.099752 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44823d97-61f6-4f15-9140-664f74168ced service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:37.126519 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 909/1814] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:36 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:37.578614 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca94fcc-e787-42bd-b0d0-9845a1d5780f service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:04:37.588573 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca94fcc-e787-42bd-b0d0-9845a1d5780f service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:04:37.592958 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c56da-8aae-4502-8003-7e639383698f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:04:37.593739 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c56da-8aae-4502-8003-7e639383698f service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:37.594020 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c56da-8aae-4502-8003-7e639383698f service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:37.594290 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c56da-8aae-4502-8003-7e639383698f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:37.596055 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-909c56da-8aae-4502-8003-7e639383698f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:37.659505 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c56da-8aae-4502-8003-7e639383698f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:04:37.660934 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c56da-8aae-4502-8003-7e639383698f service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:04:37.671156 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 906/1815] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:04:37 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:04:40.243086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8360f-47e3-4144-90a8-dcde1eafede9 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:04:40.243735 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8360f-47e3-4144-90a8-dcde1eafede9 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:04:40.243832 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8360f-47e3-4144-90a8-dcde1eafede9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:04:40.266181 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-85c8360f-47e3-4144-90a8-dcde1eafede9 None None] MFA Rules not processed for user `c7bbc84e02454949a8936c856f19bace`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:04:40.267422 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-85c8360f-47e3-4144-90a8-dcde1eafede9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:04:40.275232 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 910/1816] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:04:40 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:08.395042 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c56da-8aae-4502-8003-7e639383698f service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:08.396504 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-909c56da-8aae-4502-8003-7e639383698f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:08.410157 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c56da-8aae-4502-8003-7e639383698f service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:08.414711 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c68f4-5155-4bce-a2b4-4b44b63afd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:08.415636 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c68f4-5155-4bce-a2b4-4b44b63afd31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:08.415919 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c68f4-5155-4bce-a2b4-4b44b63afd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:08.416191 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c68f4-5155-4bce-a2b4-4b44b63afd31 admin admin] PATH_INFO: `/v3/users/a69a754edcbb415f81ffd2777af46e2e` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:08.417554 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c68f4-5155-4bce-a2b4-4b44b63afd31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a69a754edcbb415f81ffd2777af46e2e)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:08.419607 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c68f4-5155-4bce-a2b4-4b44b63afd31 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:08.483845 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-0e9c68f4-5155-4bce-a2b4-4b44b63afd31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a69a754edcbb415f81ffd2777af46e2e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:08.496863 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-0e9c68f4-5155-4bce-a2b4-4b44b63afd31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a69a754edcbb415f81ffd2777af46e2e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:08.497562 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-0e9c68f4-5155-4bce-a2b4-4b44b63afd31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a69a754edcbb415f81ffd2777af46e2e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:08.504744 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-0e9c68f4-5155-4bce-a2b4-4b44b63afd31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a69a754edcbb415f81ffd2777af46e2e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:08.515132 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-0e9c68f4-5155-4bce-a2b4-4b44b63afd31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a69a754edcbb415f81ffd2777af46e2e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:08.522384 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 907/1817] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:08 2021] DELETE /identity/v3/users/a69a754edcbb415f81ffd2777af46e2e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:08.527770 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38585b-3926-428e-a1e4-96923ce01105 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:08.528287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38585b-3926-428e-a1e4-96923ce01105 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:08.529021 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38585b-3926-428e-a1e4-96923ce01105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:08.555531 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-6c38585b-3926-428e-a1e4-96923ce01105 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:08.556854 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-6c38585b-3926-428e-a1e4-96923ce01105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:08.626969 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 911/1818] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:08.638919 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c68f4-5155-4bce-a2b4-4b44b63afd31 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:08.640412 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-0e9c68f4-5155-4bce-a2b4-4b44b63afd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:08.718303 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c68f4-5155-4bce-a2b4-4b44b63afd31 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:08.720327 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d18af-21be-4d81-af8a-7b7625b7e41f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:08.720998 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d18af-21be-4d81-af8a-7b7625b7e41f service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:08.721503 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d18af-21be-4d81-af8a-7b7625b7e41f service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:08.721789 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d18af-21be-4d81-af8a-7b7625b7e41f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:08.734726 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d18af-21be-4d81-af8a-7b7625b7e41f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:08.736089 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d18af-21be-4d81-af8a-7b7625b7e41f service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:08.748857 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 908/1819] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:09.144821 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38585b-3926-428e-a1e4-96923ce01105 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:09.146948 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-6c38585b-3926-428e-a1e4-96923ce01105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:09.163649 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38585b-3926-428e-a1e4-96923ce01105 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:09.170892 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d2108-13d3-45ac-8f44-c2116ac3c7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:09.171812 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d2108-13d3-45ac-8f44-c2116ac3c7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:09.172179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d2108-13d3-45ac-8f44-c2116ac3c7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:09.172456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d2108-13d3-45ac-8f44-c2116ac3c7d2 admin admin] PATH_INFO: `/v3/projects/b2b3016f8355426cb17e1fc15a937b82` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:09.173785 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d2108-13d3-45ac-8f44-c2116ac3c7d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b3016f8355426cb17e1fc15a937b82)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:09.177119 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d2108-13d3-45ac-8f44-c2116ac3c7d2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:09.235650 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-731d2108-13d3-45ac-8f44-c2116ac3c7d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b3016f8355426cb17e1fc15a937b82', 'request_id': 'req-731d2108-13d3-45ac-8f44-c2116ac3c7d2'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:09.243164 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-731d2108-13d3-45ac-8f44-c2116ac3c7d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b3016f8355426cb17e1fc15a937b82', 'request_id': 'req-731d2108-13d3-45ac-8f44-c2116ac3c7d2'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:09.249338 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-731d2108-13d3-45ac-8f44-c2116ac3c7d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b3016f8355426cb17e1fc15a937b82', 'request_id': 'req-731d2108-13d3-45ac-8f44-c2116ac3c7d2'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:09.268071 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-731d2108-13d3-45ac-8f44-c2116ac3c7d2 admin admin] The token cache is being invalidate because project b2b3016f8355426cb17e1fc15a937b82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:09.268417 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-731d2108-13d3-45ac-8f44-c2116ac3c7d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:09.269197 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-731d2108-13d3-45ac-8f44-c2116ac3c7d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:09.274050 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 912/1820] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:09 2021] DELETE /identity/v3/projects/b2b3016f8355426cb17e1fc15a937b82 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:09.275083 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d18af-21be-4d81-af8a-7b7625b7e41f service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:09.285762 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d18af-21be-4d81-af8a-7b7625b7e41f service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:09.349847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4f13f-090b-4ec2-957a-67eac4e3696d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:09.350905 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4f13f-090b-4ec2-957a-67eac4e3696d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:09.351194 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4f13f-090b-4ec2-957a-67eac4e3696d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:09.351523 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4f13f-090b-4ec2-957a-67eac4e3696d admin admin] PATH_INFO: `/v3/users/d4ad53649eeb483794d2517a1426bf04` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:09.352748 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4f13f-090b-4ec2-957a-67eac4e3696d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ad53649eeb483794d2517a1426bf04)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:09.355061 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4f13f-090b-4ec2-957a-67eac4e3696d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:09.405636 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-abe4f13f-090b-4ec2-957a-67eac4e3696d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ad53649eeb483794d2517a1426bf04'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:09.418651 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-abe4f13f-090b-4ec2-957a-67eac4e3696d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ad53649eeb483794d2517a1426bf04'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:09.419546 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-abe4f13f-090b-4ec2-957a-67eac4e3696d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ad53649eeb483794d2517a1426bf04'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:09.426474 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-abe4f13f-090b-4ec2-957a-67eac4e3696d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ad53649eeb483794d2517a1426bf04'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:09.444717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-abe4f13f-090b-4ec2-957a-67eac4e3696d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ad53649eeb483794d2517a1426bf04'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:09.451598 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 909/1821] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:09 2021] DELETE /identity/v3/users/d4ad53649eeb483794d2517a1426bf04 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:09.820802 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d2108-13d3-45ac-8f44-c2116ac3c7d2 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:09.822362 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-731d2108-13d3-45ac-8f44-c2116ac3c7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:09.836527 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d2108-13d3-45ac-8f44-c2116ac3c7d2 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:09.877362 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4f13f-090b-4ec2-957a-67eac4e3696d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:09.879086 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-abe4f13f-090b-4ec2-957a-67eac4e3696d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:09.921983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cedcf3-77a6-4cd0-8eef-d3318f1d9170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:09.922853 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cedcf3-77a6-4cd0-8eef-d3318f1d9170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:09.923135 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cedcf3-77a6-4cd0-8eef-d3318f1d9170 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:09.923436 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cedcf3-77a6-4cd0-8eef-d3318f1d9170 admin admin] PATH_INFO: `/v3/projects/41634e2bfbd949fa948b9bd187c5583b` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:09.924921 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cedcf3-77a6-4cd0-8eef-d3318f1d9170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41634e2bfbd949fa948b9bd187c5583b)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:09.926858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cedcf3-77a6-4cd0-8eef-d3318f1d9170 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:09.946561 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4f13f-090b-4ec2-957a-67eac4e3696d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:09.951581 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12d5bf-aca9-47f0-a429-57a1be3e2a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:09.952740 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12d5bf-aca9-47f0-a429-57a1be3e2a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:09.953225 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12d5bf-aca9-47f0-a429-57a1be3e2a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:09.953707 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12d5bf-aca9-47f0-a429-57a1be3e2a34 admin admin] PATH_INFO: `/v3/users/e42aedf589394bb3b7382d53ef25f22f` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:09.955144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12d5bf-aca9-47f0-a429-57a1be3e2a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e42aedf589394bb3b7382d53ef25f22f)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:09.957759 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12d5bf-aca9-47f0-a429-57a1be3e2a34 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:09.986410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a7cedcf3-77a6-4cd0-8eef-d3318f1d9170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41634e2bfbd949fa948b9bd187c5583b', 'request_id': 'req-a7cedcf3-77a6-4cd0-8eef-d3318f1d9170'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:09.994750 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a7cedcf3-77a6-4cd0-8eef-d3318f1d9170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41634e2bfbd949fa948b9bd187c5583b', 'request_id': 'req-a7cedcf3-77a6-4cd0-8eef-d3318f1d9170'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:10.001969 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a7cedcf3-77a6-4cd0-8eef-d3318f1d9170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41634e2bfbd949fa948b9bd187c5583b', 'request_id': 'req-a7cedcf3-77a6-4cd0-8eef-d3318f1d9170'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:10.012859 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-df12d5bf-aca9-47f0-a429-57a1be3e2a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e42aedf589394bb3b7382d53ef25f22f'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:10.016732 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a7cedcf3-77a6-4cd0-8eef-d3318f1d9170 admin admin] The token cache is being invalidate because project 41634e2bfbd949fa948b9bd187c5583b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:10.017033 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a7cedcf3-77a6-4cd0-8eef-d3318f1d9170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:10.017663 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a7cedcf3-77a6-4cd0-8eef-d3318f1d9170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:10.019251 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 913/1822] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:09 2021] DELETE /identity/v3/projects/41634e2bfbd949fa948b9bd187c5583b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:10.025362 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19462ba0-4856-4f51-9fc6-0e6c2e091863 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:10.025595 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-df12d5bf-aca9-47f0-a429-57a1be3e2a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e42aedf589394bb3b7382d53ef25f22f'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:10.025717 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19462ba0-4856-4f51-9fc6-0e6c2e091863 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:10.026758 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19462ba0-4856-4f51-9fc6-0e6c2e091863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:10.027210 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-df12d5bf-aca9-47f0-a429-57a1be3e2a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e42aedf589394bb3b7382d53ef25f22f'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:10.034490 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-df12d5bf-aca9-47f0-a429-57a1be3e2a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e42aedf589394bb3b7382d53ef25f22f'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:10.043390 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-df12d5bf-aca9-47f0-a429-57a1be3e2a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e42aedf589394bb3b7382d53ef25f22f'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:10.048866 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-19462ba0-4856-4f51-9fc6-0e6c2e091863 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:10.050079 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-19462ba0-4856-4f51-9fc6-0e6c2e091863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:10.053387 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 910/1823] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:09 2021] DELETE /identity/v3/users/e42aedf589394bb3b7382d53ef25f22f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:10.054886 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268ee5c-5403-4caf-8e69-6a30d0fbf869 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:10.055233 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268ee5c-5403-4caf-8e69-6a30d0fbf869 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:10.055541 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268ee5c-5403-4caf-8e69-6a30d0fbf869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:10.076448 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-3268ee5c-5403-4caf-8e69-6a30d0fbf869 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:10.077732 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-3268ee5c-5403-4caf-8e69-6a30d0fbf869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:10.132166 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 914/1824] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:10.139868 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e6ef5-4644-408b-9a41-4fa27675c179 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:10.140164 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e6ef5-4644-408b-9a41-4fa27675c179 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:10.140447 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e6ef5-4644-408b-9a41-4fa27675c179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:10.159329 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 911/1825] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:10.159509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-424e6ef5-4644-408b-9a41-4fa27675c179 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:10.160758 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-424e6ef5-4644-408b-9a41-4fa27675c179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:10.169418 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 915/1826] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:10.171508 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268ee5c-5403-4caf-8e69-6a30d0fbf869 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:10.173311 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-3268ee5c-5403-4caf-8e69-6a30d0fbf869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:10.173447 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e6ef5-4644-408b-9a41-4fa27675c179 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:10.183120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e6ef5-4644-408b-9a41-4fa27675c179 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:10.188597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d158a3-11fd-4a25-ab5d-6e5fbc47edb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:10.189077 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d158a3-11fd-4a25-ab5d-6e5fbc47edb3 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:10.189460 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d158a3-11fd-4a25-ab5d-6e5fbc47edb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:10.189838 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d158a3-11fd-4a25-ab5d-6e5fbc47edb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:10.190699 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d158a3-11fd-4a25-ab5d-6e5fbc47edb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:05:10.191106 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d158a3-11fd-4a25-ab5d-6e5fbc47edb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:10.192846 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d158a3-11fd-4a25-ab5d-6e5fbc47edb3 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:10.208187 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 916/1827] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:05:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:05:10.209331 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d158a3-11fd-4a25-ab5d-6e5fbc47edb3 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:10.220705 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d158a3-11fd-4a25-ab5d-6e5fbc47edb3 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:10.225568 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cfdb5-7f0f-447f-9701-77a2c114453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:10.226395 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cfdb5-7f0f-447f-9701-77a2c114453b admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:10.226819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cfdb5-7f0f-447f-9701-77a2c114453b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:10.227277 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cfdb5-7f0f-447f-9701-77a2c114453b admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:10.228165 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94cfdb5-7f0f-447f-9701-77a2c114453b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:10.232071 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94cfdb5-7f0f-447f-9701-77a2c114453b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:10.239304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268ee5c-5403-4caf-8e69-6a30d0fbf869 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:10.243513 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548a107-2e72-40b0-8a9e-8689efc54e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:10.244340 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548a107-2e72-40b0-8a9e-8689efc54e17 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:10.245360 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548a107-2e72-40b0-8a9e-8689efc54e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:10.245784 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548a107-2e72-40b0-8a9e-8689efc54e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:10.256384 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548a107-2e72-40b0-8a9e-8689efc54e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:10.257859 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548a107-2e72-40b0-8a9e-8689efc54e17 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:10.263188 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 917/1828] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:10 2021] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:10.264752 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cfdb5-7f0f-447f-9701-77a2c114453b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:10.269122 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 912/1829] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:10.329604 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cfdb5-7f0f-447f-9701-77a2c114453b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:10.334563 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8762107-160a-4650-bf26-7954d51e5bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:10.335230 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8762107-160a-4650-bf26-7954d51e5bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:10.335702 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8762107-160a-4650-bf26-7954d51e5bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:10.335980 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8762107-160a-4650-bf26-7954d51e5bf8 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:10.336833 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8762107-160a-4650-bf26-7954d51e5bf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:10.338762 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8762107-160a-4650-bf26-7954d51e5bf8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:10.368782 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 918/1830] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:10 2021] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:10.370746 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548a107-2e72-40b0-8a9e-8689efc54e17 service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:10.388110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548a107-2e72-40b0-8a9e-8689efc54e17 service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:10.399553 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6e46b-0cce-4ee0-bd2d-dc3b61726c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:10.401488 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6e46b-0cce-4ee0-bd2d-dc3b61726c6d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:10.402213 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6e46b-0cce-4ee0-bd2d-dc3b61726c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:10.403003 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6e46b-0cce-4ee0-bd2d-dc3b61726c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:10.405008 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6e46b-0cce-4ee0-bd2d-dc3b61726c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:10.410165 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6e46b-0cce-4ee0-bd2d-dc3b61726c6d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:10.434241 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 913/1831] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:10 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:05:10.442581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8762107-160a-4650-bf26-7954d51e5bf8 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:10.457053 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8762107-160a-4650-bf26-7954d51e5bf8 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:10.462180 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9334a6-28f8-44a9-9a9a-ab633144ab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:10.462849 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9334a6-28f8-44a9-9a9a-ab633144ab23 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:10.463564 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9334a6-28f8-44a9-9a9a-ab633144ab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:10.463564 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9334a6-28f8-44a9-9a9a-ab633144ab23 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:10.464412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9334a6-28f8-44a9-9a9a-ab633144ab23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:10.466096 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9334a6-28f8-44a9-9a9a-ab633144ab23 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:10.477506 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 919/1832] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:10 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:10.482476 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6e46b-0cce-4ee0-bd2d-dc3b61726c6d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:10.493496 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6e46b-0cce-4ee0-bd2d-dc3b61726c6d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:10.498892 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fab10-7b8a-40f8-ae5b-046bb3dc67d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:10.500114 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fab10-7b8a-40f8-ae5b-046bb3dc67d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:10.500415 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fab10-7b8a-40f8-ae5b-046bb3dc67d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:10.500918 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fab10-7b8a-40f8-ae5b-046bb3dc67d7 admin admin] PATH_INFO: `/v3/projects/046b73bfb41e4384ba137cc360e963ca/users/cbe4f07737d34a61877107af86ce2616/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:10.518833 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989fab10-7b8a-40f8-ae5b-046bb3dc67d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=046b73bfb41e4384ba137cc360e963ca, user_id=cbe4f07737d34a61877107af86ce2616, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:10.521603 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989fab10-7b8a-40f8-ae5b-046bb3dc67d7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:10.540899 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 914/1833] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:10 2021] PUT /identity/v3/projects/046b73bfb41e4384ba137cc360e963ca/users/cbe4f07737d34a61877107af86ce2616/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:10.553546 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63149c-94d5-4153-b93b-548608ee8a5d None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:10.553839 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63149c-94d5-4153-b93b-548608ee8a5d None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:10.554108 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63149c-94d5-4153-b93b-548608ee8a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:10.585326 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-1e63149c-94d5-4153-b93b-548608ee8a5d None None] MFA Rules not processed for user `cbe4f07737d34a61877107af86ce2616`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:10.586598 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1e63149c-94d5-4153-b93b-548608ee8a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:10.666704 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 920/1834] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:10 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:10.672885 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fab10-7b8a-40f8-ae5b-046bb3dc67d7 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:10.763644 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fab10-7b8a-40f8-ae5b-046bb3dc67d7 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:10.769462 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38e34a-d3cb-4ca4-ad4c-9f38d8161b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:10.772062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38e34a-d3cb-4ca4-ad4c-9f38d8161b03 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:10.772549 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38e34a-d3cb-4ca4-ad4c-9f38d8161b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:10.772999 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38e34a-d3cb-4ca4-ad4c-9f38d8161b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:10.774079 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38e34a-d3cb-4ca4-ad4c-9f38d8161b03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:10.776093 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38e34a-d3cb-4ca4-ad4c-9f38d8161b03 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:10.809173 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 915/1835] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:10 2021] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:10.813866 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63149c-94d5-4153-b93b-548608ee8a5d None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:10.828282 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63149c-94d5-4153-b93b-548608ee8a5d None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:10.904971 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb3783-d569-49a0-9893-5aa39fab0d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:10.905913 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb3783-d569-49a0-9893-5aa39fab0d1c admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:10.906528 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb3783-d569-49a0-9893-5aa39fab0d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:10.906944 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb3783-d569-49a0-9893-5aa39fab0d1c admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:10.907827 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb3783-d569-49a0-9893-5aa39fab0d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:10.909939 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb3783-d569-49a0-9893-5aa39fab0d1c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:10.939042 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 921/1836] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:10 2021] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:10.943163 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38e34a-d3cb-4ca4-ad4c-9f38d8161b03 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:10.954513 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38e34a-d3cb-4ca4-ad4c-9f38d8161b03 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:10.959328 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c30058-999b-47d8-bce9-7284895d6758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:10.960038 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c30058-999b-47d8-bce9-7284895d6758 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:10.960323 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c30058-999b-47d8-bce9-7284895d6758 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:10.960601 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c30058-999b-47d8-bce9-7284895d6758 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:10.961416 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c30058-999b-47d8-bce9-7284895d6758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:10.963054 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c30058-999b-47d8-bce9-7284895d6758 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:10.975306 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 916/1837] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:10 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:05:10.980325 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb3783-d569-49a0-9893-5aa39fab0d1c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:10.995483 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb3783-d569-49a0-9893-5aa39fab0d1c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:11.000817 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad5883-ea81-4d6f-ae00-2a8e5664df4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:11.001895 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad5883-ea81-4d6f-ae00-2a8e5664df4d admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:11.002353 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad5883-ea81-4d6f-ae00-2a8e5664df4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:11.002632 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad5883-ea81-4d6f-ae00-2a8e5664df4d admin admin] PATH_INFO: `/v3/projects/85d2cceccda54a3fab814e300cf3acca/users/0348bd6afcba40baa818e55b7d6b5eb0/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:11.020081 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad5883-ea81-4d6f-ae00-2a8e5664df4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d2cceccda54a3fab814e300cf3acca, user_id=0348bd6afcba40baa818e55b7d6b5eb0, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:11.023102 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad5883-ea81-4d6f-ae00-2a8e5664df4d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:11.037430 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 922/1838] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:10 2021] PUT /identity/v3/projects/85d2cceccda54a3fab814e300cf3acca/users/0348bd6afcba40baa818e55b7d6b5eb0/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:11.039245 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c30058-999b-47d8-bce9-7284895d6758 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:11.041130 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-25c30058-999b-47d8-bce9-7284895d6758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:11.047740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad5883-ea81-4d6f-ae00-2a8e5664df4d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:11.064319 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c30058-999b-47d8-bce9-7284895d6758 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:11.151872 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad5883-ea81-4d6f-ae00-2a8e5664df4d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:11.159599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef620856-f174-45c5-9fb4-a718480ec326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:11.160310 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef620856-f174-45c5-9fb4-a718480ec326 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:11.160650 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef620856-f174-45c5-9fb4-a718480ec326 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:11.161298 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef620856-f174-45c5-9fb4-a718480ec326 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:11.162090 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef620856-f174-45c5-9fb4-a718480ec326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:11.164029 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef620856-f174-45c5-9fb4-a718480ec326 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:11.168053 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2c450-b7ba-40b9-a5a5-0aa778d530c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:11.169045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2c450-b7ba-40b9-a5a5-0aa778d530c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:11.169509 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2c450-b7ba-40b9-a5a5-0aa778d530c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:11.169793 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2c450-b7ba-40b9-a5a5-0aa778d530c6 admin admin] PATH_INFO: `/v3/projects/02a2e04e6fe947c4b0bcc76255ec0e15` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:11.171005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2c450-b7ba-40b9-a5a5-0aa778d530c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02a2e04e6fe947c4b0bcc76255ec0e15)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:11.173296 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2c450-b7ba-40b9-a5a5-0aa778d530c6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:11.181651 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 923/1839] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:11 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:05:11.182716 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef620856-f174-45c5-9fb4-a718480ec326 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:11.193667 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef620856-f174-45c5-9fb4-a718480ec326 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:11.199054 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5a858-e46f-45ce-b59a-6731fd4d50f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:11.200205 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5a858-e46f-45ce-b59a-6731fd4d50f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:11.200670 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5a858-e46f-45ce-b59a-6731fd4d50f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:11.201272 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5a858-e46f-45ce-b59a-6731fd4d50f6 admin admin] PATH_INFO: `/v3/projects/85d2cceccda54a3fab814e300cf3acca/users/0348bd6afcba40baa818e55b7d6b5eb0/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:11.203457 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5a858-e46f-45ce-b59a-6731fd4d50f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d2cceccda54a3fab814e300cf3acca, user_id=0348bd6afcba40baa818e55b7d6b5eb0, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:11.206337 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5a858-e46f-45ce-b59a-6731fd4d50f6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:11.218749 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 924/1840] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:11 2021] PUT /identity/v3/projects/85d2cceccda54a3fab814e300cf3acca/users/0348bd6afcba40baa818e55b7d6b5eb0/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:11.230185 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3210ce-23d0-41a3-a8f0-dd686eb9e3cf None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:11.230750 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3210ce-23d0-41a3-a8f0-dd686eb9e3cf None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:11.231182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3210ce-23d0-41a3-a8f0-dd686eb9e3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:11.237201 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d0b2c450-b7ba-40b9-a5a5-0aa778d530c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02a2e04e6fe947c4b0bcc76255ec0e15', 'request_id': 'req-d0b2c450-b7ba-40b9-a5a5-0aa778d530c6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:11.249334 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d0b2c450-b7ba-40b9-a5a5-0aa778d530c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02a2e04e6fe947c4b0bcc76255ec0e15', 'request_id': 'req-d0b2c450-b7ba-40b9-a5a5-0aa778d530c6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:11.265172 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d0b2c450-b7ba-40b9-a5a5-0aa778d530c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02a2e04e6fe947c4b0bcc76255ec0e15', 'request_id': 'req-d0b2c450-b7ba-40b9-a5a5-0aa778d530c6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:11.276331 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-8f3210ce-23d0-41a3-a8f0-dd686eb9e3cf None None] MFA Rules not processed for user `0348bd6afcba40baa818e55b7d6b5eb0`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:11.277883 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-8f3210ce-23d0-41a3-a8f0-dd686eb9e3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:11.286750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d0b2c450-b7ba-40b9-a5a5-0aa778d530c6 admin admin] The token cache is being invalidate because project 02a2e04e6fe947c4b0bcc76255ec0e15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:11.287051 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d0b2c450-b7ba-40b9-a5a5-0aa778d530c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:11.287941 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d0b2c450-b7ba-40b9-a5a5-0aa778d530c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:11.289794 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 917/1841] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:11 2021] DELETE /identity/v3/projects/02a2e04e6fe947c4b0bcc76255ec0e15 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:11.294283 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2c450-b7ba-40b9-a5a5-0aa778d530c6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:11.295932 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-d0b2c450-b7ba-40b9-a5a5-0aa778d530c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:11.375384 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 925/1842] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:11 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:11.381681 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3210ce-23d0-41a3-a8f0-dd686eb9e3cf None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:11.383173 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-8f3210ce-23d0-41a3-a8f0-dd686eb9e3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:11.394956 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2c450-b7ba-40b9-a5a5-0aa778d530c6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:11.402512 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab5f0c-90e5-4dc1-954d-3ec66c713edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:11.403408 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab5f0c-90e5-4dc1-954d-3ec66c713edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:11.403699 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab5f0c-90e5-4dc1-954d-3ec66c713edc admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:11.404021 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab5f0c-90e5-4dc1-954d-3ec66c713edc admin admin] PATH_INFO: `/v3/users/bf48e1a2f70546f8ae95994a3de8999e` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:11.405244 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab5f0c-90e5-4dc1-954d-3ec66c713edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf48e1a2f70546f8ae95994a3de8999e)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:11.406020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3210ce-23d0-41a3-a8f0-dd686eb9e3cf None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:11.407225 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab5f0c-90e5-4dc1-954d-3ec66c713edc admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:11.411692 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984b780-e71a-4f12-a565-e3c99fb56c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:11.412648 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984b780-e71a-4f12-a565-e3c99fb56c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:11.412998 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984b780-e71a-4f12-a565-e3c99fb56c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:11.413350 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984b780-e71a-4f12-a565-e3c99fb56c49 admin admin] PATH_INFO: `/v3/users/cbe4f07737d34a61877107af86ce2616` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:11.415488 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984b780-e71a-4f12-a565-e3c99fb56c49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe4f07737d34a61877107af86ce2616)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:11.418423 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984b780-e71a-4f12-a565-e3c99fb56c49 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:11.462553 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-edab5f0c-90e5-4dc1-954d-3ec66c713edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf48e1a2f70546f8ae95994a3de8999e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:11.484486 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-edab5f0c-90e5-4dc1-954d-3ec66c713edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf48e1a2f70546f8ae95994a3de8999e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:11.487941 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-edab5f0c-90e5-4dc1-954d-3ec66c713edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf48e1a2f70546f8ae95994a3de8999e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:11.493590 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1984b780-e71a-4f12-a565-e3c99fb56c49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe4f07737d34a61877107af86ce2616'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:11.497499 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-edab5f0c-90e5-4dc1-954d-3ec66c713edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf48e1a2f70546f8ae95994a3de8999e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:11.504038 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1984b780-e71a-4f12-a565-e3c99fb56c49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe4f07737d34a61877107af86ce2616'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:11.506737 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-edab5f0c-90e5-4dc1-954d-3ec66c713edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf48e1a2f70546f8ae95994a3de8999e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:11.513211 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1984b780-e71a-4f12-a565-e3c99fb56c49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe4f07737d34a61877107af86ce2616'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:11.520010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 918/1843] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:11 2021] DELETE /identity/v3/users/bf48e1a2f70546f8ae95994a3de8999e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:11.531651 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1984b780-e71a-4f12-a565-e3c99fb56c49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe4f07737d34a61877107af86ce2616'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:11.540277 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1984b780-e71a-4f12-a565-e3c99fb56c49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe4f07737d34a61877107af86ce2616'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:11.556426 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 926/1844] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:11 2021] DELETE /identity/v3/users/cbe4f07737d34a61877107af86ce2616 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:11.562310 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47d748-9b3f-4732-9169-bbbd030d71ca None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:11.562423 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47d748-9b3f-4732-9169-bbbd030d71ca None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:11.562647 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47d748-9b3f-4732-9169-bbbd030d71ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:11.581414 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-cd47d748-9b3f-4732-9169-bbbd030d71ca None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:11.582635 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-cd47d748-9b3f-4732-9169-bbbd030d71ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:11.646405 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 919/1845] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:11.658359 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984b780-e71a-4f12-a565-e3c99fb56c49 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:11.660122 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1984b780-e71a-4f12-a565-e3c99fb56c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:11.720256 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984b780-e71a-4f12-a565-e3c99fb56c49 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:11.724236 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84785582-c7cd-41dc-ae90-418d36ba348f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:11.725071 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84785582-c7cd-41dc-ae90-418d36ba348f service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:11.725396 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84785582-c7cd-41dc-ae90-418d36ba348f service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:11.725671 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84785582-c7cd-41dc-ae90-418d36ba348f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:11.736026 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84785582-c7cd-41dc-ae90-418d36ba348f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:11.737631 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84785582-c7cd-41dc-ae90-418d36ba348f service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:11.747995 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 927/1846] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:12.045239 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47d748-9b3f-4732-9169-bbbd030d71ca None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:12.046688 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-cd47d748-9b3f-4732-9169-bbbd030d71ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:12.058960 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47d748-9b3f-4732-9169-bbbd030d71ca None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:12.064451 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5dc73-5dfe-462a-aa07-9516a6a84f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:12.065566 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5dc73-5dfe-462a-aa07-9516a6a84f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:12.066120 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5dc73-5dfe-462a-aa07-9516a6a84f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:12.066601 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5dc73-5dfe-462a-aa07-9516a6a84f05 admin admin] PATH_INFO: `/v3/users/39c19d1dc2734b3fbf827de84bfba57d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:12.068044 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5dc73-5dfe-462a-aa07-9516a6a84f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39c19d1dc2734b3fbf827de84bfba57d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:12.070321 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5dc73-5dfe-462a-aa07-9516a6a84f05 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:12.149067 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84785582-c7cd-41dc-ae90-418d36ba348f service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:12.152454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-84785582-c7cd-41dc-ae90-418d36ba348f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:12.171020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84785582-c7cd-41dc-ae90-418d36ba348f service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:12.178072 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c538f-f9ad-46f3-8488-d63e4b0e73d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:12.179320 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c538f-f9ad-46f3-8488-d63e4b0e73d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:12.179905 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c538f-f9ad-46f3-8488-d63e4b0e73d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:12.180370 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c538f-f9ad-46f3-8488-d63e4b0e73d0 admin admin] PATH_INFO: `/v3/projects/f39f60257c7248e9b2da1aa464ab16e3` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:12.181818 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c538f-f9ad-46f3-8488-d63e4b0e73d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f39f60257c7248e9b2da1aa464ab16e3)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:12.185498 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-05a5dc73-5dfe-462a-aa07-9516a6a84f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39c19d1dc2734b3fbf827de84bfba57d'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.186169 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c538f-f9ad-46f3-8488-d63e4b0e73d0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:12.201950 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-05a5dc73-5dfe-462a-aa07-9516a6a84f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39c19d1dc2734b3fbf827de84bfba57d'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.202701 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-05a5dc73-5dfe-462a-aa07-9516a6a84f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39c19d1dc2734b3fbf827de84bfba57d'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.210873 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-05a5dc73-5dfe-462a-aa07-9516a6a84f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39c19d1dc2734b3fbf827de84bfba57d'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.233140 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-05a5dc73-5dfe-462a-aa07-9516a6a84f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39c19d1dc2734b3fbf827de84bfba57d'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.233140 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 920/1847] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:12 2021] DELETE /identity/v3/users/39c19d1dc2734b3fbf827de84bfba57d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:12.237810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b938b6-f5db-415e-a316-da0e47beeb1f None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:12.237810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b938b6-f5db-415e-a316-da0e47beeb1f None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:12.238044 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b938b6-f5db-415e-a316-da0e47beeb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:12.262216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-49b938b6-f5db-415e-a316-da0e47beeb1f None None] MFA Rules not processed for user `c7bbc84e02454949a8936c856f19bace`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:12.264430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-49b938b6-f5db-415e-a316-da0e47beeb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:12.316826 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-bd4c538f-f9ad-46f3-8488-d63e4b0e73d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f39f60257c7248e9b2da1aa464ab16e3', 'request_id': 'req-bd4c538f-f9ad-46f3-8488-d63e4b0e73d0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.335848 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-bd4c538f-f9ad-46f3-8488-d63e4b0e73d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f39f60257c7248e9b2da1aa464ab16e3', 'request_id': 'req-bd4c538f-f9ad-46f3-8488-d63e4b0e73d0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.349936 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-bd4c538f-f9ad-46f3-8488-d63e4b0e73d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f39f60257c7248e9b2da1aa464ab16e3', 'request_id': 'req-bd4c538f-f9ad-46f3-8488-d63e4b0e73d0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.353578 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 921/1848] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:12 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:12.355411 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b938b6-f5db-415e-a316-da0e47beeb1f None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:12.368216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-49b938b6-f5db-415e-a316-da0e47beeb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:12.372321 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-bd4c538f-f9ad-46f3-8488-d63e4b0e73d0 admin admin] The token cache is being invalidate because project f39f60257c7248e9b2da1aa464ab16e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:12.372484 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-bd4c538f-f9ad-46f3-8488-d63e4b0e73d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.373598 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-bd4c538f-f9ad-46f3-8488-d63e4b0e73d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.375708 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 928/1849] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:12 2021] DELETE /identity/v3/projects/f39f60257c7248e9b2da1aa464ab16e3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:12.382072 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495c2d8-2a16-40ef-a666-912af239adf4 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:12.382674 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495c2d8-2a16-40ef-a666-912af239adf4 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:12.383654 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495c2d8-2a16-40ef-a666-912af239adf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:12.412875 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-6495c2d8-2a16-40ef-a666-912af239adf4 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:12.414820 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-6495c2d8-2a16-40ef-a666-912af239adf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:12.458431 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b938b6-f5db-415e-a316-da0e47beeb1f None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:12.524277 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 929/1850] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:12.533123 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba34d06-ee8d-4e92-83b6-7bd2778a5991 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:12.533592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba34d06-ee8d-4e92-83b6-7bd2778a5991 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:12.534163 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba34d06-ee8d-4e92-83b6-7bd2778a5991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:12.542541 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20205666-6490-4b74-8400-a250a18e87dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:12.545500 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20205666-6490-4b74-8400-a250a18e87dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:12.545929 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20205666-6490-4b74-8400-a250a18e87dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:12.546304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20205666-6490-4b74-8400-a250a18e87dc admin admin] PATH_INFO: `/v3/projects/046b73bfb41e4384ba137cc360e963ca` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:12.547964 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20205666-6490-4b74-8400-a250a18e87dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=046b73bfb41e4384ba137cc360e963ca)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:12.550050 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20205666-6490-4b74-8400-a250a18e87dc admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:12.566494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-7ba34d06-ee8d-4e92-83b6-7bd2778a5991 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:12.567741 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-7ba34d06-ee8d-4e92-83b6-7bd2778a5991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:12.581646 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 930/1851] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:12.582990 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba34d06-ee8d-4e92-83b6-7bd2778a5991 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:12.595805 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba34d06-ee8d-4e92-83b6-7bd2778a5991 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:12.601781 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b5627-f645-41f3-bfe7-1859c1d83cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:12.602881 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b5627-f645-41f3-bfe7-1859c1d83cae admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:12.603430 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b5627-f645-41f3-bfe7-1859c1d83cae admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:12.603716 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b5627-f645-41f3-bfe7-1859c1d83cae admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:12.605033 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b5627-f645-41f3-bfe7-1859c1d83cae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:05:12.605248 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b5627-f645-41f3-bfe7-1859c1d83cae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:12.607327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b5627-f645-41f3-bfe7-1859c1d83cae admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:12.623818 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-20205666-6490-4b74-8400-a250a18e87dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046b73bfb41e4384ba137cc360e963ca', 'request_id': 'req-20205666-6490-4b74-8400-a250a18e87dc'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.627045 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 931/1852] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:05:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:05:12.631883 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b5627-f645-41f3-bfe7-1859c1d83cae admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:12.650613 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-20205666-6490-4b74-8400-a250a18e87dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046b73bfb41e4384ba137cc360e963ca', 'request_id': 'req-20205666-6490-4b74-8400-a250a18e87dc'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.656153 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b5627-f645-41f3-bfe7-1859c1d83cae admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:12.665023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-20205666-6490-4b74-8400-a250a18e87dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046b73bfb41e4384ba137cc360e963ca', 'request_id': 'req-20205666-6490-4b74-8400-a250a18e87dc'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.718835 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-20205666-6490-4b74-8400-a250a18e87dc admin admin] The token cache is being invalidate because project 046b73bfb41e4384ba137cc360e963ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:12.719012 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-20205666-6490-4b74-8400-a250a18e87dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.721265 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-20205666-6490-4b74-8400-a250a18e87dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.723614 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 922/1853] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:12 2021] DELETE /identity/v3/projects/046b73bfb41e4384ba137cc360e963ca => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:12.724696 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20205666-6490-4b74-8400-a250a18e87dc admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:12.729100 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-20205666-6490-4b74-8400-a250a18e87dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:12.774122 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1c7c0-ec68-4204-b462-db788e00cb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:12.774774 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1c7c0-ec68-4204-b462-db788e00cb7e admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:12.775058 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1c7c0-ec68-4204-b462-db788e00cb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:12.775328 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1c7c0-ec68-4204-b462-db788e00cb7e admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:12.777423 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1c7c0-ec68-4204-b462-db788e00cb7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:12.779079 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1c7c0-ec68-4204-b462-db788e00cb7e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:12.812346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 932/1854] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:12 2021] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:12.812346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1c7c0-ec68-4204-b462-db788e00cb7e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:12.812346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a6c1c7c0-ec68-4204-b462-db788e00cb7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:12.821811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20205666-6490-4b74-8400-a250a18e87dc admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:12.883490 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefafa3-33e2-4426-b399-f562c7dfa1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:12.884361 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefafa3-33e2-4426-b399-f562c7dfa1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:12.884749 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefafa3-33e2-4426-b399-f562c7dfa1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:12.885027 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefafa3-33e2-4426-b399-f562c7dfa1f0 admin admin] PATH_INFO: `/v3/projects/b969381b31514174b4a28e1c0d43f737` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:12.886260 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefafa3-33e2-4426-b399-f562c7dfa1f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b969381b31514174b4a28e1c0d43f737)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:12.886407 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1c7c0-ec68-4204-b462-db788e00cb7e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:12.888264 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefafa3-33e2-4426-b399-f562c7dfa1f0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:12.892970 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dd1c2-0343-4031-989a-2109d141bb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:12.893862 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dd1c2-0343-4031-989a-2109d141bb53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:12.894146 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dd1c2-0343-4031-989a-2109d141bb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:12.894696 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dd1c2-0343-4031-989a-2109d141bb53 admin admin] PATH_INFO: `/v3/users/0348bd6afcba40baa818e55b7d6b5eb0` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:12.895650 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dd1c2-0343-4031-989a-2109d141bb53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0348bd6afcba40baa818e55b7d6b5eb0)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:12.897559 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dd1c2-0343-4031-989a-2109d141bb53 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:12.942305 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-0aefafa3-33e2-4426-b399-f562c7dfa1f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b969381b31514174b4a28e1c0d43f737', 'request_id': 'req-0aefafa3-33e2-4426-b399-f562c7dfa1f0'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.950641 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-0aefafa3-33e2-4426-b399-f562c7dfa1f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b969381b31514174b4a28e1c0d43f737', 'request_id': 'req-0aefafa3-33e2-4426-b399-f562c7dfa1f0'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.958656 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a52dd1c2-0343-4031-989a-2109d141bb53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0348bd6afcba40baa818e55b7d6b5eb0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.960858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a52dd1c2-0343-4031-989a-2109d141bb53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0348bd6afcba40baa818e55b7d6b5eb0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.961225 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-0aefafa3-33e2-4426-b399-f562c7dfa1f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b969381b31514174b4a28e1c0d43f737', 'request_id': 'req-0aefafa3-33e2-4426-b399-f562c7dfa1f0'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.961920 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a52dd1c2-0343-4031-989a-2109d141bb53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0348bd6afcba40baa818e55b7d6b5eb0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.976789 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a52dd1c2-0343-4031-989a-2109d141bb53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0348bd6afcba40baa818e55b7d6b5eb0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.987165 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a52dd1c2-0343-4031-989a-2109d141bb53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0348bd6afcba40baa818e55b7d6b5eb0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.989067 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-0aefafa3-33e2-4426-b399-f562c7dfa1f0 admin admin] The token cache is being invalidate because project b969381b31514174b4a28e1c0d43f737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:12.989554 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-0aefafa3-33e2-4426-b399-f562c7dfa1f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.990813 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-0aefafa3-33e2-4426-b399-f562c7dfa1f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:12.995213 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 923/1855] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:12 2021] DELETE /identity/v3/projects/b969381b31514174b4a28e1c0d43f737 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:12.995213 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefafa3-33e2-4426-b399-f562c7dfa1f0 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:12.995213 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-0aefafa3-33e2-4426-b399-f562c7dfa1f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:13.009173 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 933/1856] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:12 2021] DELETE /identity/v3/users/0348bd6afcba40baa818e55b7d6b5eb0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:13.010785 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dd1c2-0343-4031-989a-2109d141bb53 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:13.012320 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a52dd1c2-0343-4031-989a-2109d141bb53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:13.091846 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefafa3-33e2-4426-b399-f562c7dfa1f0 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:13.175020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dd1c2-0343-4031-989a-2109d141bb53 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:13.181516 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e2493-c0f5-46e4-91b5-016f20f7a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:13.183650 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e2493-c0f5-46e4-91b5-016f20f7a13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:13.184255 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e2493-c0f5-46e4-91b5-016f20f7a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:13.184599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e2493-c0f5-46e4-91b5-016f20f7a13d admin admin] PATH_INFO: `/v3/users/66d91fc430944e94bd501d3f87a000d7` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:13.185912 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e2493-c0f5-46e4-91b5-016f20f7a13d admin admin] RBAC: Authorizing `identity:delete_user(user_id=66d91fc430944e94bd501d3f87a000d7)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:13.189239 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e2493-c0f5-46e4-91b5-016f20f7a13d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:13.198019 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4473dea-ae3f-45a8-ad1a-55f8877a4626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:13.198717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4473dea-ae3f-45a8-ad1a-55f8877a4626 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:13.198994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4473dea-ae3f-45a8-ad1a-55f8877a4626 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:13.199262 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4473dea-ae3f-45a8-ad1a-55f8877a4626 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:13.199993 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4473dea-ae3f-45a8-ad1a-55f8877a4626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:13.202643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4473dea-ae3f-45a8-ad1a-55f8877a4626 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:13.230118 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 924/1857] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:12 2021] POST /identity/v3/users => generated 283 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:13.238760 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4473dea-ae3f-45a8-ad1a-55f8877a4626 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:13.247965 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-fb6e2493-c0f5-46e4-91b5-016f20f7a13d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d91fc430944e94bd501d3f87a000d7'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:13.249121 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-fb6e2493-c0f5-46e4-91b5-016f20f7a13d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d91fc430944e94bd501d3f87a000d7'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:13.250327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-fb6e2493-c0f5-46e4-91b5-016f20f7a13d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d91fc430944e94bd501d3f87a000d7'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:13.253100 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4473dea-ae3f-45a8-ad1a-55f8877a4626 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:13.261292 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99d049-eb22-4ba7-9b2a-a2ad2a32c5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:13.262046 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99d049-eb22-4ba7-9b2a-a2ad2a32c5da admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:13.262336 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99d049-eb22-4ba7-9b2a-a2ad2a32c5da admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:13.262613 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99d049-eb22-4ba7-9b2a-a2ad2a32c5da admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:13.263341 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99d049-eb22-4ba7-9b2a-a2ad2a32c5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:13.265320 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99d049-eb22-4ba7-9b2a-a2ad2a32c5da admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:13.269803 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-fb6e2493-c0f5-46e4-91b5-016f20f7a13d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d91fc430944e94bd501d3f87a000d7'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:13.277840 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 925/1858] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:13 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:05:13.281961 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99d049-eb22-4ba7-9b2a-a2ad2a32c5da admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:13.283720 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-fb6e2493-c0f5-46e4-91b5-016f20f7a13d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d91fc430944e94bd501d3f87a000d7'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:13.284707 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-da99d049-eb22-4ba7-9b2a-a2ad2a32c5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:13.300178 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 934/1859] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:13 2021] DELETE /identity/v3/users/66d91fc430944e94bd501d3f87a000d7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:13.302736 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99d049-eb22-4ba7-9b2a-a2ad2a32c5da admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:13.366623 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a342a2-4c2a-44de-a813-e0329b281181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:13.367168 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a342a2-4c2a-44de-a813-e0329b281181 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:13.367582 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a342a2-4c2a-44de-a813-e0329b281181 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:13.368301 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a342a2-4c2a-44de-a813-e0329b281181 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:13.369137 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a342a2-4c2a-44de-a813-e0329b281181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:13.372274 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a342a2-4c2a-44de-a813-e0329b281181 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:13.390948 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 926/1860] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:13 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:13.397010 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e2493-c0f5-46e4-91b5-016f20f7a13d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:13.411397 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e2493-c0f5-46e4-91b5-016f20f7a13d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:13.419826 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833dce0b-9c6a-46a5-8ab7-77293fed21fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:13.420737 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dce0b-9c6a-46a5-8ab7-77293fed21fc admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:13.421027 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dce0b-9c6a-46a5-8ab7-77293fed21fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:13.421309 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833dce0b-9c6a-46a5-8ab7-77293fed21fc admin admin] PATH_INFO: `/v3/projects/d07fe26e95c74c8ca5ba7d239e19ac50/users/fdd08ec1dafe48bbaac224adafc9a402/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:13.438935 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833dce0b-9c6a-46a5-8ab7-77293fed21fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d07fe26e95c74c8ca5ba7d239e19ac50, user_id=fdd08ec1dafe48bbaac224adafc9a402, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:13.441627 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833dce0b-9c6a-46a5-8ab7-77293fed21fc admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:13.458441 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 935/1861] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:13 2021] PUT /identity/v3/projects/d07fe26e95c74c8ca5ba7d239e19ac50/users/fdd08ec1dafe48bbaac224adafc9a402/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:13.471201 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a41033-7798-4389-83e0-24ae022c88f3 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:13.472082 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a41033-7798-4389-83e0-24ae022c88f3 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:13.472613 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a41033-7798-4389-83e0-24ae022c88f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:13.538232 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-e6a41033-7798-4389-83e0-24ae022c88f3 None None] MFA Rules not processed for user `fdd08ec1dafe48bbaac224adafc9a402`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:13.543276 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-e6a41033-7798-4389-83e0-24ae022c88f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:13.561052 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833dce0b-9c6a-46a5-8ab7-77293fed21fc admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:13.563350 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-833dce0b-9c6a-46a5-8ab7-77293fed21fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:13.675540 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 927/1862] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:13 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:13.677140 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a41033-7798-4389-83e0-24ae022c88f3 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:13.681322 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-e6a41033-7798-4389-83e0-24ae022c88f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:13.691293 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833dce0b-9c6a-46a5-8ab7-77293fed21fc admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:13.698965 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a41033-7798-4389-83e0-24ae022c88f3 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:13.706221 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ef5da-cb76-46a1-8435-27035f040806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:13.707314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ef5da-cb76-46a1-8435-27035f040806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:13.707630 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ef5da-cb76-46a1-8435-27035f040806 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:13.707909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ef5da-cb76-46a1-8435-27035f040806 admin admin] PATH_INFO: `/v3/projects/efd3f22e12e34dfb817144eefc2e9746` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:13.711209 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613ea77-9e23-4b34-bf92-4a3a8be2c155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:13.712181 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613ea77-9e23-4b34-bf92-4a3a8be2c155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:13.712470 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613ea77-9e23-4b34-bf92-4a3a8be2c155 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:13.712752 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613ea77-9e23-4b34-bf92-4a3a8be2c155 admin admin] PATH_INFO: `/v3/projects/85d2cceccda54a3fab814e300cf3acca` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:13.717264 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613ea77-9e23-4b34-bf92-4a3a8be2c155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d2cceccda54a3fab814e300cf3acca)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:13.717631 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ef5da-cb76-46a1-8435-27035f040806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd3f22e12e34dfb817144eefc2e9746)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:13.722338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ef5da-cb76-46a1-8435-27035f040806 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:13.723210 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613ea77-9e23-4b34-bf92-4a3a8be2c155 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:13.788239 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-083ef5da-cb76-46a1-8435-27035f040806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd3f22e12e34dfb817144eefc2e9746', 'request_id': 'req-083ef5da-cb76-46a1-8435-27035f040806'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:13.800072 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-083ef5da-cb76-46a1-8435-27035f040806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd3f22e12e34dfb817144eefc2e9746', 'request_id': 'req-083ef5da-cb76-46a1-8435-27035f040806'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:13.806674 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f613ea77-9e23-4b34-bf92-4a3a8be2c155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d2cceccda54a3fab814e300cf3acca', 'request_id': 'req-f613ea77-9e23-4b34-bf92-4a3a8be2c155'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:13.816788 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-083ef5da-cb76-46a1-8435-27035f040806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd3f22e12e34dfb817144eefc2e9746', 'request_id': 'req-083ef5da-cb76-46a1-8435-27035f040806'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:13.817865 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f613ea77-9e23-4b34-bf92-4a3a8be2c155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d2cceccda54a3fab814e300cf3acca', 'request_id': 'req-f613ea77-9e23-4b34-bf92-4a3a8be2c155'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:13.825204 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f613ea77-9e23-4b34-bf92-4a3a8be2c155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d2cceccda54a3fab814e300cf3acca', 'request_id': 'req-f613ea77-9e23-4b34-bf92-4a3a8be2c155'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:13.842216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-083ef5da-cb76-46a1-8435-27035f040806 admin admin] The token cache is being invalidate because project efd3f22e12e34dfb817144eefc2e9746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:13.842783 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-083ef5da-cb76-46a1-8435-27035f040806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:13.843618 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-083ef5da-cb76-46a1-8435-27035f040806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:13.847585 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 928/1863] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:13 2021] DELETE /identity/v3/projects/efd3f22e12e34dfb817144eefc2e9746 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:13.847738 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f613ea77-9e23-4b34-bf92-4a3a8be2c155 admin admin] The token cache is being invalidate because project 85d2cceccda54a3fab814e300cf3acca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:13.848046 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f613ea77-9e23-4b34-bf92-4a3a8be2c155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:13.848821 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f613ea77-9e23-4b34-bf92-4a3a8be2c155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:13.849409 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ef5da-cb76-46a1-8435-27035f040806 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:13.850658 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 936/1864] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:13 2021] DELETE /identity/v3/projects/85d2cceccda54a3fab814e300cf3acca => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:13.852555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-083ef5da-cb76-46a1-8435-27035f040806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:13.858995 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf91f9-2545-48c1-8016-2db4859768ee None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:13.859284 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf91f9-2545-48c1-8016-2db4859768ee None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:13.859593 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf91f9-2545-48c1-8016-2db4859768ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:13.884580 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-e8cf91f9-2545-48c1-8016-2db4859768ee None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:13.886279 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-e8cf91f9-2545-48c1-8016-2db4859768ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:13.934979 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ef5da-cb76-46a1-8435-27035f040806 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:13.955586 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 937/1865] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:13.957980 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892b738-e9ee-46b8-98a7-af074543d55b None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:13.958277 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892b738-e9ee-46b8-98a7-af074543d55b None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:13.958561 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892b738-e9ee-46b8-98a7-af074543d55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:13.981409 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-1892b738-e9ee-46b8-98a7-af074543d55b None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:13.983514 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1892b738-e9ee-46b8-98a7-af074543d55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:13.991817 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 938/1866] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:13.995616 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc097bc7-47c1-47a2-88f6-2e1bbb1f50f9 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:13.995616 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc097bc7-47c1-47a2-88f6-2e1bbb1f50f9 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:13.995616 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc097bc7-47c1-47a2-88f6-2e1bbb1f50f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.000455 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7902c0a-559d-473f-9539-35ad7ea87c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:14.001164 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7902c0a-559d-473f-9539-35ad7ea87c14 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.001418 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7902c0a-559d-473f-9539-35ad7ea87c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.001692 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7902c0a-559d-473f-9539-35ad7ea87c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.002382 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7902c0a-559d-473f-9539-35ad7ea87c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:14.004744 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7902c0a-559d-473f-9539-35ad7ea87c14 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:14.021064 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-cc097bc7-47c1-47a2-88f6-2e1bbb1f50f9 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:14.022351 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-cc097bc7-47c1-47a2-88f6-2e1bbb1f50f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:14.030933 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 939/1867] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:14.032512 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 929/1868] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:13 2021] POST /identity/v3/projects => generated 369 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:14.032771 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85770938-77cb-4b5d-b079-656e124420ca None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.033269 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85770938-77cb-4b5d-b079-656e124420ca None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.033708 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85770938-77cb-4b5d-b079-656e124420ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.034979 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7902c0a-559d-473f-9539-35ad7ea87c14 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:14.052329 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-85770938-77cb-4b5d-b079-656e124420ca None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:14.053500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-85770938-77cb-4b5d-b079-656e124420ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:14.094845 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7902c0a-559d-473f-9539-35ad7ea87c14 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:14.099563 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950e4f2-475a-4a34-92c7-ae158104b199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:14.100223 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950e4f2-475a-4a34-92c7-ae158104b199 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.100506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950e4f2-475a-4a34-92c7-ae158104b199 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.100783 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950e4f2-475a-4a34-92c7-ae158104b199 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.101498 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950e4f2-475a-4a34-92c7-ae158104b199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:05:14.101805 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950e4f2-475a-4a34-92c7-ae158104b199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:14.103442 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950e4f2-475a-4a34-92c7-ae158104b199 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:14.111442 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 940/1869] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:14.112266 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85770938-77cb-4b5d-b079-656e124420ca None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:14.113501 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-85770938-77cb-4b5d-b079-656e124420ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:14.118912 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 930/1870] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:05:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:05:14.120325 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950e4f2-475a-4a34-92c7-ae158104b199 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:14.126252 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85770938-77cb-4b5d-b079-656e124420ca None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:14.130577 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950e4f2-475a-4a34-92c7-ae158104b199 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:14.131148 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd482bf1-ff0c-414b-b598-21d320759465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:14.131844 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd482bf1-ff0c-414b-b598-21d320759465 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.132129 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd482bf1-ff0c-414b-b598-21d320759465 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.132404 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd482bf1-ff0c-414b-b598-21d320759465 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.133108 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd482bf1-ff0c-414b-b598-21d320759465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:14.135245 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd482bf1-ff0c-414b-b598-21d320759465 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:14.136336 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30de207-edc7-431f-a25b-811116b5703a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:14.136877 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30de207-edc7-431f-a25b-811116b5703a admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.137178 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30de207-edc7-431f-a25b-811116b5703a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.137452 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30de207-edc7-431f-a25b-811116b5703a admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.138163 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30de207-edc7-431f-a25b-811116b5703a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:05:14.138465 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30de207-edc7-431f-a25b-811116b5703a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:14.140073 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30de207-edc7-431f-a25b-811116b5703a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:14.153452 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 931/1871] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:05:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:05:14.154284 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30de207-edc7-431f-a25b-811116b5703a admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:14.172375 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 941/1872] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:14 2021] POST /identity/v3/users => generated 291 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:14.173716 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd482bf1-ff0c-414b-b598-21d320759465 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:14.173961 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30de207-edc7-431f-a25b-811116b5703a admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:14.180397 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38510657-fec1-4a8f-8894-ae694d129d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:14.181287 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38510657-fec1-4a8f-8894-ae694d129d19 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.181789 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38510657-fec1-4a8f-8894-ae694d129d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.182205 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38510657-fec1-4a8f-8894-ae694d129d19 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.182901 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38510657-fec1-4a8f-8894-ae694d129d19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:14.184922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38510657-fec1-4a8f-8894-ae694d129d19 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:14.188545 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd482bf1-ff0c-414b-b598-21d320759465 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:14.195964 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208b6f6-3bb5-4f8c-b7d6-7c777ecb1b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:14.196632 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208b6f6-3bb5-4f8c-b7d6-7c777ecb1b9e admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.196915 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208b6f6-3bb5-4f8c-b7d6-7c777ecb1b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.197187 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208b6f6-3bb5-4f8c-b7d6-7c777ecb1b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.197904 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208b6f6-3bb5-4f8c-b7d6-7c777ecb1b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:14.200025 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208b6f6-3bb5-4f8c-b7d6-7c777ecb1b9e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:14.214960 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 932/1873] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:14 2021] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:14.215817 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38510657-fec1-4a8f-8894-ae694d129d19 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:14.227790 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 942/1874] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:14 2021] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:14.229723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208b6f6-3bb5-4f8c-b7d6-7c777ecb1b9e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:14.295096 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38510657-fec1-4a8f-8894-ae694d129d19 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:14.350262 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208b6f6-3bb5-4f8c-b7d6-7c777ecb1b9e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:14.355483 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118b473-808d-4d52-8966-5c883fcb698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:14.356352 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118b473-808d-4d52-8966-5c883fcb698d admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.356739 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118b473-808d-4d52-8966-5c883fcb698d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.357113 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118b473-808d-4d52-8966-5c883fcb698d admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.357903 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118b473-808d-4d52-8966-5c883fcb698d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:14.359971 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118b473-808d-4d52-8966-5c883fcb698d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:14.369594 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fa3b1-6446-4e5c-855e-d449321a4b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:14.371493 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fa3b1-6446-4e5c-855e-d449321a4b74 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.371493 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fa3b1-6446-4e5c-855e-d449321a4b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.371493 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fa3b1-6446-4e5c-855e-d449321a4b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.376795 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fa3b1-6446-4e5c-855e-d449321a4b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:14.379355 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fa3b1-6446-4e5c-855e-d449321a4b74 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:14.391257 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 933/1875] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:14 2021] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:14.392395 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 943/1876] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:14 2021] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:14.392806 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fa3b1-6446-4e5c-855e-d449321a4b74 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:14.395430 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118b473-808d-4d52-8966-5c883fcb698d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:14.405918 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fa3b1-6446-4e5c-855e-d449321a4b74 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:14.408774 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118b473-808d-4d52-8966-5c883fcb698d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:14.411627 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa68511-0927-4875-80a6-65f9b148481f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:14.412384 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa68511-0927-4875-80a6-65f9b148481f admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.412915 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa68511-0927-4875-80a6-65f9b148481f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.413494 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa68511-0927-4875-80a6-65f9b148481f admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.414426 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa68511-0927-4875-80a6-65f9b148481f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:14.421155 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa68511-0927-4875-80a6-65f9b148481f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:14.427880 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc690ad-f218-49ae-88e1-d3cd90b63873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:14.428846 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc690ad-f218-49ae-88e1-d3cd90b63873 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.429133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc690ad-f218-49ae-88e1-d3cd90b63873 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.429461 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc690ad-f218-49ae-88e1-d3cd90b63873 admin admin] PATH_INFO: `/v3/projects/903bbb7c1de347809b553dfd9fcd95a2/users/fe5762833cc7459e85ffd0ea410eebfa/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.446061 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc690ad-f218-49ae-88e1-d3cd90b63873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=903bbb7c1de347809b553dfd9fcd95a2, user_id=fe5762833cc7459e85ffd0ea410eebfa, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:14.449072 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc690ad-f218-49ae-88e1-d3cd90b63873 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:14.470708 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 934/1877] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:14 2021] POST /identity/v3/users => generated 291 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:14.471878 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa68511-0927-4875-80a6-65f9b148481f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:14.483042 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 944/1878] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:14 2021] PUT /identity/v3/projects/903bbb7c1de347809b553dfd9fcd95a2/users/fe5762833cc7459e85ffd0ea410eebfa/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:14.484518 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa68511-0927-4875-80a6-65f9b148481f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:14.484912 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc690ad-f218-49ae-88e1-d3cd90b63873 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:14.569979 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc690ad-f218-49ae-88e1-d3cd90b63873 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:14.576514 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd8129-eefe-434f-9b99-8505424275ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:14.577190 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd8129-eefe-434f-9b99-8505424275ae admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.577476 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd8129-eefe-434f-9b99-8505424275ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.577755 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd8129-eefe-434f-9b99-8505424275ae admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.578619 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd8129-eefe-434f-9b99-8505424275ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:14.595354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd8129-eefe-434f-9b99-8505424275ae admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:14.595354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 945/1879] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:14 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:14.605901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd8129-eefe-434f-9b99-8505424275ae admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:14.606149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c404768-551f-4c9c-816b-a70f568a94c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:14.606149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c404768-551f-4c9c-816b-a70f568a94c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.606149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c404768-551f-4c9c-816b-a70f568a94c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.606149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c404768-551f-4c9c-816b-a70f568a94c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.606990 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c404768-551f-4c9c-816b-a70f568a94c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:14.608724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c404768-551f-4c9c-816b-a70f568a94c2 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:14.616438 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd8129-eefe-434f-9b99-8505424275ae admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:14.627322 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08dcf0-8de7-4a32-a8bd-80fb19aa4793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:14.628449 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08dcf0-8de7-4a32-a8bd-80fb19aa4793 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.629186 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08dcf0-8de7-4a32-a8bd-80fb19aa4793 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.629473 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08dcf0-8de7-4a32-a8bd-80fb19aa4793 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.630646 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08dcf0-8de7-4a32-a8bd-80fb19aa4793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:14.632468 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08dcf0-8de7-4a32-a8bd-80fb19aa4793 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:14.637949 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 935/1880] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:14 2021] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:14.639003 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c404768-551f-4c9c-816b-a70f568a94c2 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:14.647171 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 946/1881] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:14 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:14.648079 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08dcf0-8de7-4a32-a8bd-80fb19aa4793 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:14.659691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c404768-551f-4c9c-816b-a70f568a94c2 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:14.663002 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08dcf0-8de7-4a32-a8bd-80fb19aa4793 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:14.667204 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7045f94-e33b-4b67-814e-b10ea558a6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:14.668252 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7045f94-e33b-4b67-814e-b10ea558a6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.668686 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7045f94-e33b-4b67-814e-b10ea558a6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.669180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7045f94-e33b-4b67-814e-b10ea558a6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.670069 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7045f94-e33b-4b67-814e-b10ea558a6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:14.672121 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7045f94-e33b-4b67-814e-b10ea558a6e7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:14.675658 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d08a64-d7ae-455d-9b68-1fb2bcd22f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:14.676521 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d08a64-d7ae-455d-9b68-1fb2bcd22f44 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.676870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d08a64-d7ae-455d-9b68-1fb2bcd22f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.677222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d08a64-d7ae-455d-9b68-1fb2bcd22f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.678078 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d08a64-d7ae-455d-9b68-1fb2bcd22f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:14.679873 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d08a64-d7ae-455d-9b68-1fb2bcd22f44 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:14.683443 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 936/1882] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:14 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:14.685327 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be1312-aab5-4b80-a869-318aee7de29e None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.685327 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be1312-aab5-4b80-a869-318aee7de29e None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.685607 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be1312-aab5-4b80-a869-318aee7de29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.694292 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 947/1883] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:14 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:14.695218 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d08a64-d7ae-455d-9b68-1fb2bcd22f44 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:14.708654 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-03be1312-aab5-4b80-a869-318aee7de29e None None] MFA Rules not processed for user `361eb264d0a147e9879a758807cd3eed`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:14.709481 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d08a64-d7ae-455d-9b68-1fb2bcd22f44 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:14.709864 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-03be1312-aab5-4b80-a869-318aee7de29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:14.716980 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0c85f-ab5e-479f-b44d-eed9035656da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:14.717988 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0c85f-ab5e-479f-b44d-eed9035656da admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.718299 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0c85f-ab5e-479f-b44d-eed9035656da admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.718703 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0c85f-ab5e-479f-b44d-eed9035656da admin admin] PATH_INFO: `/v3/projects/903bbb7c1de347809b553dfd9fcd95a2/users/fe5762833cc7459e85ffd0ea410eebfa/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.720780 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0c85f-ab5e-479f-b44d-eed9035656da admin admin] RBAC: Authorizing `identity:create_grant(project_id=903bbb7c1de347809b553dfd9fcd95a2, user_id=fe5762833cc7459e85ffd0ea410eebfa, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:14.723825 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0c85f-ab5e-479f-b44d-eed9035656da admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:14.772834 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 937/1884] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:14 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:14.793549 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be1312-aab5-4b80-a869-318aee7de29e None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:14.813414 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be1312-aab5-4b80-a869-318aee7de29e None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:14.860497 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 948/1885] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:14 2021] PUT /identity/v3/projects/903bbb7c1de347809b553dfd9fcd95a2/users/fe5762833cc7459e85ffd0ea410eebfa/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:14.861331 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0c85f-ab5e-479f-b44d-eed9035656da admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:14.895040 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6c80b-cf25-4aaa-9ce3-d2b3b797ca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:14.895879 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6c80b-cf25-4aaa-9ce3-d2b3b797ca3b admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.896161 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6c80b-cf25-4aaa-9ce3-d2b3b797ca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.896435 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6c80b-cf25-4aaa-9ce3-d2b3b797ca3b admin admin] PATH_INFO: `/v3/projects/7dbdfa0276614705913cea52f337b020/users/31bb836b6dc84c38a862b48cdc89b5c4/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.915654 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6c80b-cf25-4aaa-9ce3-d2b3b797ca3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dbdfa0276614705913cea52f337b020, user_id=31bb836b6dc84c38a862b48cdc89b5c4, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:14.919249 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6c80b-cf25-4aaa-9ce3-d2b3b797ca3b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:14.938767 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 938/1886] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:14 2021] PUT /identity/v3/projects/7dbdfa0276614705913cea52f337b020/users/31bb836b6dc84c38a862b48cdc89b5c4/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:14.940922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af049d-8819-46ad-8661-619f41b6a9ae None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:14.940922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af049d-8819-46ad-8661-619f41b6a9ae None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:14.941125 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af049d-8819-46ad-8661-619f41b6a9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:14.960359 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0c85f-ab5e-479f-b44d-eed9035656da admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:14.985102 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-82af049d-8819-46ad-8661-619f41b6a9ae None None] MFA Rules not processed for user `fe5762833cc7459e85ffd0ea410eebfa`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:14.986803 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-82af049d-8819-46ad-8661-619f41b6a9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:15.077370 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 939/1887] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:14 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:15.087060 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc971be6-67ce-4253-b0f3-8cbabcc45a92 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:15.087351 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc971be6-67ce-4253-b0f3-8cbabcc45a92 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:15.087660 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc971be6-67ce-4253-b0f3-8cbabcc45a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:15.089269 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc41ade-6f9e-4478-946c-57ebee6c529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:15.090172 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc41ade-6f9e-4478-946c-57ebee6c529b admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:15.090453 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc41ade-6f9e-4478-946c-57ebee6c529b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:15.090725 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc41ade-6f9e-4478-946c-57ebee6c529b admin admin] PATH_INFO: `/v3/projects/b5e3866cee67472faa9ceea5a06ac2bb/users/1a7ca78eccd54f1d8000d43792121a24/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:15.113468 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc41ade-6f9e-4478-946c-57ebee6c529b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e3866cee67472faa9ceea5a06ac2bb, user_id=1a7ca78eccd54f1d8000d43792121a24, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:15.121081 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc41ade-6f9e-4478-946c-57ebee6c529b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:15.136386 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 949/1888] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:14 2021] PUT /identity/v3/projects/b5e3866cee67472faa9ceea5a06ac2bb/users/1a7ca78eccd54f1d8000d43792121a24/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:15.137852 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc41ade-6f9e-4478-946c-57ebee6c529b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:15.140189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-7fc41ade-6f9e-4478-946c-57ebee6c529b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:15.155025 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-fc971be6-67ce-4253-b0f3-8cbabcc45a92 None None] MFA Rules not processed for user `31bb836b6dc84c38a862b48cdc89b5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:15.156091 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-fc971be6-67ce-4253-b0f3-8cbabcc45a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:15.220215 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc41ade-6f9e-4478-946c-57ebee6c529b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:15.226592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca29878-c0a1-44be-a147-0c819043f9a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:15.228042 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca29878-c0a1-44be-a147-0c819043f9a7 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:15.229799 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca29878-c0a1-44be-a147-0c819043f9a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:15.230162 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca29878-c0a1-44be-a147-0c819043f9a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:15.303954 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 940/1889] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:15 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:15.305354 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f0619-d5e8-4445-9288-4eb310b51ced None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:15.305659 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f0619-d5e8-4445-9288-4eb310b51ced None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:15.305922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f0619-d5e8-4445-9288-4eb310b51ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:15.350858 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-619f0619-d5e8-4445-9288-4eb310b51ced None None] MFA Rules not processed for user `1a7ca78eccd54f1d8000d43792121a24`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:15.352114 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-619f0619-d5e8-4445-9288-4eb310b51ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:15.389632 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca29878-c0a1-44be-a147-0c819043f9a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:15.391155 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca29878-c0a1-44be-a147-0c819043f9a7 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:15.404011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 950/1890] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:15 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:15.410058 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca29878-c0a1-44be-a147-0c819043f9a7 service cinder] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:15.508977 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca29878-c0a1-44be-a147-0c819043f9a7 service cinder] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:15.514842 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595db5b7-e61d-4039-bb56-64081cfa7f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:15.515679 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595db5b7-e61d-4039-bb56-64081cfa7f4c admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:15.515975 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595db5b7-e61d-4039-bb56-64081cfa7f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:15.516256 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595db5b7-e61d-4039-bb56-64081cfa7f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:15.516952 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595db5b7-e61d-4039-bb56-64081cfa7f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:15.520421 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595db5b7-e61d-4039-bb56-64081cfa7f4c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:15.560586 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 941/1891] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:15 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:15.561512 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f0619-d5e8-4445-9288-4eb310b51ced None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:15.570319 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 951/1892] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:15 2021] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:15.574728 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595db5b7-e61d-4039-bb56-64081cfa7f4c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:15.580143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f0619-d5e8-4445-9288-4eb310b51ced None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:15.652025 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e098f3-0548-4f37-b28e-41da52e45840 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:15.659830 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e098f3-0548-4f37-b28e-41da52e45840 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:15.660406 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e098f3-0548-4f37-b28e-41da52e45840 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:15.660891 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e098f3-0548-4f37-b28e-41da52e45840 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:15.686752 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-57e098f3-0548-4f37-b28e-41da52e45840 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:15.706496 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595db5b7-e61d-4039-bb56-64081cfa7f4c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:15.716631 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7731d82-e14c-4820-951a-2c9c049e6bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:15.717487 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7731d82-e14c-4820-951a-2c9c049e6bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:15.718165 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7731d82-e14c-4820-951a-2c9c049e6bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:15.718491 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7731d82-e14c-4820-951a-2c9c049e6bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:15.719240 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7731d82-e14c-4820-951a-2c9c049e6bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:15.721716 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7731d82-e14c-4820-951a-2c9c049e6bf0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:15.752395 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 952/1893] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:15 2021] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:15.753376 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7731d82-e14c-4820-951a-2c9c049e6bf0 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:15.755808 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a7731d82-e14c-4820-951a-2c9c049e6bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:15.771418 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7731d82-e14c-4820-951a-2c9c049e6bf0 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:15.776503 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552927a-b7b4-4b97-95bb-097ffb6de092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:15.777265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552927a-b7b4-4b97-95bb-097ffb6de092 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:15.777624 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552927a-b7b4-4b97-95bb-097ffb6de092 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:15.778100 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552927a-b7b4-4b97-95bb-097ffb6de092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:15.820147 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e098f3-0548-4f37-b28e-41da52e45840 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:15.823070 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e098f3-0548-4f37-b28e-41da52e45840 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:15.836295 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 942/1894] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:15 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:15.837559 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e098f3-0548-4f37-b28e-41da52e45840 service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:15.850438 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e098f3-0548-4f37-b28e-41da52e45840 service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:15.857399 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403d7ab-5e70-481f-a63f-5f6af6dbaf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:15.858558 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403d7ab-5e70-481f-a63f-5f6af6dbaf41 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:15.859023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403d7ab-5e70-481f-a63f-5f6af6dbaf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:15.859478 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403d7ab-5e70-481f-a63f-5f6af6dbaf41 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:15.860346 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403d7ab-5e70-481f-a63f-5f6af6dbaf41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:15.862275 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403d7ab-5e70-481f-a63f-5f6af6dbaf41 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:15.869052 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552927a-b7b4-4b97-95bb-097ffb6de092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:15.870801 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552927a-b7b4-4b97-95bb-097ffb6de092 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:15.877211 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 943/1895] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:15 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:15.884695 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403d7ab-5e70-481f-a63f-5f6af6dbaf41 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:15.893706 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 953/1896] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:15 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:15.899971 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403d7ab-5e70-481f-a63f-5f6af6dbaf41 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:15.906271 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b776fb-7978-404f-8d2f-3cafd27b0a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:15.907173 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b776fb-7978-404f-8d2f-3cafd27b0a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:15.907501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b776fb-7978-404f-8d2f-3cafd27b0a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:15.907878 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b776fb-7978-404f-8d2f-3cafd27b0a49 admin admin] PATH_INFO: `/v3/projects/253cb3ba4e0c464181143f6219bf5703/users/a63f47f4b35346efa6cc8fbb0c074164/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:15.943550 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b776fb-7978-404f-8d2f-3cafd27b0a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=253cb3ba4e0c464181143f6219bf5703, user_id=a63f47f4b35346efa6cc8fbb0c074164, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:15.947398 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b776fb-7978-404f-8d2f-3cafd27b0a49 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:15.979824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 944/1897] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:15 2021] PUT /identity/v3/projects/253cb3ba4e0c464181143f6219bf5703/users/a63f47f4b35346efa6cc8fbb0c074164/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:15.983867 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552927a-b7b4-4b97-95bb-097ffb6de092 service cinder] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:15.999115 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552927a-b7b4-4b97-95bb-097ffb6de092 service cinder] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:16.081611 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3176d-ef5b-4a77-83f8-09467428c95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:16.082162 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3176d-ef5b-4a77-83f8-09467428c95b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:16.082787 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3176d-ef5b-4a77-83f8-09467428c95b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:16.083191 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3176d-ef5b-4a77-83f8-09467428c95b admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:16.084722 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3176d-ef5b-4a77-83f8-09467428c95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:16.086478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3176d-ef5b-4a77-83f8-09467428c95b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:16.099181 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 954/1898] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:15 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:16.111481 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b776fb-7978-404f-8d2f-3cafd27b0a49 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:16.143498 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b776fb-7978-404f-8d2f-3cafd27b0a49 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:16.160108 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68951a-bbec-4243-892b-7e2d12583f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:16.162625 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68951a-bbec-4243-892b-7e2d12583f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:16.162625 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68951a-bbec-4243-892b-7e2d12583f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:16.162625 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68951a-bbec-4243-892b-7e2d12583f3d admin admin] PATH_INFO: `/v3/projects/253cb3ba4e0c464181143f6219bf5703/users/a63f47f4b35346efa6cc8fbb0c074164/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:16.164297 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68951a-bbec-4243-892b-7e2d12583f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=253cb3ba4e0c464181143f6219bf5703, user_id=a63f47f4b35346efa6cc8fbb0c074164, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:16.168448 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68951a-bbec-4243-892b-7e2d12583f3d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:16.217040 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 945/1899] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:16 2021] PUT /identity/v3/projects/253cb3ba4e0c464181143f6219bf5703/users/a63f47f4b35346efa6cc8fbb0c074164/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:16.218963 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0c754-0491-4eb1-93a1-244f7a57d7b2 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:16.219350 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0c754-0491-4eb1-93a1-244f7a57d7b2 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:16.221427 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0c754-0491-4eb1-93a1-244f7a57d7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:16.279568 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-f4f0c754-0491-4eb1-93a1-244f7a57d7b2 None None] MFA Rules not processed for user `a63f47f4b35346efa6cc8fbb0c074164`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:16.281034 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f4f0c754-0491-4eb1-93a1-244f7a57d7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:16.410071 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 955/1900] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:16 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:16.425158 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68951a-bbec-4243-892b-7e2d12583f3d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:16.508405 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68951a-bbec-4243-892b-7e2d12583f3d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:16.512425 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b6d8a-dffc-4132-8532-668acd76cdfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:16.513169 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b6d8a-dffc-4132-8532-668acd76cdfd service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:16.513849 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b6d8a-dffc-4132-8532-668acd76cdfd service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:16.513849 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b6d8a-dffc-4132-8532-668acd76cdfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:16.524973 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b6d8a-dffc-4132-8532-668acd76cdfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:16.531592 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b6d8a-dffc-4132-8532-668acd76cdfd service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:16.547443 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 946/1901] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:16 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:16.960634 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0c754-0491-4eb1-93a1-244f7a57d7b2 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:17.046958 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0c754-0491-4eb1-93a1-244f7a57d7b2 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:17.052444 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79d435-7b8a-4297-9ec3-e93c261b00ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:17.053509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79d435-7b8a-4297-9ec3-e93c261b00ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:17.053784 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79d435-7b8a-4297-9ec3-e93c261b00ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:17.054060 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79d435-7b8a-4297-9ec3-e93c261b00ff admin admin] PATH_INFO: `/v3/users/31bb836b6dc84c38a862b48cdc89b5c4` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:17.055554 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79d435-7b8a-4297-9ec3-e93c261b00ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=31bb836b6dc84c38a862b48cdc89b5c4)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:17.057691 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79d435-7b8a-4297-9ec3-e93c261b00ff admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:17.150456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-5e79d435-7b8a-4297-9ec3-e93c261b00ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31bb836b6dc84c38a862b48cdc89b5c4'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:17.151677 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-5e79d435-7b8a-4297-9ec3-e93c261b00ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31bb836b6dc84c38a862b48cdc89b5c4'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:17.152339 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-5e79d435-7b8a-4297-9ec3-e93c261b00ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31bb836b6dc84c38a862b48cdc89b5c4'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:17.167118 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-5e79d435-7b8a-4297-9ec3-e93c261b00ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31bb836b6dc84c38a862b48cdc89b5c4'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:17.175841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-5e79d435-7b8a-4297-9ec3-e93c261b00ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31bb836b6dc84c38a862b48cdc89b5c4'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:17.190258 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 956/1902] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:16 2021] DELETE /identity/v3/users/31bb836b6dc84c38a862b48cdc89b5c4 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:17.194829 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a87d09-716b-496d-b197-d0b6a3c9e38a None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:17.195320 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a87d09-716b-496d-b197-d0b6a3c9e38a None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:17.195577 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a87d09-716b-496d-b197-d0b6a3c9e38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:17.215841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-24a87d09-716b-496d-b197-d0b6a3c9e38a None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:17.217083 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-24a87d09-716b-496d-b197-d0b6a3c9e38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:17.297111 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 947/1903] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:17.316622 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79d435-7b8a-4297-9ec3-e93c261b00ff admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:17.318587 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-5e79d435-7b8a-4297-9ec3-e93c261b00ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:17.384693 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79d435-7b8a-4297-9ec3-e93c261b00ff admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:17.388801 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8e23c-d6c4-4603-ba30-cc53ea14ae95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:17.389515 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8e23c-d6c4-4603-ba30-cc53ea14ae95 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:17.389858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8e23c-d6c4-4603-ba30-cc53ea14ae95 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:17.390189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8e23c-d6c4-4603-ba30-cc53ea14ae95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:17.403014 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8e23c-d6c4-4603-ba30-cc53ea14ae95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:17.404656 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8e23c-d6c4-4603-ba30-cc53ea14ae95 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:17.414876 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 957/1904] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:17.958366 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a87d09-716b-496d-b197-d0b6a3c9e38a None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:17.960049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-24a87d09-716b-496d-b197-d0b6a3c9e38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:17.984184 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a87d09-716b-496d-b197-d0b6a3c9e38a None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:17.991559 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd44bcb-eeae-4f98-beb8-130798d3d741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:17.992797 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd44bcb-eeae-4f98-beb8-130798d3d741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:17.993084 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd44bcb-eeae-4f98-beb8-130798d3d741 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:17.993363 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd44bcb-eeae-4f98-beb8-130798d3d741 admin admin] PATH_INFO: `/v3/users/999210c8bd9c4367869ebaf967556c6b` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:17.994932 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd44bcb-eeae-4f98-beb8-130798d3d741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=999210c8bd9c4367869ebaf967556c6b)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:17.997107 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd44bcb-eeae-4f98-beb8-130798d3d741 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:18.076856 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-bcd44bcb-eeae-4f98-beb8-130798d3d741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999210c8bd9c4367869ebaf967556c6b'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.096768 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-bcd44bcb-eeae-4f98-beb8-130798d3d741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999210c8bd9c4367869ebaf967556c6b'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.097510 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-bcd44bcb-eeae-4f98-beb8-130798d3d741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999210c8bd9c4367869ebaf967556c6b'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.113598 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-bcd44bcb-eeae-4f98-beb8-130798d3d741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999210c8bd9c4367869ebaf967556c6b'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.135010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-bcd44bcb-eeae-4f98-beb8-130798d3d741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999210c8bd9c4367869ebaf967556c6b'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.150221 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 948/1905] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:17 2021] DELETE /identity/v3/users/999210c8bd9c4367869ebaf967556c6b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:18.315163 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8e23c-d6c4-4603-ba30-cc53ea14ae95 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:18.317155 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b8f8e23c-d6c4-4603-ba30-cc53ea14ae95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:18.349441 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8e23c-d6c4-4603-ba30-cc53ea14ae95 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:18.350609 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd44bcb-eeae-4f98-beb8-130798d3d741 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:18.352130 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-bcd44bcb-eeae-4f98-beb8-130798d3d741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:18.416484 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec2471-fdc1-4943-a252-6ccf8cc689d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:18.417340 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec2471-fdc1-4943-a252-6ccf8cc689d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:18.417621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec2471-fdc1-4943-a252-6ccf8cc689d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:18.417901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec2471-fdc1-4943-a252-6ccf8cc689d6 admin admin] PATH_INFO: `/v3/projects/7dbdfa0276614705913cea52f337b020` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:18.419084 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec2471-fdc1-4943-a252-6ccf8cc689d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dbdfa0276614705913cea52f337b020)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:18.421025 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec2471-fdc1-4943-a252-6ccf8cc689d6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:18.434644 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd44bcb-eeae-4f98-beb8-130798d3d741 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:18.439323 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14204ef-9d81-4e2e-9186-74c65a397ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:18.440208 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14204ef-9d81-4e2e-9186-74c65a397ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:18.440491 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14204ef-9d81-4e2e-9186-74c65a397ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:18.440767 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14204ef-9d81-4e2e-9186-74c65a397ad5 admin admin] PATH_INFO: `/v3/projects/cbeddb341e5b4fe38a57da85751267ba` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:18.443395 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14204ef-9d81-4e2e-9186-74c65a397ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbeddb341e5b4fe38a57da85751267ba)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:18.445034 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14204ef-9d81-4e2e-9186-74c65a397ad5 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:18.470872 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9cec2471-fdc1-4943-a252-6ccf8cc689d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dbdfa0276614705913cea52f337b020', 'request_id': 'req-9cec2471-fdc1-4943-a252-6ccf8cc689d6'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.477043 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9cec2471-fdc1-4943-a252-6ccf8cc689d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dbdfa0276614705913cea52f337b020', 'request_id': 'req-9cec2471-fdc1-4943-a252-6ccf8cc689d6'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.482950 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9cec2471-fdc1-4943-a252-6ccf8cc689d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dbdfa0276614705913cea52f337b020', 'request_id': 'req-9cec2471-fdc1-4943-a252-6ccf8cc689d6'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.495926 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-e14204ef-9d81-4e2e-9186-74c65a397ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbeddb341e5b4fe38a57da85751267ba', 'request_id': 'req-e14204ef-9d81-4e2e-9186-74c65a397ad5'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.496789 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9cec2471-fdc1-4943-a252-6ccf8cc689d6 admin admin] The token cache is being invalidate because project 7dbdfa0276614705913cea52f337b020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:18.497087 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9cec2471-fdc1-4943-a252-6ccf8cc689d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.497746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9cec2471-fdc1-4943-a252-6ccf8cc689d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.499302 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 958/1906] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:18 2021] DELETE /identity/v3/projects/7dbdfa0276614705913cea52f337b020 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:18.502188 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-e14204ef-9d81-4e2e-9186-74c65a397ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbeddb341e5b4fe38a57da85751267ba', 'request_id': 'req-e14204ef-9d81-4e2e-9186-74c65a397ad5'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.503129 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec2471-fdc1-4943-a252-6ccf8cc689d6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:18.504778 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-9cec2471-fdc1-4943-a252-6ccf8cc689d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:18.509439 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-e14204ef-9d81-4e2e-9186-74c65a397ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbeddb341e5b4fe38a57da85751267ba', 'request_id': 'req-e14204ef-9d81-4e2e-9186-74c65a397ad5'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.520937 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-e14204ef-9d81-4e2e-9186-74c65a397ad5 admin admin] The token cache is being invalidate because project cbeddb341e5b4fe38a57da85751267ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:18.521228 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-e14204ef-9d81-4e2e-9186-74c65a397ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.521853 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-e14204ef-9d81-4e2e-9186-74c65a397ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.523605 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 949/1907] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:18 2021] DELETE /identity/v3/projects/cbeddb341e5b4fe38a57da85751267ba => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:18.529553 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a4483-569e-42af-86c4-fd4e9a150e04 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:18.529840 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a4483-569e-42af-86c4-fd4e9a150e04 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:18.530121 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a4483-569e-42af-86c4-fd4e9a150e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:18.548841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-639a4483-569e-42af-86c4-fd4e9a150e04 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:18.550035 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-639a4483-569e-42af-86c4-fd4e9a150e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:18.568131 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec2471-fdc1-4943-a252-6ccf8cc689d6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:18.606838 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 950/1908] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:18.614786 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fa94e-0ad0-4c7b-adca-b65efbe21a65 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:18.615078 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fa94e-0ad0-4c7b-adca-b65efbe21a65 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:18.615355 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fa94e-0ad0-4c7b-adca-b65efbe21a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:18.625235 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2bc70-d26c-4dd5-b5d6-7614dde38fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:18.626098 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2bc70-d26c-4dd5-b5d6-7614dde38fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:18.626375 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2bc70-d26c-4dd5-b5d6-7614dde38fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:18.626644 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2bc70-d26c-4dd5-b5d6-7614dde38fb6 admin admin] PATH_INFO: `/v3/users/a63f47f4b35346efa6cc8fbb0c074164` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:18.627848 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2bc70-d26c-4dd5-b5d6-7614dde38fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a63f47f4b35346efa6cc8fbb0c074164)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:18.630059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2bc70-d26c-4dd5-b5d6-7614dde38fb6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:18.634470 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-885fa94e-0ad0-4c7b-adca-b65efbe21a65 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:18.636210 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-885fa94e-0ad0-4c7b-adca-b65efbe21a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:18.648915 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 951/1909] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:18.649929 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fa94e-0ad0-4c7b-adca-b65efbe21a65 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:18.661374 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fa94e-0ad0-4c7b-adca-b65efbe21a65 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:18.667000 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedcf76-a78e-4e2b-b0a3-fa7917ace0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:18.667797 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedcf76-a78e-4e2b-b0a3-fa7917ace0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:18.668201 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedcf76-a78e-4e2b-b0a3-fa7917ace0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:18.668485 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedcf76-a78e-4e2b-b0a3-fa7917ace0c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:18.669209 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedcf76-a78e-4e2b-b0a3-fa7917ace0c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:05:18.669511 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedcf76-a78e-4e2b-b0a3-fa7917ace0c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:18.671103 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedcf76-a78e-4e2b-b0a3-fa7917ace0c7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:18.680215 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-5fd2bc70-d26c-4dd5-b5d6-7614dde38fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a63f47f4b35346efa6cc8fbb0c074164'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.680969 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-5fd2bc70-d26c-4dd5-b5d6-7614dde38fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a63f47f4b35346efa6cc8fbb0c074164'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.681692 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-5fd2bc70-d26c-4dd5-b5d6-7614dde38fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a63f47f4b35346efa6cc8fbb0c074164'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.683961 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 952/1910] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:05:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:05:18.687934 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedcf76-a78e-4e2b-b0a3-fa7917ace0c7 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:18.689593 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-2aedcf76-a78e-4e2b-b0a3-fa7917ace0c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:18.693128 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-5fd2bc70-d26c-4dd5-b5d6-7614dde38fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a63f47f4b35346efa6cc8fbb0c074164'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.701050 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-5fd2bc70-d26c-4dd5-b5d6-7614dde38fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a63f47f4b35346efa6cc8fbb0c074164'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:18.704175 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedcf76-a78e-4e2b-b0a3-fa7917ace0c7 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:18.708938 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2b37f-9a76-459f-89dc-ee935a8027e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:18.709619 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2b37f-9a76-459f-89dc-ee935a8027e5 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:18.709899 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2b37f-9a76-459f-89dc-ee935a8027e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:18.710170 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2b37f-9a76-459f-89dc-ee935a8027e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:18.710871 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2b37f-9a76-459f-89dc-ee935a8027e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:18.712786 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2b37f-9a76-459f-89dc-ee935a8027e5 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:18.716971 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 959/1911] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:18 2021] DELETE /identity/v3/users/a63f47f4b35346efa6cc8fbb0c074164 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:18.749056 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 953/1912] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:18 2021] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:18.750776 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2bc70-d26c-4dd5-b5d6-7614dde38fb6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:18.811624 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2bc70-d26c-4dd5-b5d6-7614dde38fb6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:18.869150 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f098a67-8860-406f-afea-19f6caee2c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:18.870502 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f098a67-8860-406f-afea-19f6caee2c24 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:18.870908 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f098a67-8860-406f-afea-19f6caee2c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:18.871191 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f098a67-8860-406f-afea-19f6caee2c24 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:18.871923 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f098a67-8860-406f-afea-19f6caee2c24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:18.874468 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f098a67-8860-406f-afea-19f6caee2c24 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:18.899269 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 960/1913] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:18 2021] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:18.904479 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2b37f-9a76-459f-89dc-ee935a8027e5 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:18.915036 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2b37f-9a76-459f-89dc-ee935a8027e5 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:18.920413 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef5031-72e7-4599-9fd5-3cbdc7275145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:18.921081 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef5031-72e7-4599-9fd5-3cbdc7275145 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:18.921366 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef5031-72e7-4599-9fd5-3cbdc7275145 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:18.921640 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef5031-72e7-4599-9fd5-3cbdc7275145 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:18.922361 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef5031-72e7-4599-9fd5-3cbdc7275145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:18.924003 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef5031-72e7-4599-9fd5-3cbdc7275145 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:18.933942 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 954/1914] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:18 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:18.938173 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f098a67-8860-406f-afea-19f6caee2c24 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:18.948550 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f098a67-8860-406f-afea-19f6caee2c24 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:18.953572 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5525f-65ae-4b0c-9a46-611f43520bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:18.954365 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5525f-65ae-4b0c-9a46-611f43520bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:18.954706 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5525f-65ae-4b0c-9a46-611f43520bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:18.955056 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5525f-65ae-4b0c-9a46-611f43520bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:18.956421 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5525f-65ae-4b0c-9a46-611f43520bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:18.957630 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5525f-65ae-4b0c-9a46-611f43520bc7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:18.968537 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 961/1915] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:18 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:18.972753 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef5031-72e7-4599-9fd5-3cbdc7275145 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:18.983303 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef5031-72e7-4599-9fd5-3cbdc7275145 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:18.988605 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3a6d0-1249-4464-b006-36efc2274f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:18.989429 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3a6d0-1249-4464-b006-36efc2274f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:18.989713 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3a6d0-1249-4464-b006-36efc2274f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:18.989991 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3a6d0-1249-4464-b006-36efc2274f3b admin admin] PATH_INFO: `/v3/projects/d9b5be56b38b4ee8bc359a836e0594c8/users/f67596443e3541329a6e7b523a9a57f1/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.004859 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3a6d0-1249-4464-b006-36efc2274f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b5be56b38b4ee8bc359a836e0594c8, user_id=f67596443e3541329a6e7b523a9a57f1, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:19.007545 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3a6d0-1249-4464-b006-36efc2274f3b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:19.023932 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 955/1916] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:18 2021] PUT /identity/v3/projects/d9b5be56b38b4ee8bc359a836e0594c8/users/f67596443e3541329a6e7b523a9a57f1/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:19.072303 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b262cb-32bf-466a-8b62-02996d11aadf None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.073132 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b262cb-32bf-466a-8b62-02996d11aadf None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.073634 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b262cb-32bf-466a-8b62-02996d11aadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.092530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3a6d0-1249-4464-b006-36efc2274f3b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:19.095675 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ace3a6d0-1249-4464-b006-36efc2274f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:19.108281 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-a3b262cb-32bf-466a-8b62-02996d11aadf None None] MFA Rules not processed for user `f67596443e3541329a6e7b523a9a57f1`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:19.112512 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a3b262cb-32bf-466a-8b62-02996d11aadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:19.186925 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3a6d0-1249-4464-b006-36efc2274f3b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:19.198443 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b466466-8655-4f4a-bd6d-bd116a65e633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:19.199404 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b466466-8655-4f4a-bd6d-bd116a65e633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.199682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b466466-8655-4f4a-bd6d-bd116a65e633 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.199957 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b466466-8655-4f4a-bd6d-bd116a65e633 admin admin] PATH_INFO: `/v3/projects/253cb3ba4e0c464181143f6219bf5703` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.201797 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b466466-8655-4f4a-bd6d-bd116a65e633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=253cb3ba4e0c464181143f6219bf5703)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:19.204126 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b466466-8655-4f4a-bd6d-bd116a65e633 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:19.208287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 962/1917] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:19 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:19.212383 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b262cb-32bf-466a-8b62-02996d11aadf None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:19.236728 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b262cb-32bf-466a-8b62-02996d11aadf None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:19.242335 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fc0d5-0171-43fd-95d0-dc244915c075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:19.242924 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc0d5-0171-43fd-95d0-dc244915c075 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.243200 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc0d5-0171-43fd-95d0-dc244915c075 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.243647 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc0d5-0171-43fd-95d0-dc244915c075 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.244239 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fc0d5-0171-43fd-95d0-dc244915c075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:19.247214 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fc0d5-0171-43fd-95d0-dc244915c075 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:19.255380 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4b466466-8655-4f4a-bd6d-bd116a65e633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253cb3ba4e0c464181143f6219bf5703', 'request_id': 'req-4b466466-8655-4f4a-bd6d-bd116a65e633'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:19.261735 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4b466466-8655-4f4a-bd6d-bd116a65e633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253cb3ba4e0c464181143f6219bf5703', 'request_id': 'req-4b466466-8655-4f4a-bd6d-bd116a65e633'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:19.274342 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4b466466-8655-4f4a-bd6d-bd116a65e633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253cb3ba4e0c464181143f6219bf5703', 'request_id': 'req-4b466466-8655-4f4a-bd6d-bd116a65e633'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:19.281911 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 963/1918] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:19 2021] POST /identity/v3/projects => generated 363 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:19.285840 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fc0d5-0171-43fd-95d0-dc244915c075 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:19.288194 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4b466466-8655-4f4a-bd6d-bd116a65e633 admin admin] The token cache is being invalidate because project 253cb3ba4e0c464181143f6219bf5703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:19.288596 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4b466466-8655-4f4a-bd6d-bd116a65e633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:19.289257 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4b466466-8655-4f4a-bd6d-bd116a65e633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:19.291741 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 956/1919] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:19 2021] DELETE /identity/v3/projects/253cb3ba4e0c464181143f6219bf5703 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:19.297073 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272cd93-1b78-466d-9b18-da8c3fa94d93 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.297370 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272cd93-1b78-466d-9b18-da8c3fa94d93 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.297648 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272cd93-1b78-466d-9b18-da8c3fa94d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.316526 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-9272cd93-1b78-466d-9b18-da8c3fa94d93 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:19.317963 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-9272cd93-1b78-466d-9b18-da8c3fa94d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:19.350532 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fc0d5-0171-43fd-95d0-dc244915c075 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:19.359302 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2988f3c-0f65-49e8-b112-17fb5f1aca5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:19.360100 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2988f3c-0f65-49e8-b112-17fb5f1aca5f admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.360448 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2988f3c-0f65-49e8-b112-17fb5f1aca5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.360820 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2988f3c-0f65-49e8-b112-17fb5f1aca5f admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.361594 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2988f3c-0f65-49e8-b112-17fb5f1aca5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:19.364429 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2988f3c-0f65-49e8-b112-17fb5f1aca5f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:19.391175 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 964/1920] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:19 2021] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:19.394969 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2988f3c-0f65-49e8-b112-17fb5f1aca5f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:19.396698 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 957/1921] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:19.398343 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c2988f3c-0f65-49e8-b112-17fb5f1aca5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:19.398658 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbef72a-9d05-4f13-b711-4c01b8f97a2e None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.398913 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbef72a-9d05-4f13-b711-4c01b8f97a2e None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.399314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbef72a-9d05-4f13-b711-4c01b8f97a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.422592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2988f3c-0f65-49e8-b112-17fb5f1aca5f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:19.426162 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-0fbef72a-9d05-4f13-b711-4c01b8f97a2e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:19.427601 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-0fbef72a-9d05-4f13-b711-4c01b8f97a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:19.428241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4fd4d-0201-495a-9bdc-ab8ae218a04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:19.430798 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4fd4d-0201-495a-9bdc-ab8ae218a04f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.431181 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4fd4d-0201-495a-9bdc-ab8ae218a04f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.431487 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4fd4d-0201-495a-9bdc-ab8ae218a04f admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.432996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4fd4d-0201-495a-9bdc-ab8ae218a04f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:19.434755 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4fd4d-0201-495a-9bdc-ab8ae218a04f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:19.440303 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 958/1922] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:19.441312 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbef72a-9d05-4f13-b711-4c01b8f97a2e None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:19.447610 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 965/1923] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:19 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:05:19.451100 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4fd4d-0201-495a-9bdc-ab8ae218a04f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:19.451255 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbef72a-9d05-4f13-b711-4c01b8f97a2e None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:19.456562 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cbc02-344f-4723-a346-6d54d08c2ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:19.457368 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cbc02-344f-4723-a346-6d54d08c2ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.457728 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cbc02-344f-4723-a346-6d54d08c2ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.458078 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cbc02-344f-4723-a346-6d54d08c2ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.458903 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cbc02-344f-4723-a346-6d54d08c2ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:05:19.459278 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cbc02-344f-4723-a346-6d54d08c2ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:19.461357 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cbc02-344f-4723-a346-6d54d08c2ac9 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:19.462162 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4fd4d-0201-495a-9bdc-ab8ae218a04f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:19.470008 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0bf30-05f7-4e4e-a009-faaf3c36c52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:19.470899 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0bf30-05f7-4e4e-a009-faaf3c36c52d admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.471659 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0bf30-05f7-4e4e-a009-faaf3c36c52d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.471940 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0bf30-05f7-4e4e-a009-faaf3c36c52d admin admin] PATH_INFO: `/v3/projects/b9ffe091b12345098f7a477fd3c9fe94/users/ee7bd6aabaa849ff9a2fa3068efa3fd6/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.475015 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 959/1924] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:05:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:05:19.480754 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cbc02-344f-4723-a346-6d54d08c2ac9 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:19.491662 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0bf30-05f7-4e4e-a009-faaf3c36c52d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ffe091b12345098f7a477fd3c9fe94, user_id=ee7bd6aabaa849ff9a2fa3068efa3fd6, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:19.491818 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cbc02-344f-4723-a346-6d54d08c2ac9 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:19.495304 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0bf30-05f7-4e4e-a009-faaf3c36c52d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:19.501434 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f853c9-bc1f-4bec-b857-a4a7020f7e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:19.503062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f853c9-bc1f-4bec-b857-a4a7020f7e8d admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.503814 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f853c9-bc1f-4bec-b857-a4a7020f7e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.504141 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f853c9-bc1f-4bec-b857-a4a7020f7e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.504944 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f853c9-bc1f-4bec-b857-a4a7020f7e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:19.506921 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f853c9-bc1f-4bec-b857-a4a7020f7e8d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:19.514864 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 966/1925] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:19 2021] PUT /identity/v3/projects/b9ffe091b12345098f7a477fd3c9fe94/users/ee7bd6aabaa849ff9a2fa3068efa3fd6/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:19.519050 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0bf30-05f7-4e4e-a009-faaf3c36c52d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:19.549326 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 960/1926] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:19 2021] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:19.550852 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f853c9-bc1f-4bec-b857-a4a7020f7e8d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:19.600573 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0bf30-05f7-4e4e-a009-faaf3c36c52d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:19.636858 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f853c9-bc1f-4bec-b857-a4a7020f7e8d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:19.641751 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b19220-2d24-4ab8-95f0-424fec38056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:19.642494 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b19220-2d24-4ab8-95f0-424fec38056d admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.642873 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b19220-2d24-4ab8-95f0-424fec38056d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.643218 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b19220-2d24-4ab8-95f0-424fec38056d admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.644025 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b19220-2d24-4ab8-95f0-424fec38056d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:19.646019 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b19220-2d24-4ab8-95f0-424fec38056d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:19.669526 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd23a64-06ef-422a-abcf-5f779968b79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:19.670196 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd23a64-06ef-422a-abcf-5f779968b79d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.670505 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd23a64-06ef-422a-abcf-5f779968b79d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.670774 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd23a64-06ef-422a-abcf-5f779968b79d admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.671541 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd23a64-06ef-422a-abcf-5f779968b79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:19.673596 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd23a64-06ef-422a-abcf-5f779968b79d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:19.674268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 961/1927] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:19 2021] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:19.678365 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b19220-2d24-4ab8-95f0-424fec38056d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:19.687756 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 967/1928] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:19 2021] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:19.689106 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd23a64-06ef-422a-abcf-5f779968b79d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:19.689314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b19220-2d24-4ab8-95f0-424fec38056d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:19.694059 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfeab8-3b3e-419c-a3a3-e56410a282ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:19.694750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfeab8-3b3e-419c-a3a3-e56410a282ea admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.695035 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfeab8-3b3e-419c-a3a3-e56410a282ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.695312 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfeab8-3b3e-419c-a3a3-e56410a282ea admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.696061 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfeab8-3b3e-419c-a3a3-e56410a282ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:19.698470 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfeab8-3b3e-419c-a3a3-e56410a282ea admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:19.702455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd23a64-06ef-422a-abcf-5f779968b79d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:19.708354 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 962/1929] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:19 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:05:19.711503 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a05e8-676e-4666-9021-db0342640395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:19.712734 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfeab8-3b3e-419c-a3a3-e56410a282ea admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:19.715693 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a05e8-676e-4666-9021-db0342640395 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.716001 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a05e8-676e-4666-9021-db0342640395 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.716286 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a05e8-676e-4666-9021-db0342640395 admin admin] PATH_INFO: `/v3/projects/b9ffe091b12345098f7a477fd3c9fe94/users/ee7bd6aabaa849ff9a2fa3068efa3fd6/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.718370 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a05e8-676e-4666-9021-db0342640395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ffe091b12345098f7a477fd3c9fe94, user_id=ee7bd6aabaa849ff9a2fa3068efa3fd6, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:19.721057 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a05e8-676e-4666-9021-db0342640395 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:19.723711 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfeab8-3b3e-419c-a3a3-e56410a282ea admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:19.730061 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2baa9-aeb0-4be3-9ece-2aa8a1eb7ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:19.730849 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2baa9-aeb0-4be3-9ece-2aa8a1eb7ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.731197 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2baa9-aeb0-4be3-9ece-2aa8a1eb7ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.731584 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2baa9-aeb0-4be3-9ece-2aa8a1eb7ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.732309 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2baa9-aeb0-4be3-9ece-2aa8a1eb7ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:19.733011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 968/1930] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:19 2021] PUT /identity/v3/projects/b9ffe091b12345098f7a477fd3c9fe94/users/ee7bd6aabaa849ff9a2fa3068efa3fd6/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:19.733807 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a05e8-676e-4666-9021-db0342640395 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:19.734016 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2baa9-aeb0-4be3-9ece-2aa8a1eb7ae5 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:19.736860 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b64a05e8-676e-4666-9021-db0342640395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:19.745998 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 963/1931] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:19 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:19.746232 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664eb2b-12cc-4b36-9c7c-d13052bc2157 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.746647 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664eb2b-12cc-4b36-9c7c-d13052bc2157 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.746795 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664eb2b-12cc-4b36-9c7c-d13052bc2157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.773348 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-8664eb2b-12cc-4b36-9c7c-d13052bc2157 None None] MFA Rules not processed for user `ee7bd6aabaa849ff9a2fa3068efa3fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:19.773878 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-8664eb2b-12cc-4b36-9c7c-d13052bc2157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:19.801958 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a05e8-676e-4666-9021-db0342640395 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:19.806672 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf886d88-4c7b-4b07-a7e2-6a2b85fabbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:19.808121 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf886d88-4c7b-4b07-a7e2-6a2b85fabbb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.808399 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf886d88-4c7b-4b07-a7e2-6a2b85fabbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.808669 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf886d88-4c7b-4b07-a7e2-6a2b85fabbb6 admin admin] PATH_INFO: `/v3/users/fdd08ec1dafe48bbaac224adafc9a402` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.809863 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf886d88-4c7b-4b07-a7e2-6a2b85fabbb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd08ec1dafe48bbaac224adafc9a402)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:19.811821 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf886d88-4c7b-4b07-a7e2-6a2b85fabbb6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:19.840841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 964/1932] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:19 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:19.841651 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664eb2b-12cc-4b36-9c7c-d13052bc2157 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:19.851803 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664eb2b-12cc-4b36-9c7c-d13052bc2157 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:19.857061 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef781cab-7f15-4422-bfb8-4f894b5f454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:19.857960 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef781cab-7f15-4422-bfb8-4f894b5f454e admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.858237 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef781cab-7f15-4422-bfb8-4f894b5f454e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.858507 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef781cab-7f15-4422-bfb8-4f894b5f454e admin admin] PATH_INFO: `/v3/projects/72dea46818924414b1a2389d37863b12/users/a56adcefe36f442abe26c6790215c90b/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.862351 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-cf886d88-4c7b-4b07-a7e2-6a2b85fabbb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd08ec1dafe48bbaac224adafc9a402'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:19.863013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-cf886d88-4c7b-4b07-a7e2-6a2b85fabbb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd08ec1dafe48bbaac224adafc9a402'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:19.863926 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-cf886d88-4c7b-4b07-a7e2-6a2b85fabbb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd08ec1dafe48bbaac224adafc9a402'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:19.873620 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef781cab-7f15-4422-bfb8-4f894b5f454e admin admin] RBAC: Authorizing `identity:create_grant(project_id=72dea46818924414b1a2389d37863b12, user_id=a56adcefe36f442abe26c6790215c90b, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:19.876205 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-cf886d88-4c7b-4b07-a7e2-6a2b85fabbb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd08ec1dafe48bbaac224adafc9a402'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:19.876325 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef781cab-7f15-4422-bfb8-4f894b5f454e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:19.884485 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-cf886d88-4c7b-4b07-a7e2-6a2b85fabbb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd08ec1dafe48bbaac224adafc9a402'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:19.903049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 965/1933] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:19 2021] PUT /identity/v3/projects/72dea46818924414b1a2389d37863b12/users/a56adcefe36f442abe26c6790215c90b/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:19.903049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef781cab-7f15-4422-bfb8-4f894b5f454e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:19.903049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ef781cab-7f15-4422-bfb8-4f894b5f454e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:19.907013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 969/1934] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:19 2021] DELETE /identity/v3/users/fdd08ec1dafe48bbaac224adafc9a402 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:19.908387 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739a91e-5470-42b8-934b-173a34d9d746 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:19.908677 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739a91e-5470-42b8-934b-173a34d9d746 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:19.908957 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739a91e-5470-42b8-934b-173a34d9d746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:19.934974 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-a739a91e-5470-42b8-934b-173a34d9d746 None None] MFA Rules not processed for user `a56adcefe36f442abe26c6790215c90b`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:19.936251 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a739a91e-5470-42b8-934b-173a34d9d746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:19.956698 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef781cab-7f15-4422-bfb8-4f894b5f454e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:20.001785 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 970/1935] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:19 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:20.002905 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2288d-b1ef-4512-b470-b2c3b438cf3d None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:20.003197 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2288d-b1ef-4512-b470-b2c3b438cf3d None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:20.003498 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2288d-b1ef-4512-b470-b2c3b438cf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:20.009923 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe3595-91b5-485a-925c-655d1ad88b16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:20.011218 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe3595-91b5-485a-925c-655d1ad88b16 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:20.011458 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe3595-91b5-485a-925c-655d1ad88b16 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:20.011735 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe3595-91b5-485a-925c-655d1ad88b16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:20.014080 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-bcfe3595-91b5-485a-925c-655d1ad88b16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:20.021656 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-18d2288d-b1ef-4512-b470-b2c3b438cf3d None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:20.022828 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-18d2288d-b1ef-4512-b470-b2c3b438cf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:20.087152 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe3595-91b5-485a-925c-655d1ad88b16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:20.089307 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe3595-91b5-485a-925c-655d1ad88b16 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:20.091245 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 971/1936] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:20.092310 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2288d-b1ef-4512-b470-b2c3b438cf3d None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:20.093735 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-18d2288d-b1ef-4512-b470-b2c3b438cf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:20.108267 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 966/1937] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:19 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:20.110950 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2288d-b1ef-4512-b470-b2c3b438cf3d None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:20.116694 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c627c-2801-4f4c-bd6b-49dfa1d73d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:20.116694 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c627c-2801-4f4c-bd6b-49dfa1d73d7b admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:20.116694 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c627c-2801-4f4c-bd6b-49dfa1d73d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:20.116985 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c627c-2801-4f4c-bd6b-49dfa1d73d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:20.117636 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c627c-2801-4f4c-bd6b-49dfa1d73d7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:20.120413 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c627c-2801-4f4c-bd6b-49dfa1d73d7b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:20.128485 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe3595-91b5-485a-925c-655d1ad88b16 service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:20.132038 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-bcfe3595-91b5-485a-925c-655d1ad88b16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:20.163658 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 972/1938] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:20 2021] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:20.168929 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c627c-2801-4f4c-bd6b-49dfa1d73d7b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:20.216629 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe3595-91b5-485a-925c-655d1ad88b16 service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:20.282072 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1215cf-29b3-4bc0-9e19-de43b9221a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:20.282743 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1215cf-29b3-4bc0-9e19-de43b9221a9a service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:20.283067 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1215cf-29b3-4bc0-9e19-de43b9221a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:20.283343 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1215cf-29b3-4bc0-9e19-de43b9221a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:20.289219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c627c-2801-4f4c-bd6b-49dfa1d73d7b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:20.295089 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57682998-85f4-4b86-b2ff-2b603d9dc87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:20.295797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57682998-85f4-4b86-b2ff-2b603d9dc87d admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:20.296082 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57682998-85f4-4b86-b2ff-2b603d9dc87d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:20.296359 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57682998-85f4-4b86-b2ff-2b603d9dc87d admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:20.297049 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57682998-85f4-4b86-b2ff-2b603d9dc87d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:20.299131 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57682998-85f4-4b86-b2ff-2b603d9dc87d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:20.305511 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1215cf-29b3-4bc0-9e19-de43b9221a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:20.307721 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1215cf-29b3-4bc0-9e19-de43b9221a9a service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:20.322492 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 967/1939] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:20.328027 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 973/1940] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:20 2021] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:20.332204 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1215cf-29b3-4bc0-9e19-de43b9221a9a service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:20.345390 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57682998-85f4-4b86-b2ff-2b603d9dc87d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:20.346058 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1215cf-29b3-4bc0-9e19-de43b9221a9a service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:20.347788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-57682998-85f4-4b86-b2ff-2b603d9dc87d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:20.354580 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcb429-341f-4201-ad42-8142afd1d222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:20.355569 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcb429-341f-4201-ad42-8142afd1d222 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:20.355847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcb429-341f-4201-ad42-8142afd1d222 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:20.356134 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcb429-341f-4201-ad42-8142afd1d222 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:20.356854 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcb429-341f-4201-ad42-8142afd1d222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:20.358556 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcb429-341f-4201-ad42-8142afd1d222 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:20.370278 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 968/1941] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:20 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:20.370769 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57682998-85f4-4b86-b2ff-2b603d9dc87d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:20.374273 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcb429-341f-4201-ad42-8142afd1d222 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:20.376053 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede22f87-a421-4cae-92be-8c8764fc2904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:20.377148 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede22f87-a421-4cae-92be-8c8764fc2904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:20.378041 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede22f87-a421-4cae-92be-8c8764fc2904 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:20.378041 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede22f87-a421-4cae-92be-8c8764fc2904 admin admin] PATH_INFO: `/v3/users/f67596443e3541329a6e7b523a9a57f1` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:20.380088 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede22f87-a421-4cae-92be-8c8764fc2904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f67596443e3541329a6e7b523a9a57f1)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:20.382485 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede22f87-a421-4cae-92be-8c8764fc2904 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:20.385802 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcb429-341f-4201-ad42-8142afd1d222 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:20.392190 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c50a2-b654-4a3c-a31d-8afe8a7b5c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:20.393095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c50a2-b654-4a3c-a31d-8afe8a7b5c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:20.393500 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c50a2-b654-4a3c-a31d-8afe8a7b5c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:20.393868 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c50a2-b654-4a3c-a31d-8afe8a7b5c4e admin admin] PATH_INFO: `/v3/projects/ec5ecea786eb42b7836aacad4e5b5af5/users/39fa3708e18c471c9da2295b013f41d5/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:20.412542 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c50a2-b654-4a3c-a31d-8afe8a7b5c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5ecea786eb42b7836aacad4e5b5af5, user_id=39fa3708e18c471c9da2295b013f41d5, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:20.415743 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c50a2-b654-4a3c-a31d-8afe8a7b5c4e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:20.433960 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 969/1942] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:20 2021] PUT /identity/v3/projects/ec5ecea786eb42b7836aacad4e5b5af5/users/39fa3708e18c471c9da2295b013f41d5/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:20.438429 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c50a2-b654-4a3c-a31d-8afe8a7b5c4e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:20.452077 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-ede22f87-a421-4cae-92be-8c8764fc2904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f67596443e3541329a6e7b523a9a57f1'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:20.453236 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-ede22f87-a421-4cae-92be-8c8764fc2904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f67596443e3541329a6e7b523a9a57f1'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:20.454081 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-ede22f87-a421-4cae-92be-8c8764fc2904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f67596443e3541329a6e7b523a9a57f1'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:20.469305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-ede22f87-a421-4cae-92be-8c8764fc2904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f67596443e3541329a6e7b523a9a57f1'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:20.480203 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-ede22f87-a421-4cae-92be-8c8764fc2904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f67596443e3541329a6e7b523a9a57f1'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:20.497203 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 974/1943] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:20 2021] DELETE /identity/v3/users/f67596443e3541329a6e7b523a9a57f1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:20.501182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074b6c4-00cc-4463-84c6-71f47a89861b None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:20.501613 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074b6c4-00cc-4463-84c6-71f47a89861b None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:20.501986 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074b6c4-00cc-4463-84c6-71f47a89861b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:20.527972 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-8074b6c4-00cc-4463-84c6-71f47a89861b None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:20.529319 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-8074b6c4-00cc-4463-84c6-71f47a89861b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:20.535213 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c50a2-b654-4a3c-a31d-8afe8a7b5c4e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:20.618016 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 975/1944] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:20.633207 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074b6c4-00cc-4463-84c6-71f47a89861b None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:20.636463 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-8074b6c4-00cc-4463-84c6-71f47a89861b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:20.667213 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3dc76-6251-4de1-8501-9058258eb408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:20.668136 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3dc76-6251-4de1-8501-9058258eb408 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:20.668651 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3dc76-6251-4de1-8501-9058258eb408 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:20.669029 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3dc76-6251-4de1-8501-9058258eb408 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:20.670397 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3dc76-6251-4de1-8501-9058258eb408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:20.672058 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3dc76-6251-4de1-8501-9058258eb408 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:20.687664 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 970/1945] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:20 2021] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:05:20.692156 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3dc76-6251-4de1-8501-9058258eb408 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:20.695275 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-d4c3dc76-6251-4de1-8501-9058258eb408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:20.710537 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074b6c4-00cc-4463-84c6-71f47a89861b None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:20.710789 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3dc76-6251-4de1-8501-9058258eb408 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:20.717491 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702d646-4a20-4564-88da-9458796a922a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:20.717491 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702d646-4a20-4564-88da-9458796a922a service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:20.717791 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e1c86-52aa-4c4c-a1b1-2ebccee75929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:20.717910 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702d646-4a20-4564-88da-9458796a922a service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:20.717910 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702d646-4a20-4564-88da-9458796a922a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:20.718188 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e1c86-52aa-4c4c-a1b1-2ebccee75929 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:20.718473 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e1c86-52aa-4c4c-a1b1-2ebccee75929 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:20.718743 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e1c86-52aa-4c4c-a1b1-2ebccee75929 admin admin] PATH_INFO: `/v3/projects/ec5ecea786eb42b7836aacad4e5b5af5/users/39fa3708e18c471c9da2295b013f41d5/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:20.721208 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e1c86-52aa-4c4c-a1b1-2ebccee75929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5ecea786eb42b7836aacad4e5b5af5, user_id=39fa3708e18c471c9da2295b013f41d5, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:20.724268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e1c86-52aa-4c4c-a1b1-2ebccee75929 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:20.728459 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702d646-4a20-4564-88da-9458796a922a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:20.730353 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702d646-4a20-4564-88da-9458796a922a service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:20.739393 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 971/1946] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:20 2021] PUT /identity/v3/projects/ec5ecea786eb42b7836aacad4e5b5af5/users/39fa3708e18c471c9da2295b013f41d5/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:20.741358 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 976/1947] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:20.751143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88854386-5129-4c55-a121-dbb9a4ac13f7 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:20.751464 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88854386-5129-4c55-a121-dbb9a4ac13f7 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:20.751760 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88854386-5129-4c55-a121-dbb9a4ac13f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:20.781201 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-88854386-5129-4c55-a121-dbb9a4ac13f7 None None] MFA Rules not processed for user `39fa3708e18c471c9da2295b013f41d5`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:20.782339 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-88854386-5129-4c55-a121-dbb9a4ac13f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:20.844558 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702d646-4a20-4564-88da-9458796a922a service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:20.846575 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f702d646-4a20-4564-88da-9458796a922a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:20.879688 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 972/1948] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:20 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:20.882607 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702d646-4a20-4564-88da-9458796a922a service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:20.890645 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88854386-5129-4c55-a121-dbb9a4ac13f7 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:20.892952 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-88854386-5129-4c55-a121-dbb9a4ac13f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:20.946547 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d0af8-e44f-4db9-8a3e-88bc1d7f81c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:20.947521 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d0af8-e44f-4db9-8a3e-88bc1d7f81c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:20.947920 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d0af8-e44f-4db9-8a3e-88bc1d7f81c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:20.948556 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d0af8-e44f-4db9-8a3e-88bc1d7f81c0 admin admin] PATH_INFO: `/v3/projects/d07fe26e95c74c8ca5ba7d239e19ac50` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:20.949523 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d0af8-e44f-4db9-8a3e-88bc1d7f81c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d07fe26e95c74c8ca5ba7d239e19ac50)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:20.952859 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d0af8-e44f-4db9-8a3e-88bc1d7f81c0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:20.974453 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88854386-5129-4c55-a121-dbb9a4ac13f7 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:20.980806 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89102da8-3e0e-4ddf-999c-4a806c874f0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:20.981809 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89102da8-3e0e-4ddf-999c-4a806c874f0a service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:20.982254 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89102da8-3e0e-4ddf-999c-4a806c874f0a service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:20.982538 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89102da8-3e0e-4ddf-999c-4a806c874f0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:20.998436 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89102da8-3e0e-4ddf-999c-4a806c874f0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:21.000702 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89102da8-3e0e-4ddf-999c-4a806c874f0a service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:21.014954 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 973/1949] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:20 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:05:21.020585 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-df3d0af8-e44f-4db9-8a3e-88bc1d7f81c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd07fe26e95c74c8ca5ba7d239e19ac50', 'request_id': 'req-df3d0af8-e44f-4db9-8a3e-88bc1d7f81c0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.029804 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-df3d0af8-e44f-4db9-8a3e-88bc1d7f81c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd07fe26e95c74c8ca5ba7d239e19ac50', 'request_id': 'req-df3d0af8-e44f-4db9-8a3e-88bc1d7f81c0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.042007 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-df3d0af8-e44f-4db9-8a3e-88bc1d7f81c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd07fe26e95c74c8ca5ba7d239e19ac50', 'request_id': 'req-df3d0af8-e44f-4db9-8a3e-88bc1d7f81c0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.068728 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89102da8-3e0e-4ddf-999c-4a806c874f0a service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:21.070359 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-89102da8-3e0e-4ddf-999c-4a806c874f0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:21.079810 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-df3d0af8-e44f-4db9-8a3e-88bc1d7f81c0 admin admin] The token cache is being invalidate because project d07fe26e95c74c8ca5ba7d239e19ac50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:21.080115 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-df3d0af8-e44f-4db9-8a3e-88bc1d7f81c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.082587 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-df3d0af8-e44f-4db9-8a3e-88bc1d7f81c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.085177 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89102da8-3e0e-4ddf-999c-4a806c874f0a service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:21.088860 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 977/1950] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:20 2021] DELETE /identity/v3/projects/d07fe26e95c74c8ca5ba7d239e19ac50 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:21.095446 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d0af8-e44f-4db9-8a3e-88bc1d7f81c0 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:21.096848 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-df3d0af8-e44f-4db9-8a3e-88bc1d7f81c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:21.152025 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720ccde-f836-4655-aeb7-eb82d059d844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:21.153200 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720ccde-f836-4655-aeb7-eb82d059d844 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:21.153544 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720ccde-f836-4655-aeb7-eb82d059d844 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:21.155126 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720ccde-f836-4655-aeb7-eb82d059d844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:21.157486 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c720ccde-f836-4655-aeb7-eb82d059d844 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:21.250676 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720ccde-f836-4655-aeb7-eb82d059d844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:21.253068 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720ccde-f836-4655-aeb7-eb82d059d844 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:21.259830 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d0af8-e44f-4db9-8a3e-88bc1d7f81c0 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:21.266403 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e662be5-198d-439e-b7ea-1edb7f68a047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:21.267640 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e662be5-198d-439e-b7ea-1edb7f68a047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:21.268215 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e662be5-198d-439e-b7ea-1edb7f68a047 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:21.268981 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e662be5-198d-439e-b7ea-1edb7f68a047 admin admin] PATH_INFO: `/v3/users/fe5762833cc7459e85ffd0ea410eebfa` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:21.270683 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e662be5-198d-439e-b7ea-1edb7f68a047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5762833cc7459e85ffd0ea410eebfa)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:21.273201 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e662be5-198d-439e-b7ea-1edb7f68a047 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:21.281791 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 974/1951] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:21 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:05:21.356647 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1e662be5-198d-439e-b7ea-1edb7f68a047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5762833cc7459e85ffd0ea410eebfa'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.360188 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1e662be5-198d-439e-b7ea-1edb7f68a047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5762833cc7459e85ffd0ea410eebfa'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.372933 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1e662be5-198d-439e-b7ea-1edb7f68a047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5762833cc7459e85ffd0ea410eebfa'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.404494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1e662be5-198d-439e-b7ea-1edb7f68a047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5762833cc7459e85ffd0ea410eebfa'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.418375 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1e662be5-198d-439e-b7ea-1edb7f68a047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5762833cc7459e85ffd0ea410eebfa'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.435272 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 978/1952] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:21 2021] DELETE /identity/v3/users/fe5762833cc7459e85ffd0ea410eebfa => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:21.458916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720ccde-f836-4655-aeb7-eb82d059d844 service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:21.460691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c720ccde-f836-4655-aeb7-eb82d059d844 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:21.476424 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e662be5-198d-439e-b7ea-1edb7f68a047 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:21.477748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1e662be5-198d-439e-b7ea-1edb7f68a047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:21.491281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720ccde-f836-4655-aeb7-eb82d059d844 service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:21.594085 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e662be5-198d-439e-b7ea-1edb7f68a047 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:21.609341 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37352c1b-7b44-4c99-ae68-c698f7b8b3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:21.610223 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37352c1b-7b44-4c99-ae68-c698f7b8b3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:21.610507 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37352c1b-7b44-4c99-ae68-c698f7b8b3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:21.611195 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37352c1b-7b44-4c99-ae68-c698f7b8b3d5 admin admin] PATH_INFO: `/v3/projects/d9b5be56b38b4ee8bc359a836e0594c8` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:21.613054 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37352c1b-7b44-4c99-ae68-c698f7b8b3d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b5be56b38b4ee8bc359a836e0594c8)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:21.614992 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37352c1b-7b44-4c99-ae68-c698f7b8b3d5 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:21.615548 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222416e-431b-4599-bab0-b56c9729522d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:21.617669 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222416e-431b-4599-bab0-b56c9729522d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:21.619753 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222416e-431b-4599-bab0-b56c9729522d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:21.619753 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222416e-431b-4599-bab0-b56c9729522d admin admin] PATH_INFO: `/v3/users/a56adcefe36f442abe26c6790215c90b` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:21.623491 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222416e-431b-4599-bab0-b56c9729522d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a56adcefe36f442abe26c6790215c90b)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:21.628948 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222416e-431b-4599-bab0-b56c9729522d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:21.706257 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-37352c1b-7b44-4c99-ae68-c698f7b8b3d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b5be56b38b4ee8bc359a836e0594c8', 'request_id': 'req-37352c1b-7b44-4c99-ae68-c698f7b8b3d5'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.707693 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9222416e-431b-4599-bab0-b56c9729522d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a56adcefe36f442abe26c6790215c90b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.708989 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9222416e-431b-4599-bab0-b56c9729522d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a56adcefe36f442abe26c6790215c90b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.709852 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9222416e-431b-4599-bab0-b56c9729522d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a56adcefe36f442abe26c6790215c90b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.719348 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-37352c1b-7b44-4c99-ae68-c698f7b8b3d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b5be56b38b4ee8bc359a836e0594c8', 'request_id': 'req-37352c1b-7b44-4c99-ae68-c698f7b8b3d5'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.729900 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-37352c1b-7b44-4c99-ae68-c698f7b8b3d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b5be56b38b4ee8bc359a836e0594c8', 'request_id': 'req-37352c1b-7b44-4c99-ae68-c698f7b8b3d5'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.732344 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9222416e-431b-4599-bab0-b56c9729522d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a56adcefe36f442abe26c6790215c90b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.743854 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-37352c1b-7b44-4c99-ae68-c698f7b8b3d5 admin admin] The token cache is being invalidate because project d9b5be56b38b4ee8bc359a836e0594c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:21.744188 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-37352c1b-7b44-4c99-ae68-c698f7b8b3d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.745586 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-37352c1b-7b44-4c99-ae68-c698f7b8b3d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.747225 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 975/1953] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:21 2021] DELETE /identity/v3/projects/d9b5be56b38b4ee8bc359a836e0594c8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:21.752096 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9222416e-431b-4599-bab0-b56c9729522d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a56adcefe36f442abe26c6790215c90b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:21.752502 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37352c1b-7b44-4c99-ae68-c698f7b8b3d5 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:21.756099 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-37352c1b-7b44-4c99-ae68-c698f7b8b3d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:21.805881 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 979/1954] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:21 2021] DELETE /identity/v3/users/a56adcefe36f442abe26c6790215c90b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:21.810494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13616889-9cbb-4cd1-b3f4-b9bda134922d None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:21.810853 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13616889-9cbb-4cd1-b3f4-b9bda134922d None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:21.811214 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13616889-9cbb-4cd1-b3f4-b9bda134922d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:21.859266 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-13616889-9cbb-4cd1-b3f4-b9bda134922d None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:21.860259 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-13616889-9cbb-4cd1-b3f4-b9bda134922d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:21.933176 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37352c1b-7b44-4c99-ae68-c698f7b8b3d5 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:22.037828 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 980/1955] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:22.038914 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13616889-9cbb-4cd1-b3f4-b9bda134922d None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:22.048101 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-13616889-9cbb-4cd1-b3f4-b9bda134922d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:22.076584 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13616889-9cbb-4cd1-b3f4-b9bda134922d None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:22.086160 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a2df9-8249-4c04-9e73-d013739a3288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:22.089932 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a2df9-8249-4c04-9e73-d013739a3288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:22.090233 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a2df9-8249-4c04-9e73-d013739a3288 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:22.090597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a2df9-8249-4c04-9e73-d013739a3288 admin admin] PATH_INFO: `/v3/projects/903bbb7c1de347809b553dfd9fcd95a2` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:22.094683 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a2df9-8249-4c04-9e73-d013739a3288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=903bbb7c1de347809b553dfd9fcd95a2)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:22.095551 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa9eba-0c78-4d42-b89c-a55c1c45dc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:22.096457 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa9eba-0c78-4d42-b89c-a55c1c45dc0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:22.096741 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa9eba-0c78-4d42-b89c-a55c1c45dc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:22.098485 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa9eba-0c78-4d42-b89c-a55c1c45dc0c admin admin] PATH_INFO: `/v3/users/ee7bd6aabaa849ff9a2fa3068efa3fd6` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:22.100207 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a2df9-8249-4c04-9e73-d013739a3288 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:22.101815 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa9eba-0c78-4d42-b89c-a55c1c45dc0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee7bd6aabaa849ff9a2fa3068efa3fd6)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:22.109576 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa9eba-0c78-4d42-b89c-a55c1c45dc0c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:22.175416 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b46a2df9-8249-4c04-9e73-d013739a3288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903bbb7c1de347809b553dfd9fcd95a2', 'request_id': 'req-b46a2df9-8249-4c04-9e73-d013739a3288'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:22.180148 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c5fa9eba-0c78-4d42-b89c-a55c1c45dc0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee7bd6aabaa849ff9a2fa3068efa3fd6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:22.183836 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b46a2df9-8249-4c04-9e73-d013739a3288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903bbb7c1de347809b553dfd9fcd95a2', 'request_id': 'req-b46a2df9-8249-4c04-9e73-d013739a3288'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:22.190837 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b46a2df9-8249-4c04-9e73-d013739a3288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903bbb7c1de347809b553dfd9fcd95a2', 'request_id': 'req-b46a2df9-8249-4c04-9e73-d013739a3288'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:22.198559 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c5fa9eba-0c78-4d42-b89c-a55c1c45dc0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee7bd6aabaa849ff9a2fa3068efa3fd6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:22.201517 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c5fa9eba-0c78-4d42-b89c-a55c1c45dc0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee7bd6aabaa849ff9a2fa3068efa3fd6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:22.213524 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b46a2df9-8249-4c04-9e73-d013739a3288 admin admin] The token cache is being invalidate because project 903bbb7c1de347809b553dfd9fcd95a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:22.213955 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b46a2df9-8249-4c04-9e73-d013739a3288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:22.215857 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b46a2df9-8249-4c04-9e73-d013739a3288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:22.222496 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c5fa9eba-0c78-4d42-b89c-a55c1c45dc0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee7bd6aabaa849ff9a2fa3068efa3fd6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:22.223151 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 981/1956] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:22 2021] DELETE /identity/v3/projects/903bbb7c1de347809b553dfd9fcd95a2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:22.223151 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a2df9-8249-4c04-9e73-d013739a3288 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:22.224541 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b46a2df9-8249-4c04-9e73-d013739a3288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:22.238021 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c5fa9eba-0c78-4d42-b89c-a55c1c45dc0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee7bd6aabaa849ff9a2fa3068efa3fd6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:22.259190 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 976/1957] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:21 2021] DELETE /identity/v3/users/ee7bd6aabaa849ff9a2fa3068efa3fd6 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:22.263389 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc14732-fb23-43fb-a102-7706e10b6823 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:22.263695 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc14732-fb23-43fb-a102-7706e10b6823 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:22.269945 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc14732-fb23-43fb-a102-7706e10b6823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:22.324956 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a2df9-8249-4c04-9e73-d013739a3288 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:22.338004 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-dbc14732-fb23-43fb-a102-7706e10b6823 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:22.339601 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-dbc14732-fb23-43fb-a102-7706e10b6823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:22.388305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a92329-14dd-4a46-a93c-fd7d1e363615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:22.389143 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a92329-14dd-4a46-a93c-fd7d1e363615 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:22.389521 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a92329-14dd-4a46-a93c-fd7d1e363615 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:22.390099 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a92329-14dd-4a46-a93c-fd7d1e363615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:22.392361 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-59a92329-14dd-4a46-a93c-fd7d1e363615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:22.417833 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 977/1958] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:22.426888 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ac25d-3256-4fb8-8d61-ec54472b8f62 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:22.427437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ac25d-3256-4fb8-8d61-ec54472b8f62 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:22.427822 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ac25d-3256-4fb8-8d61-ec54472b8f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:22.460247 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-ea8ac25d-3256-4fb8-8d61-ec54472b8f62 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:22.461541 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ea8ac25d-3256-4fb8-8d61-ec54472b8f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:22.473150 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 978/1959] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:22.476794 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ac25d-3256-4fb8-8d61-ec54472b8f62 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:22.489623 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ac25d-3256-4fb8-8d61-ec54472b8f62 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:22.502154 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a92329-14dd-4a46-a93c-fd7d1e363615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:22.504132 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a92329-14dd-4a46-a93c-fd7d1e363615 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:22.504603 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47cbd8-c4d7-4946-8d82-81bed18b2b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:22.505692 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47cbd8-c4d7-4946-8d82-81bed18b2b9e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:22.505979 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47cbd8-c4d7-4946-8d82-81bed18b2b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:22.506255 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47cbd8-c4d7-4946-8d82-81bed18b2b9e admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:22.506978 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47cbd8-c4d7-4946-8d82-81bed18b2b9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:05:22.507281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47cbd8-c4d7-4946-8d82-81bed18b2b9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:22.513079 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47cbd8-c4d7-4946-8d82-81bed18b2b9e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:22.515221 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 982/1960] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:22.539957 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 979/1961] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:05:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:05:22.542889 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a92329-14dd-4a46-a93c-fd7d1e363615 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:22.556707 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a92329-14dd-4a46-a93c-fd7d1e363615 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:22.563524 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7af733-9a26-4a71-b31f-d2fb6faabd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:22.564435 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7af733-9a26-4a71-b31f-d2fb6faabd52 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:22.564968 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7af733-9a26-4a71-b31f-d2fb6faabd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:22.565758 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7af733-9a26-4a71-b31f-d2fb6faabd52 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:22.566935 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7af733-9a26-4a71-b31f-d2fb6faabd52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:22.569317 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7af733-9a26-4a71-b31f-d2fb6faabd52 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:22.611312 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 983/1962] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:22 2021] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:22.612844 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47cbd8-c4d7-4946-8d82-81bed18b2b9e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:22.629131 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47cbd8-c4d7-4946-8d82-81bed18b2b9e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:22.674111 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7af733-9a26-4a71-b31f-d2fb6faabd52 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:22.676446 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-5c7af733-9a26-4a71-b31f-d2fb6faabd52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:22.727629 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30ef10-06c1-4a75-8c6c-9da8c1aa9c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:22.728532 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30ef10-06c1-4a75-8c6c-9da8c1aa9c2e admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:22.729067 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30ef10-06c1-4a75-8c6c-9da8c1aa9c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:22.729457 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30ef10-06c1-4a75-8c6c-9da8c1aa9c2e admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:22.730299 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30ef10-06c1-4a75-8c6c-9da8c1aa9c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:22.733457 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30ef10-06c1-4a75-8c6c-9da8c1aa9c2e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:22.772491 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 980/1963] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:22 2021] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:22.779305 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30ef10-06c1-4a75-8c6c-9da8c1aa9c2e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:22.797046 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30ef10-06c1-4a75-8c6c-9da8c1aa9c2e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:22.798926 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7af733-9a26-4a71-b31f-d2fb6faabd52 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:22.802392 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d9979-e093-4206-8529-51399eb84a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:22.803176 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d9979-e093-4206-8529-51399eb84a5b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:22.803569 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d9979-e093-4206-8529-51399eb84a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:22.803857 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d9979-e093-4206-8529-51399eb84a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:22.804618 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d9979-e093-4206-8529-51399eb84a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:22.804731 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0019e3b-3011-411f-97dd-d7cce5d5af05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:22.805677 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0019e3b-3011-411f-97dd-d7cce5d5af05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:22.806020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0019e3b-3011-411f-97dd-d7cce5d5af05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:22.806220 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d9979-e093-4206-8529-51399eb84a5b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:22.806321 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0019e3b-3011-411f-97dd-d7cce5d5af05 admin admin] PATH_INFO: `/v3/projects/b9ffe091b12345098f7a477fd3c9fe94` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:22.808230 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0019e3b-3011-411f-97dd-d7cce5d5af05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ffe091b12345098f7a477fd3c9fe94)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:22.810178 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0019e3b-3011-411f-97dd-d7cce5d5af05 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:22.826931 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 981/1964] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:22 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:05:22.828458 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d9979-e093-4206-8529-51399eb84a5b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:22.842370 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d9979-e093-4206-8529-51399eb84a5b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:22.853276 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea343f-6c72-4f8c-8376-b62d603a4dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:22.854539 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea343f-6c72-4f8c-8376-b62d603a4dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:22.854856 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea343f-6c72-4f8c-8376-b62d603a4dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:22.855134 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea343f-6c72-4f8c-8376-b62d603a4dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:22.856154 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea343f-6c72-4f8c-8376-b62d603a4dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:22.860493 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea343f-6c72-4f8c-8376-b62d603a4dd7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:22.867505 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b0019e3b-3011-411f-97dd-d7cce5d5af05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ffe091b12345098f7a477fd3c9fe94', 'request_id': 'req-b0019e3b-3011-411f-97dd-d7cce5d5af05'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:22.876421 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 982/1965] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:22 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:22.876603 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b0019e3b-3011-411f-97dd-d7cce5d5af05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ffe091b12345098f7a477fd3c9fe94', 'request_id': 'req-b0019e3b-3011-411f-97dd-d7cce5d5af05'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:22.878023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea343f-6c72-4f8c-8376-b62d603a4dd7 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:22.881757 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b0019e3b-3011-411f-97dd-d7cce5d5af05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ffe091b12345098f7a477fd3c9fe94', 'request_id': 'req-b0019e3b-3011-411f-97dd-d7cce5d5af05'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:22.891068 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea343f-6c72-4f8c-8376-b62d603a4dd7 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:22.914070 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b0019e3b-3011-411f-97dd-d7cce5d5af05 admin admin] The token cache is being invalidate because project b9ffe091b12345098f7a477fd3c9fe94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:22.914709 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b0019e3b-3011-411f-97dd-d7cce5d5af05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:22.915490 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b0019e3b-3011-411f-97dd-d7cce5d5af05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:22.918354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 984/1966] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:22 2021] DELETE /identity/v3/projects/b9ffe091b12345098f7a477fd3c9fe94 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:22.925907 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730af8fd-079a-41e7-a303-8727a589d79e None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:22.926529 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730af8fd-079a-41e7-a303-8727a589d79e None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:22.927430 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730af8fd-079a-41e7-a303-8727a589d79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:22.959006 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-730af8fd-079a-41e7-a303-8727a589d79e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:22.960951 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-730af8fd-079a-41e7-a303-8727a589d79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:22.977258 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93ade6-e8c8-4f15-88de-754f0db0efd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:22.978618 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93ade6-e8c8-4f15-88de-754f0db0efd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:22.979457 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93ade6-e8c8-4f15-88de-754f0db0efd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:22.979738 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93ade6-e8c8-4f15-88de-754f0db0efd7 admin admin] PATH_INFO: `/v3/projects/4227a354dffa4af9bcf4081c84efb834/users/47a7dec8d3d74d05abe6262dc66803d6/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:23.000158 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93ade6-e8c8-4f15-88de-754f0db0efd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4227a354dffa4af9bcf4081c84efb834, user_id=47a7dec8d3d74d05abe6262dc66803d6, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:23.002872 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93ade6-e8c8-4f15-88de-754f0db0efd7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:23.037025 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 983/1967] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:22 2021] PUT /identity/v3/projects/4227a354dffa4af9bcf4081c84efb834/users/47a7dec8d3d74d05abe6262dc66803d6/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:23.037988 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51bb57-43c0-4063-8002-43d35b057b45 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:23.038373 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51bb57-43c0-4063-8002-43d35b057b45 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:23.038725 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51bb57-43c0-4063-8002-43d35b057b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:23.064868 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 985/1968] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:23.072458 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5d841-b450-4a1d-a544-b93abbeb03f6 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:23.072747 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5d841-b450-4a1d-a544-b93abbeb03f6 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:23.073021 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5d841-b450-4a1d-a544-b93abbeb03f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:23.084437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-0f51bb57-43c0-4063-8002-43d35b057b45 None None] MFA Rules not processed for user `47a7dec8d3d74d05abe6262dc66803d6`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:23.086070 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-0f51bb57-43c0-4063-8002-43d35b057b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:23.097025 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-fca5d841-b450-4a1d-a544-b93abbeb03f6 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:23.098522 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-fca5d841-b450-4a1d-a544-b93abbeb03f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:23.207209 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 984/1969] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:23 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:23.208294 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51bb57-43c0-4063-8002-43d35b057b45 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:23.209688 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-0f51bb57-43c0-4063-8002-43d35b057b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:23.214777 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 986/1970] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:23.220855 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5d841-b450-4a1d-a544-b93abbeb03f6 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:23.243388 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51bb57-43c0-4063-8002-43d35b057b45 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:23.252557 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292546d-b5b5-4d50-9172-07cce40c28ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:23.253374 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292546d-b5b5-4d50-9172-07cce40c28ab admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:23.256191 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292546d-b5b5-4d50-9172-07cce40c28ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:23.256744 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292546d-b5b5-4d50-9172-07cce40c28ab admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:23.257575 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292546d-b5b5-4d50-9172-07cce40c28ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:23.260393 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5d841-b450-4a1d-a544-b93abbeb03f6 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:23.263777 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292546d-b5b5-4d50-9172-07cce40c28ab admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:23.274364 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c632d-9a0e-44a6-9738-784ee88e93b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:23.275311 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c632d-9a0e-44a6-9738-784ee88e93b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:23.276531 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c632d-9a0e-44a6-9738-784ee88e93b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:23.277156 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c632d-9a0e-44a6-9738-784ee88e93b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:23.278185 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c632d-9a0e-44a6-9738-784ee88e93b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:05:23.278680 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c632d-9a0e-44a6-9738-784ee88e93b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:23.280522 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c632d-9a0e-44a6-9738-784ee88e93b2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:23.299512 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 987/1971] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:05:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:05:23.300667 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c632d-9a0e-44a6-9738-784ee88e93b2 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:23.303940 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-251c632d-9a0e-44a6-9738-784ee88e93b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:23.314381 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 985/1972] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:23 2021] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:23.318437 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c632d-9a0e-44a6-9738-784ee88e93b2 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:23.318943 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292546d-b5b5-4d50-9172-07cce40c28ab admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:23.387567 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cacea-8a6b-4127-83a0-4351e8d8027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:23.388538 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cacea-8a6b-4127-83a0-4351e8d8027b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:23.389114 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cacea-8a6b-4127-83a0-4351e8d8027b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:23.389114 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cacea-8a6b-4127-83a0-4351e8d8027b admin admin] PATH_INFO: `/v3/projects/72dea46818924414b1a2389d37863b12` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:23.390486 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cacea-8a6b-4127-83a0-4351e8d8027b admin admin] RBAC: Authorizing `identity:delete_project(project_id=72dea46818924414b1a2389d37863b12)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:23.392599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cacea-8a6b-4127-83a0-4351e8d8027b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:23.412369 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292546d-b5b5-4d50-9172-07cce40c28ab admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:23.419574 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476d386-47c6-4388-b1ed-836976e991a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:23.420817 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476d386-47c6-4388-b1ed-836976e991a6 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:23.421360 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476d386-47c6-4388-b1ed-836976e991a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:23.421905 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476d386-47c6-4388-b1ed-836976e991a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:23.424049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476d386-47c6-4388-b1ed-836976e991a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:23.427282 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476d386-47c6-4388-b1ed-836976e991a6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:23.473932 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e76cacea-8a6b-4127-83a0-4351e8d8027b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72dea46818924414b1a2389d37863b12', 'request_id': 'req-e76cacea-8a6b-4127-83a0-4351e8d8027b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:23.482691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 986/1973] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:23 2021] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:23.488705 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476d386-47c6-4388-b1ed-836976e991a6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:23.510504 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e76cacea-8a6b-4127-83a0-4351e8d8027b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72dea46818924414b1a2389d37863b12', 'request_id': 'req-e76cacea-8a6b-4127-83a0-4351e8d8027b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:23.516041 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e76cacea-8a6b-4127-83a0-4351e8d8027b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72dea46818924414b1a2389d37863b12', 'request_id': 'req-e76cacea-8a6b-4127-83a0-4351e8d8027b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:23.544539 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e76cacea-8a6b-4127-83a0-4351e8d8027b admin admin] The token cache is being invalidate because project 72dea46818924414b1a2389d37863b12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:23.544859 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e76cacea-8a6b-4127-83a0-4351e8d8027b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:23.547580 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e76cacea-8a6b-4127-83a0-4351e8d8027b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:23.560214 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 988/1974] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:23 2021] DELETE /identity/v3/projects/72dea46818924414b1a2389d37863b12 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:23.560214 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cacea-8a6b-4127-83a0-4351e8d8027b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:23.568302 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-e76cacea-8a6b-4127-83a0-4351e8d8027b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:23.599195 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476d386-47c6-4388-b1ed-836976e991a6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:23.606967 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dacf5-60a1-4ada-8c03-f2edd2d1172f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:23.607849 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dacf5-60a1-4ada-8c03-f2edd2d1172f admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:23.608324 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dacf5-60a1-4ada-8c03-f2edd2d1172f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:23.608608 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dacf5-60a1-4ada-8c03-f2edd2d1172f admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:23.609417 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dacf5-60a1-4ada-8c03-f2edd2d1172f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:23.611547 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dacf5-60a1-4ada-8c03-f2edd2d1172f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:23.640354 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 987/1975] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:23 2021] POST /identity/v3/users => generated 299 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:23.641961 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dacf5-60a1-4ada-8c03-f2edd2d1172f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:23.644180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-2c0dacf5-60a1-4ada-8c03-f2edd2d1172f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:23.657977 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dacf5-60a1-4ada-8c03-f2edd2d1172f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:23.663145 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29fc2e-c058-462d-9e03-5f71d427113a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:23.664053 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29fc2e-c058-462d-9e03-5f71d427113a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:23.664333 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29fc2e-c058-462d-9e03-5f71d427113a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:23.664605 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29fc2e-c058-462d-9e03-5f71d427113a admin admin] PATH_INFO: `/v3/users/39fa3708e18c471c9da2295b013f41d5` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:23.665792 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29fc2e-c058-462d-9e03-5f71d427113a admin admin] RBAC: Authorizing `identity:delete_user(user_id=39fa3708e18c471c9da2295b013f41d5)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:23.668067 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29fc2e-c058-462d-9e03-5f71d427113a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:23.675521 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cacea-8a6b-4127-83a0-4351e8d8027b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:23.680645 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e47bfa-2eeb-4257-a822-d84dba4cee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:23.681316 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e47bfa-2eeb-4257-a822-d84dba4cee39 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:23.681903 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e47bfa-2eeb-4257-a822-d84dba4cee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:23.682185 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e47bfa-2eeb-4257-a822-d84dba4cee39 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:23.682873 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e47bfa-2eeb-4257-a822-d84dba4cee39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:23.685234 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e47bfa-2eeb-4257-a822-d84dba4cee39 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:23.707182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 989/1976] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:23 2021] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:23.712479 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e47bfa-2eeb-4257-a822-d84dba4cee39 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:23.715258 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-80e47bfa-2eeb-4257-a822-d84dba4cee39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:23.728463 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e47bfa-2eeb-4257-a822-d84dba4cee39 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:23.733909 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e0835-b92d-4db5-bf55-1a7db243def4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:23.734682 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e0835-b92d-4db5-bf55-1a7db243def4 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:23.735038 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e0835-b92d-4db5-bf55-1a7db243def4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:23.735410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e0835-b92d-4db5-bf55-1a7db243def4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:23.736494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e0835-b92d-4db5-bf55-1a7db243def4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:23.738002 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e0835-b92d-4db5-bf55-1a7db243def4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:23.741551 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2d29fc2e-c058-462d-9e03-5f71d427113a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39fa3708e18c471c9da2295b013f41d5'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:23.750211 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 990/1977] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:23 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:23.751211 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e0835-b92d-4db5-bf55-1a7db243def4 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:23.762490 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2d29fc2e-c058-462d-9e03-5f71d427113a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39fa3708e18c471c9da2295b013f41d5'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:23.763292 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2d29fc2e-c058-462d-9e03-5f71d427113a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39fa3708e18c471c9da2295b013f41d5'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:23.764007 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e0835-b92d-4db5-bf55-1a7db243def4 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:23.769502 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d384ce-163a-4fd2-8d58-7110b1c45c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:23.770403 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d384ce-163a-4fd2-8d58-7110b1c45c13 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:23.771011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d384ce-163a-4fd2-8d58-7110b1c45c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:23.771238 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d384ce-163a-4fd2-8d58-7110b1c45c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:23.771797 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2d29fc2e-c058-462d-9e03-5f71d427113a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39fa3708e18c471c9da2295b013f41d5'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:23.772074 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d384ce-163a-4fd2-8d58-7110b1c45c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:23.773729 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d384ce-163a-4fd2-8d58-7110b1c45c13 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:23.781584 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2d29fc2e-c058-462d-9e03-5f71d427113a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39fa3708e18c471c9da2295b013f41d5'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:23.788298 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 988/1979] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:23 2021] DELETE /identity/v3/users/39fa3708e18c471c9da2295b013f41d5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:23.791233 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 991/1979] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:23 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:23.791233 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d384ce-163a-4fd2-8d58-7110b1c45c13 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:23.792482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c2d384ce-163a-4fd2-8d58-7110b1c45c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:23.793216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29fc2e-c058-462d-9e03-5f71d427113a admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:23.794873 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-2d29fc2e-c058-462d-9e03-5f71d427113a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:23.805762 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d384ce-163a-4fd2-8d58-7110b1c45c13 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:23.866905 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29fc2e-c058-462d-9e03-5f71d427113a admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:23.879533 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818a482-ddde-4a90-a788-aa2900357d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:23.881374 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be484b5c-4f48-4431-8315-94048134fa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:23.883776 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be484b5c-4f48-4431-8315-94048134fa2d admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:23.884188 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be484b5c-4f48-4431-8315-94048134fa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:23.885726 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be484b5c-4f48-4431-8315-94048134fa2d admin admin] PATH_INFO: `/v3/projects/16721a225050435d8a9ab09124d761f2/users/038a77fc6052483da5640a930b097b74/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:23.893346 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818a482-ddde-4a90-a788-aa2900357d0e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:23.893641 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818a482-ddde-4a90-a788-aa2900357d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:23.894709 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818a482-ddde-4a90-a788-aa2900357d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:23.895498 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818a482-ddde-4a90-a788-aa2900357d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:23.897134 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818a482-ddde-4a90-a788-aa2900357d0e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:23.915912 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be484b5c-4f48-4431-8315-94048134fa2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=16721a225050435d8a9ab09124d761f2, user_id=038a77fc6052483da5640a930b097b74, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:23.918266 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 989/1980] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:23 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:23.922235 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818a482-ddde-4a90-a788-aa2900357d0e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:23.923180 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be484b5c-4f48-4431-8315-94048134fa2d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:23.937974 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818a482-ddde-4a90-a788-aa2900357d0e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:23.952265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 992/1981] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:23 2021] PUT /identity/v3/projects/16721a225050435d8a9ab09124d761f2/users/038a77fc6052483da5640a930b097b74/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:23.957640 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be484b5c-4f48-4431-8315-94048134fa2d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:24.015218 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47a25b-ff53-48aa-9a91-aff6933111a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:24.016029 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47a25b-ff53-48aa-9a91-aff6933111a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.016310 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47a25b-ff53-48aa-9a91-aff6933111a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.016586 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47a25b-ff53-48aa-9a91-aff6933111a7 admin admin] PATH_INFO: `/v3/projects/7dad9eb2175f45ec9dcd86ad6065ad3f/users/883364decdef4da181eecd839ada7ea1/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.034649 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47a25b-ff53-48aa-9a91-aff6933111a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dad9eb2175f45ec9dcd86ad6065ad3f, user_id=883364decdef4da181eecd839ada7ea1, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:24.037516 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47a25b-ff53-48aa-9a91-aff6933111a7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:24.064964 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 990/1982] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:23 2021] PUT /identity/v3/projects/7dad9eb2175f45ec9dcd86ad6065ad3f/users/883364decdef4da181eecd839ada7ea1/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:24.065916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be484b5c-4f48-4431-8315-94048134fa2d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:24.066794 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de520bc8-0cc7-4d34-9729-d85556f654ef None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.067085 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de520bc8-0cc7-4d34-9729-d85556f654ef None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.067442 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de520bc8-0cc7-4d34-9729-d85556f654ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.133810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-de520bc8-0cc7-4d34-9729-d85556f654ef None None] MFA Rules not processed for user `883364decdef4da181eecd839ada7ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:24.135670 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-de520bc8-0cc7-4d34-9729-d85556f654ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:24.154146 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b11d3-37a2-4d5d-a5a6-e56e80e4e038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:24.155379 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b11d3-37a2-4d5d-a5a6-e56e80e4e038 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.155662 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b11d3-37a2-4d5d-a5a6-e56e80e4e038 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.156669 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b11d3-37a2-4d5d-a5a6-e56e80e4e038 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.159117 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b11d3-37a2-4d5d-a5a6-e56e80e4e038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:24.169058 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b11d3-37a2-4d5d-a5a6-e56e80e4e038 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:24.195742 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 993/1983] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:23 2021] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:24.200723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b11d3-37a2-4d5d-a5a6-e56e80e4e038 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:24.217697 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b11d3-37a2-4d5d-a5a6-e56e80e4e038 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:24.217906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 991/1984] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:24 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:24.222687 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de520bc8-0cc7-4d34-9729-d85556f654ef None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:24.223705 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bb811-031d-4a3f-bc6f-be047cc6fea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:24.225272 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb811-031d-4a3f-bc6f-be047cc6fea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.225576 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb811-031d-4a3f-bc6f-be047cc6fea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.225953 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb811-031d-4a3f-bc6f-be047cc6fea3 admin admin] PATH_INFO: `/v3/projects/16721a225050435d8a9ab09124d761f2/users/038a77fc6052483da5640a930b097b74/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.228807 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bb811-031d-4a3f-bc6f-be047cc6fea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16721a225050435d8a9ab09124d761f2, user_id=038a77fc6052483da5640a930b097b74, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:24.231822 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bb811-031d-4a3f-bc6f-be047cc6fea3 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:24.238077 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de520bc8-0cc7-4d34-9729-d85556f654ef None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:24.245145 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 994/1985] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:24 2021] PUT /identity/v3/projects/16721a225050435d8a9ab09124d761f2/users/038a77fc6052483da5640a930b097b74/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:24.246169 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bb811-031d-4a3f-bc6f-be047cc6fea3 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:24.254567 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a35bb811-031d-4a3f-bc6f-be047cc6fea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:24.308562 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e342a-d1b3-4a8a-86f8-42eedf82f275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:24.309232 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e342a-d1b3-4a8a-86f8-42eedf82f275 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.309509 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e342a-d1b3-4a8a-86f8-42eedf82f275 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.309782 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e342a-d1b3-4a8a-86f8-42eedf82f275 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.310608 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e342a-d1b3-4a8a-86f8-42eedf82f275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:24.312948 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e342a-d1b3-4a8a-86f8-42eedf82f275 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:24.325538 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bb811-031d-4a3f-bc6f-be047cc6fea3 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:24.330920 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dc323-fcee-46b6-a263-7cd6d6011893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:24.331906 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dc323-fcee-46b6-a263-7cd6d6011893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.332189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dc323-fcee-46b6-a263-7cd6d6011893 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.332462 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dc323-fcee-46b6-a263-7cd6d6011893 admin admin] PATH_INFO: `/v3/projects/ec5ecea786eb42b7836aacad4e5b5af5` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.333733 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9dc323-fcee-46b6-a263-7cd6d6011893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec5ecea786eb42b7836aacad4e5b5af5)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:24.336540 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9dc323-fcee-46b6-a263-7cd6d6011893 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:24.338023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 992/1986] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:24 2021] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:24.342770 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745496-b169-4ebb-83a2-fe0c3e91634f None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.343066 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745496-b169-4ebb-83a2-fe0c3e91634f None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.343350 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745496-b169-4ebb-83a2-fe0c3e91634f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.371034 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-b7745496-b169-4ebb-83a2-fe0c3e91634f None None] MFA Rules not processed for user `038a77fc6052483da5640a930b097b74`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:24.372556 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b7745496-b169-4ebb-83a2-fe0c3e91634f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:24.385995 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-4b9dc323-fcee-46b6-a263-7cd6d6011893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec5ecea786eb42b7836aacad4e5b5af5', 'request_id': 'req-4b9dc323-fcee-46b6-a263-7cd6d6011893'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:24.392169 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-4b9dc323-fcee-46b6-a263-7cd6d6011893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec5ecea786eb42b7836aacad4e5b5af5', 'request_id': 'req-4b9dc323-fcee-46b6-a263-7cd6d6011893'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:24.398150 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-4b9dc323-fcee-46b6-a263-7cd6d6011893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec5ecea786eb42b7836aacad4e5b5af5', 'request_id': 'req-4b9dc323-fcee-46b6-a263-7cd6d6011893'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:24.412008 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-4b9dc323-fcee-46b6-a263-7cd6d6011893 admin admin] The token cache is being invalidate because project ec5ecea786eb42b7836aacad4e5b5af5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:24.412386 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-4b9dc323-fcee-46b6-a263-7cd6d6011893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:24.413352 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-4b9dc323-fcee-46b6-a263-7cd6d6011893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:24.415174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 995/1987] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:24 2021] DELETE /identity/v3/projects/ec5ecea786eb42b7836aacad4e5b5af5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:24.415944 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dc323-fcee-46b6-a263-7cd6d6011893 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:24.421415 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-4b9dc323-fcee-46b6-a263-7cd6d6011893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:24.441979 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 993/1988] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:24 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:24.443289 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d17329-806b-4101-bf22-ab06d316aeef None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.443607 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d17329-806b-4101-bf22-ab06d316aeef None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.443876 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d17329-806b-4101-bf22-ab06d316aeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.465430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-f1d17329-806b-4101-bf22-ab06d316aeef None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:24.466615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f1d17329-806b-4101-bf22-ab06d316aeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:24.488986 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dc323-fcee-46b6-a263-7cd6d6011893 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:24.493701 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e701b-4b11-4fcd-b1d2-82160cbde166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:24.494417 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e701b-4b11-4fcd-b1d2-82160cbde166 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.494941 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e701b-4b11-4fcd-b1d2-82160cbde166 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.495250 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e701b-4b11-4fcd-b1d2-82160cbde166 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.496085 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e701b-4b11-4fcd-b1d2-82160cbde166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:24.498013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e701b-4b11-4fcd-b1d2-82160cbde166 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:24.518977 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 996/1989] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:24 2021] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:24.519907 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e701b-4b11-4fcd-b1d2-82160cbde166 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:24.522010 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-cd6e701b-4b11-4fcd-b1d2-82160cbde166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:24.532863 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 994/1990] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:24.533326 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d17329-806b-4101-bf22-ab06d316aeef None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:24.544711 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d17329-806b-4101-bf22-ab06d316aeef None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:24.550999 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a0c6f-3d63-4f61-a88e-7d759caaa9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:24.551635 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a0c6f-3d63-4f61-a88e-7d759caaa9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.551921 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a0c6f-3d63-4f61-a88e-7d759caaa9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.552189 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a0c6f-3d63-4f61-a88e-7d759caaa9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.553063 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a0c6f-3d63-4f61-a88e-7d759caaa9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:24.555260 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a0c6f-3d63-4f61-a88e-7d759caaa9b2 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:24.565501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 995/1991] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:24 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:24.566611 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386139a6-bc44-49c9-a0af-e1eb2a822011 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.566900 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386139a6-bc44-49c9-a0af-e1eb2a822011 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.567176 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386139a6-bc44-49c9-a0af-e1eb2a822011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.582641 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e701b-4b11-4fcd-b1d2-82160cbde166 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:24.586553 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e4ff-7cb4-419c-a49b-0a2c22431e4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:24.587223 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e4ff-7cb4-419c-a49b-0a2c22431e4d service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.587548 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e4ff-7cb4-419c-a49b-0a2c22431e4d service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.587829 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e4ff-7cb4-419c-a49b-0a2c22431e4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.599411 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764e4ff-7cb4-419c-a49b-0a2c22431e4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:24.600602 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764e4ff-7cb4-419c-a49b-0a2c22431e4d service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:24.613182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 997/1992] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:24 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:24.614129 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e4ff-7cb4-419c-a49b-0a2c22431e4d service cinder] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:24.626419 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e4ff-7cb4-419c-a49b-0a2c22431e4d service cinder] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:24.648230 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25f90d-e3e4-43a5-bc12-344b5236d841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:24.656314 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25f90d-e3e4-43a5-bc12-344b5236d841 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.656916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25f90d-e3e4-43a5-bc12-344b5236d841 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.657215 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25f90d-e3e4-43a5-bc12-344b5236d841 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.658016 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25f90d-e3e4-43a5-bc12-344b5236d841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:24.659819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25f90d-e3e4-43a5-bc12-344b5236d841 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:24.676472 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 998/1993] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:24 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:24.677638 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25f90d-e3e4-43a5-bc12-344b5236d841 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:24.694781 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25f90d-e3e4-43a5-bc12-344b5236d841 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:24.701117 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897db8b9-a955-4b29-b21a-e8753599e4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:24.702020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897db8b9-a955-4b29-b21a-e8753599e4b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.702307 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897db8b9-a955-4b29-b21a-e8753599e4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.702588 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897db8b9-a955-4b29-b21a-e8753599e4b9 admin admin] PATH_INFO: `/v3/projects/bdf11f7642ec4004b1b0c9832a895e60/users/db8c104c88ef41d181c3269bc30d2a15/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.719253 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-386139a6-bc44-49c9-a0af-e1eb2a822011 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:24.721106 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-386139a6-bc44-49c9-a0af-e1eb2a822011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:24.722085 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897db8b9-a955-4b29-b21a-e8753599e4b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf11f7642ec4004b1b0c9832a895e60, user_id=db8c104c88ef41d181c3269bc30d2a15, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:24.725051 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897db8b9-a955-4b29-b21a-e8753599e4b9 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:24.735407 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 996/1994] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:24.735407 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386139a6-bc44-49c9-a0af-e1eb2a822011 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:24.735407 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-386139a6-bc44-49c9-a0af-e1eb2a822011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:24.746407 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 999/1995] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:24 2021] PUT /identity/v3/projects/bdf11f7642ec4004b1b0c9832a895e60/users/db8c104c88ef41d181c3269bc30d2a15/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:24.746992 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386139a6-bc44-49c9-a0af-e1eb2a822011 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:24.748430 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897db8b9-a955-4b29-b21a-e8753599e4b9 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:24.815983 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742194b0-be89-4a0b-a527-f59e8da56f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:24.816861 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742194b0-be89-4a0b-a527-f59e8da56f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.817140 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742194b0-be89-4a0b-a527-f59e8da56f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.817410 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742194b0-be89-4a0b-a527-f59e8da56f9a admin admin] PATH_INFO: `/v3/users/47a7dec8d3d74d05abe6262dc66803d6` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.818634 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742194b0-be89-4a0b-a527-f59e8da56f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a7dec8d3d74d05abe6262dc66803d6)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:24.820569 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742194b0-be89-4a0b-a527-f59e8da56f9a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:24.843146 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897db8b9-a955-4b29-b21a-e8753599e4b9 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:24.847128 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e947a-c959-47f8-a8a4-429cfbcf4ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:24.847949 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e947a-c959-47f8-a8a4-429cfbcf4ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.848234 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e947a-c959-47f8-a8a4-429cfbcf4ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.848510 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e947a-c959-47f8-a8a4-429cfbcf4ef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.849225 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e947a-c959-47f8-a8a4-429cfbcf4ef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:05:24.849543 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e947a-c959-47f8-a8a4-429cfbcf4ef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:24.851120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e947a-c959-47f8-a8a4-429cfbcf4ef6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:24.863185 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1000/1996] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:05:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:05:24.864482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd07e-9f3f-46af-b106-de12ec7b852a None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.864916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd07e-9f3f-46af-b106-de12ec7b852a None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.865093 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fd07e-9f3f-46af-b106-de12ec7b852a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.866637 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-742194b0-be89-4a0b-a527-f59e8da56f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a7dec8d3d74d05abe6262dc66803d6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:24.878299 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-742194b0-be89-4a0b-a527-f59e8da56f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a7dec8d3d74d05abe6262dc66803d6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:24.879281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-742194b0-be89-4a0b-a527-f59e8da56f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a7dec8d3d74d05abe6262dc66803d6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:24.887530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-742194b0-be89-4a0b-a527-f59e8da56f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a7dec8d3d74d05abe6262dc66803d6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:24.894446 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-487fd07e-9f3f-46af-b106-de12ec7b852a None None] MFA Rules not processed for user `db8c104c88ef41d181c3269bc30d2a15`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:24.895246 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-742194b0-be89-4a0b-a527-f59e8da56f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a7dec8d3d74d05abe6262dc66803d6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:24.895746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-487fd07e-9f3f-46af-b106-de12ec7b852a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:24.901227 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 997/1997] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:24 2021] DELETE /identity/v3/users/47a7dec8d3d74d05abe6262dc66803d6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:24.901974 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742194b0-be89-4a0b-a527-f59e8da56f9a admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:24.903433 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-742194b0-be89-4a0b-a527-f59e8da56f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:24.963825 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1001/1998] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:24 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:24.964825 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742194b0-be89-4a0b-a527-f59e8da56f9a admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:24.965197 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb28d8-a7bc-4b74-9f4b-9a5f4c39f55c None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.965605 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb28d8-a7bc-4b74-9f4b-9a5f4c39f55c None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.965886 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb28d8-a7bc-4b74-9f4b-9a5f4c39f55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.970316 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cc85c-3853-4451-845d-0fd7ed069948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:24.970968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cc85c-3853-4451-845d-0fd7ed069948 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:24.971248 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cc85c-3853-4451-845d-0fd7ed069948 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:24.971550 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cc85c-3853-4451-845d-0fd7ed069948 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:24.972226 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250cc85c-3853-4451-845d-0fd7ed069948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:24.974115 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250cc85c-3853-4451-845d-0fd7ed069948 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:24.983552 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-4eeb28d8-a7bc-4b74-9f4b-9a5f4c39f55c None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:24.984767 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-4eeb28d8-a7bc-4b74-9f4b-9a5f4c39f55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:24.993355 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1002/1999] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:24.996258 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb28d8-a7bc-4b74-9f4b-9a5f4c39f55c None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:24.998112 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-4eeb28d8-a7bc-4b74-9f4b-9a5f4c39f55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:25.004058 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 998/2000] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:24 2021] POST /identity/v3/projects => generated 361 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:25.004456 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cc85c-3853-4451-845d-0fd7ed069948 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:25.006025 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-250cc85c-3853-4451-845d-0fd7ed069948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:25.013992 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb28d8-a7bc-4b74-9f4b-9a5f4c39f55c None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:25.064328 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cc85c-3853-4451-845d-0fd7ed069948 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:25.068183 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace342d-db1a-4ad1-8a57-0b559d976306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:25.068847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace342d-db1a-4ad1-8a57-0b559d976306 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:25.069126 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace342d-db1a-4ad1-8a57-0b559d976306 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:25.069519 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace342d-db1a-4ad1-8a57-0b559d976306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:25.079534 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b16a28-70d9-4cf5-943b-35b9c82b0be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:25.080257 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b16a28-70d9-4cf5-943b-35b9c82b0be4 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:25.080546 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b16a28-70d9-4cf5-943b-35b9c82b0be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:25.080913 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b16a28-70d9-4cf5-943b-35b9c82b0be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:25.081660 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b16a28-70d9-4cf5-943b-35b9c82b0be4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:25.083978 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b16a28-70d9-4cf5-943b-35b9c82b0be4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:25.117387 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1003/2001] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:24 2021] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:25.120008 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b16a28-70d9-4cf5-943b-35b9c82b0be4 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:25.139800 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace342d-db1a-4ad1-8a57-0b559d976306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:25.141750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace342d-db1a-4ad1-8a57-0b559d976306 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:25.153000 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 999/2002] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:05:25.154565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace342d-db1a-4ad1-8a57-0b559d976306 service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:25.167416 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace342d-db1a-4ad1-8a57-0b559d976306 service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:25.193459 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b16a28-70d9-4cf5-943b-35b9c82b0be4 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:25.201264 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b519c-c0eb-4ff2-bc56-aa7fb029497a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:25.202354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b519c-c0eb-4ff2-bc56-aa7fb029497a admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:25.203132 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b519c-c0eb-4ff2-bc56-aa7fb029497a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:25.203453 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b519c-c0eb-4ff2-bc56-aa7fb029497a admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:25.205412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b519c-c0eb-4ff2-bc56-aa7fb029497a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:25.207181 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b519c-c0eb-4ff2-bc56-aa7fb029497a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:25.233413 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1004/2003] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:25 2021] POST /identity/v3/users => generated 281 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:25.237510 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b519c-c0eb-4ff2-bc56-aa7fb029497a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:25.238050 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42801b3b-50ec-409d-96b5-9f2248df4c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:25.238748 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42801b3b-50ec-409d-96b5-9f2248df4c98 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:25.239036 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42801b3b-50ec-409d-96b5-9f2248df4c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:25.239309 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42801b3b-50ec-409d-96b5-9f2248df4c98 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:25.239445 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c31b519c-c0eb-4ff2-bc56-aa7fb029497a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:25.240058 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42801b3b-50ec-409d-96b5-9f2248df4c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:25.241992 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42801b3b-50ec-409d-96b5-9f2248df4c98 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:25.255127 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b519c-c0eb-4ff2-bc56-aa7fb029497a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:25.263570 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbec98-03d2-41c6-b538-06ca0d1ff5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:25.264465 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbec98-03d2-41c6-b538-06ca0d1ff5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:25.264748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbec98-03d2-41c6-b538-06ca0d1ff5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:25.265028 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbec98-03d2-41c6-b538-06ca0d1ff5b7 admin admin] PATH_INFO: `/v3/users/1a7ca78eccd54f1d8000d43792121a24` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:25.266722 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbec98-03d2-41c6-b538-06ca0d1ff5b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a7ca78eccd54f1d8000d43792121a24)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:25.269294 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbec98-03d2-41c6-b538-06ca0d1ff5b7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:25.275576 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1000/2004] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:25 2021] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:25.276754 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42801b3b-50ec-409d-96b5-9f2248df4c98 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:25.290594 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42801b3b-50ec-409d-96b5-9f2248df4c98 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:25.299408 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec94895-7435-43ba-af50-724dca55eeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:25.301432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec94895-7435-43ba-af50-724dca55eeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:25.301767 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec94895-7435-43ba-af50-724dca55eeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:25.302056 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec94895-7435-43ba-af50-724dca55eeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:25.304461 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec94895-7435-43ba-af50-724dca55eeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:25.305155 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec94895-7435-43ba-af50-724dca55eeb6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:25.319668 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1001/2005] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:25 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:25.319668 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec94895-7435-43ba-af50-724dca55eeb6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:25.333803 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec94895-7435-43ba-af50-724dca55eeb6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:25.344234 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8e63c-4cf8-4d6e-9e95-c71e03e2001e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:25.344915 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8e63c-4cf8-4d6e-9e95-c71e03e2001e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:25.345587 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8e63c-4cf8-4d6e-9e95-c71e03e2001e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:25.345587 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8e63c-4cf8-4d6e-9e95-c71e03e2001e admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:25.346185 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8e63c-4cf8-4d6e-9e95-c71e03e2001e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:25.347828 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8e63c-4cf8-4d6e-9e95-c71e03e2001e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:25.360525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1002/2006] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:25 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:25.364866 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8e63c-4cf8-4d6e-9e95-c71e03e2001e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:25.375493 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c6bbec98-03d2-41c6-b538-06ca0d1ff5b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a7ca78eccd54f1d8000d43792121a24'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:25.375885 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8e63c-4cf8-4d6e-9e95-c71e03e2001e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:25.376224 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c6bbec98-03d2-41c6-b538-06ca0d1ff5b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a7ca78eccd54f1d8000d43792121a24'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:25.376873 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c6bbec98-03d2-41c6-b538-06ca0d1ff5b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a7ca78eccd54f1d8000d43792121a24'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:25.383772 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e6b99-6f5b-4af8-812b-c56a858ccee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:25.385012 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e6b99-6f5b-4af8-812b-c56a858ccee1 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:25.386052 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e6b99-6f5b-4af8-812b-c56a858ccee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:25.386704 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e6b99-6f5b-4af8-812b-c56a858ccee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:25.387560 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e6b99-6f5b-4af8-812b-c56a858ccee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:25.389441 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e6b99-6f5b-4af8-812b-c56a858ccee1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:25.402038 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c6bbec98-03d2-41c6-b538-06ca0d1ff5b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a7ca78eccd54f1d8000d43792121a24'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:25.403847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1003/2007] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:25 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:25.404755 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e6b99-6f5b-4af8-812b-c56a858ccee1 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:25.406577 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-6a2e6b99-6f5b-4af8-812b-c56a858ccee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:25.416165 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c6bbec98-03d2-41c6-b538-06ca0d1ff5b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a7ca78eccd54f1d8000d43792121a24'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:25.420868 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e6b99-6f5b-4af8-812b-c56a858ccee1 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:25.426800 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b842e5-9c54-4828-a281-fe161d8964f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:25.427750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b842e5-9c54-4828-a281-fe161d8964f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:25.428113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b842e5-9c54-4828-a281-fe161d8964f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:25.428503 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b842e5-9c54-4828-a281-fe161d8964f9 admin admin] PATH_INFO: `/v3/projects/ca32a1d4e75b40cc97181a5e9dcb0b26/users/08cd0de411b044319d9e6d50db658a2c/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:25.437211 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1005/2008] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:25 2021] DELETE /identity/v3/users/1a7ca78eccd54f1d8000d43792121a24 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:25.438566 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbec98-03d2-41c6-b538-06ca0d1ff5b7 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:25.440697 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c6bbec98-03d2-41c6-b538-06ca0d1ff5b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:25.446524 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b842e5-9c54-4828-a281-fe161d8964f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca32a1d4e75b40cc97181a5e9dcb0b26, user_id=08cd0de411b044319d9e6d50db658a2c, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:25.450811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b842e5-9c54-4828-a281-fe161d8964f9 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:25.473599 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1004/2009] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:25 2021] PUT /identity/v3/projects/ca32a1d4e75b40cc97181a5e9dcb0b26/users/08cd0de411b044319d9e6d50db658a2c/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:25.475198 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5bf97-f152-45e6-b127-5d56084a6743 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:25.475783 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5bf97-f152-45e6-b127-5d56084a6743 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:25.476158 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5bf97-f152-45e6-b127-5d56084a6743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:25.503501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-b6b5bf97-f152-45e6-b127-5d56084a6743 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:25.504999 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b6b5bf97-f152-45e6-b127-5d56084a6743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:25.567200 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbec98-03d2-41c6-b538-06ca0d1ff5b7 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:25.581047 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1005/2010] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:25.581047 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5bf97-f152-45e6-b127-5d56084a6743 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:25.594027 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5bf97-f152-45e6-b127-5d56084a6743 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:25.602025 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a90b9-27dd-4a1c-b4f8-4027911f6a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:25.602724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a90b9-27dd-4a1c-b4f8-4027911f6a91 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:25.603218 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a90b9-27dd-4a1c-b4f8-4027911f6a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:25.603536 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a90b9-27dd-4a1c-b4f8-4027911f6a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:25.606007 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a90b9-27dd-4a1c-b4f8-4027911f6a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:25.612018 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a90b9-27dd-4a1c-b4f8-4027911f6a91 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:25.634665 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1006/2011] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:25 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:25.636529 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a90b9-27dd-4a1c-b4f8-4027911f6a91 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:25.639011 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a06a90b9-27dd-4a1c-b4f8-4027911f6a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:25.646065 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51297092-2fb2-4d82-9e3c-211e7942be76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:25.646885 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51297092-2fb2-4d82-9e3c-211e7942be76 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:25.647169 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51297092-2fb2-4d82-9e3c-211e7942be76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:25.647503 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51297092-2fb2-4d82-9e3c-211e7942be76 admin admin] PATH_INFO: `/v3/projects/3539db56d7df413e992b9309772b4478/users/a91b3fafb77d419c9d68ed00209ab6e1/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:25.663993 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51297092-2fb2-4d82-9e3c-211e7942be76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3539db56d7df413e992b9309772b4478, user_id=a91b3fafb77d419c9d68ed00209ab6e1, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:25.667031 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51297092-2fb2-4d82-9e3c-211e7942be76 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:25.695471 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1006/2012] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:25 2021] PUT /identity/v3/projects/3539db56d7df413e992b9309772b4478/users/a91b3fafb77d419c9d68ed00209ab6e1/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:25.698182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51297092-2fb2-4d82-9e3c-211e7942be76 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:25.724695 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a90b9-27dd-4a1c-b4f8-4027911f6a91 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:25.783968 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51297092-2fb2-4d82-9e3c-211e7942be76 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:25.794321 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3fd15-033e-4ad3-8d35-f1093f925cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:25.795652 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3fd15-033e-4ad3-8d35-f1093f925cec admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:25.796263 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3fd15-033e-4ad3-8d35-f1093f925cec admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:25.796980 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3fd15-033e-4ad3-8d35-f1093f925cec admin admin] PATH_INFO: `/v3/projects/ca32a1d4e75b40cc97181a5e9dcb0b26/users/08cd0de411b044319d9e6d50db658a2c/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:25.799050 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64da150-7f50-4a4d-9741-e380e0dffba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:25.799461 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3fd15-033e-4ad3-8d35-f1093f925cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca32a1d4e75b40cc97181a5e9dcb0b26, user_id=08cd0de411b044319d9e6d50db658a2c, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:25.800300 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64da150-7f50-4a4d-9741-e380e0dffba2 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:25.800741 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64da150-7f50-4a4d-9741-e380e0dffba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:25.801223 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64da150-7f50-4a4d-9741-e380e0dffba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:25.803198 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3fd15-033e-4ad3-8d35-f1093f925cec admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:25.813799 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64da150-7f50-4a4d-9741-e380e0dffba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:25.815633 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64da150-7f50-4a4d-9741-e380e0dffba2 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:25.828280 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1007/2013] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:25.829153 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1007/2014] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:25 2021] PUT /identity/v3/projects/ca32a1d4e75b40cc97181a5e9dcb0b26/users/08cd0de411b044319d9e6d50db658a2c/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:25.829573 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64da150-7f50-4a4d-9741-e380e0dffba2 service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:25.830588 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7674b-b398-4671-9c38-f399b785e801 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:25.830881 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7674b-b398-4671-9c38-f399b785e801 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:25.831162 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7674b-b398-4671-9c38-f399b785e801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:25.843849 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-e64da150-7f50-4a4d-9741-e380e0dffba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:25.887894 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64da150-7f50-4a4d-9741-e380e0dffba2 service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:25.897619 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-62e7674b-b398-4671-9c38-f399b785e801 None None] MFA Rules not processed for user `a91b3fafb77d419c9d68ed00209ab6e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:25.901357 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-62e7674b-b398-4671-9c38-f399b785e801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:26.024519 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f394d4-0027-4899-9d47-7b7f6119b5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:26.025127 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f394d4-0027-4899-9d47-7b7f6119b5a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:26.025895 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f394d4-0027-4899-9d47-7b7f6119b5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:26.026220 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f394d4-0027-4899-9d47-7b7f6119b5a9 admin admin] PATH_INFO: `/v3/projects/4227a354dffa4af9bcf4081c84efb834` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:26.028003 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f394d4-0027-4899-9d47-7b7f6119b5a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4227a354dffa4af9bcf4081c84efb834)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:26.030029 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f394d4-0027-4899-9d47-7b7f6119b5a9 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:26.046658 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1008/2015] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:25 2021] POST /identity/v3/auth/tokens => generated 3381 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:26.049953 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ba9c3-2e45-474c-a429-aa930226f1e8 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:26.051635 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ba9c3-2e45-474c-a429-aa930226f1e8 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:26.051751 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ba9c3-2e45-474c-a429-aa930226f1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:26.099697 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-a44ba9c3-2e45-474c-a429-aa930226f1e8 None None] MFA Rules not processed for user `08cd0de411b044319d9e6d50db658a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:26.100966 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a44ba9c3-2e45-474c-a429-aa930226f1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:26.115056 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-96f394d4-0027-4899-9d47-7b7f6119b5a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4227a354dffa4af9bcf4081c84efb834', 'request_id': 'req-96f394d4-0027-4899-9d47-7b7f6119b5a9'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.121027 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-96f394d4-0027-4899-9d47-7b7f6119b5a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4227a354dffa4af9bcf4081c84efb834', 'request_id': 'req-96f394d4-0027-4899-9d47-7b7f6119b5a9'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.132277 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-96f394d4-0027-4899-9d47-7b7f6119b5a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4227a354dffa4af9bcf4081c84efb834', 'request_id': 'req-96f394d4-0027-4899-9d47-7b7f6119b5a9'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.152847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-96f394d4-0027-4899-9d47-7b7f6119b5a9 admin admin] The token cache is being invalidate because project 4227a354dffa4af9bcf4081c84efb834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:26.153437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-96f394d4-0027-4899-9d47-7b7f6119b5a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.154523 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-96f394d4-0027-4899-9d47-7b7f6119b5a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.156910 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1008/2016] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:25 2021] DELETE /identity/v3/projects/4227a354dffa4af9bcf4081c84efb834 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:26.157817 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f394d4-0027-4899-9d47-7b7f6119b5a9 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:26.159235 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-96f394d4-0027-4899-9d47-7b7f6119b5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:26.209192 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1009/2017] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:26 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:26.209192 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ba9c3-2e45-474c-a429-aa930226f1e8 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:26.209192 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a44ba9c3-2e45-474c-a429-aa930226f1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:26.240659 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f394d4-0027-4899-9d47-7b7f6119b5a9 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:26.247510 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a500037-6dba-4ac9-996a-de48ceb70493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:26.248778 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a500037-6dba-4ac9-996a-de48ceb70493 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:26.249496 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a500037-6dba-4ac9-996a-de48ceb70493 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:26.250111 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a500037-6dba-4ac9-996a-de48ceb70493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:26.253238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-1a500037-6dba-4ac9-996a-de48ceb70493 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:26.315664 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ba9c3-2e45-474c-a429-aa930226f1e8 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:26.323896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a500037-6dba-4ac9-996a-de48ceb70493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:26.325533 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a500037-6dba-4ac9-996a-de48ceb70493 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:26.328586 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a715ef-94e5-4e54-a63a-197f08362252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:26.329810 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a715ef-94e5-4e54-a63a-197f08362252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:26.330106 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a715ef-94e5-4e54-a63a-197f08362252 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:26.330650 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a715ef-94e5-4e54-a63a-197f08362252 admin admin] PATH_INFO: `/v3/users/038a77fc6052483da5640a930b097b74` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:26.333435 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a715ef-94e5-4e54-a63a-197f08362252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=038a77fc6052483da5640a930b097b74)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:26.335393 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a715ef-94e5-4e54-a63a-197f08362252 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:26.336362 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1009/2018] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:26 2021] GET /identity/v3/auth/tokens => generated 3381 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:26.352118 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a500037-6dba-4ac9-996a-de48ceb70493 service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:26.364144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a500037-6dba-4ac9-996a-de48ceb70493 service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:26.373693 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50b20c-4034-44aa-a238-d002b17141cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:26.374463 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50b20c-4034-44aa-a238-d002b17141cc service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:26.374638 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50b20c-4034-44aa-a238-d002b17141cc service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:26.374926 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50b20c-4034-44aa-a238-d002b17141cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:26.404299 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b0a715ef-94e5-4e54-a63a-197f08362252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038a77fc6052483da5640a930b097b74'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.405235 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b0a715ef-94e5-4e54-a63a-197f08362252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038a77fc6052483da5640a930b097b74'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.405870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b0a715ef-94e5-4e54-a63a-197f08362252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038a77fc6052483da5640a930b097b74'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.410051 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50b20c-4034-44aa-a238-d002b17141cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:26.411525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50b20c-4034-44aa-a238-d002b17141cc service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:26.417374 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b0a715ef-94e5-4e54-a63a-197f08362252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038a77fc6052483da5640a930b097b74'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.421241 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1010/2019] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:26 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:26.422147 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50b20c-4034-44aa-a238-d002b17141cc service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:26.423531 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-6a50b20c-4034-44aa-a238-d002b17141cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:26.425673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b0a715ef-94e5-4e54-a63a-197f08362252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038a77fc6052483da5640a930b097b74'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.438065 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50b20c-4034-44aa-a238-d002b17141cc service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:26.440723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1010/2020] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:26 2021] DELETE /identity/v3/users/038a77fc6052483da5640a930b097b74 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:26.443978 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a715ef-94e5-4e54-a63a-197f08362252 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:26.444107 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385dd4b-7cdc-4f29-bbdc-9e8a93a52d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:26.444626 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385dd4b-7cdc-4f29-bbdc-9e8a93a52d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:26.444964 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385dd4b-7cdc-4f29-bbdc-9e8a93a52d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:26.445196 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b0a715ef-94e5-4e54-a63a-197f08362252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:26.445369 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385dd4b-7cdc-4f29-bbdc-9e8a93a52d8a admin admin] PATH_INFO: `/v3/users/a91b3fafb77d419c9d68ed00209ab6e1` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:26.446767 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385dd4b-7cdc-4f29-bbdc-9e8a93a52d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a91b3fafb77d419c9d68ed00209ab6e1)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:26.449361 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385dd4b-7cdc-4f29-bbdc-9e8a93a52d8a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:26.516533 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b385dd4b-7cdc-4f29-bbdc-9e8a93a52d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a91b3fafb77d419c9d68ed00209ab6e1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.545530 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a715ef-94e5-4e54-a63a-197f08362252 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:26.546919 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b385dd4b-7cdc-4f29-bbdc-9e8a93a52d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a91b3fafb77d419c9d68ed00209ab6e1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.548236 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b385dd4b-7cdc-4f29-bbdc-9e8a93a52d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a91b3fafb77d419c9d68ed00209ab6e1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.550575 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4c74b-350a-4357-b31b-87f2a299e26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:26.551548 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4c74b-350a-4357-b31b-87f2a299e26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:26.551930 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4c74b-350a-4357-b31b-87f2a299e26d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:26.552281 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4c74b-350a-4357-b31b-87f2a299e26d admin admin] PATH_INFO: `/v3/projects/b5e3866cee67472faa9ceea5a06ac2bb` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:26.553594 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4c74b-350a-4357-b31b-87f2a299e26d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5e3866cee67472faa9ceea5a06ac2bb)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:26.555601 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4c74b-350a-4357-b31b-87f2a299e26d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:26.555823 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b385dd4b-7cdc-4f29-bbdc-9e8a93a52d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a91b3fafb77d419c9d68ed00209ab6e1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.567280 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b385dd4b-7cdc-4f29-bbdc-9e8a93a52d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a91b3fafb77d419c9d68ed00209ab6e1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.574273 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1011/2021] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:26 2021] DELETE /identity/v3/users/a91b3fafb77d419c9d68ed00209ab6e1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:26.575390 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385dd4b-7cdc-4f29-bbdc-9e8a93a52d8a admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:26.576934 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b385dd4b-7cdc-4f29-bbdc-9e8a93a52d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:26.612541 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-efb4c74b-350a-4357-b31b-87f2a299e26d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5e3866cee67472faa9ceea5a06ac2bb', 'request_id': 'req-efb4c74b-350a-4357-b31b-87f2a299e26d'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.621939 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-efb4c74b-350a-4357-b31b-87f2a299e26d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5e3866cee67472faa9ceea5a06ac2bb', 'request_id': 'req-efb4c74b-350a-4357-b31b-87f2a299e26d'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.630227 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-efb4c74b-350a-4357-b31b-87f2a299e26d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5e3866cee67472faa9ceea5a06ac2bb', 'request_id': 'req-efb4c74b-350a-4357-b31b-87f2a299e26d'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.636486 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385dd4b-7cdc-4f29-bbdc-9e8a93a52d8a admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:26.657656 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-efb4c74b-350a-4357-b31b-87f2a299e26d admin admin] The token cache is being invalidate because project b5e3866cee67472faa9ceea5a06ac2bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:26.657805 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-efb4c74b-350a-4357-b31b-87f2a299e26d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.658661 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-efb4c74b-350a-4357-b31b-87f2a299e26d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.661080 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1011/2022] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:26 2021] DELETE /identity/v3/projects/b5e3866cee67472faa9ceea5a06ac2bb => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:26.662267 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f10910-cfb3-4603-8d17-bb4ecc9d295b None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:26.662642 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f10910-cfb3-4603-8d17-bb4ecc9d295b None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:26.663340 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f10910-cfb3-4603-8d17-bb4ecc9d295b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:26.682469 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-01f10910-cfb3-4603-8d17-bb4ecc9d295b None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:26.683711 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-01f10910-cfb3-4603-8d17-bb4ecc9d295b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:26.696538 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800b246-b80c-4273-836e-3c26f9d507cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:26.697205 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800b246-b80c-4273-836e-3c26f9d507cb service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:26.697645 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800b246-b80c-4273-836e-3c26f9d507cb service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:26.698055 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800b246-b80c-4273-836e-3c26f9d507cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:26.700279 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-5800b246-b80c-4273-836e-3c26f9d507cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:26.749415 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1012/2023] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:26.751053 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce862eb6-ce46-47a2-b441-0757a83ea1c1 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:26.751053 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce862eb6-ce46-47a2-b441-0757a83ea1c1 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:26.751349 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce862eb6-ce46-47a2-b441-0757a83ea1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:26.782317 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-ce862eb6-ce46-47a2-b441-0757a83ea1c1 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:26.784292 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-ce862eb6-ce46-47a2-b441-0757a83ea1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:26.788717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800b246-b80c-4273-836e-3c26f9d507cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:26.790658 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800b246-b80c-4273-836e-3c26f9d507cb service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:26.804390 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1012/2024] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:26 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:26.815784 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800b246-b80c-4273-836e-3c26f9d507cb service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:26.816005 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1013/2025] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:26.817157 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce862eb6-ce46-47a2-b441-0757a83ea1c1 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:26.818851 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-ce862eb6-ce46-47a2-b441-0757a83ea1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:26.821064 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-5800b246-b80c-4273-836e-3c26f9d507cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:26.833918 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce862eb6-ce46-47a2-b441-0757a83ea1c1 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:26.843329 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a5024-9469-4042-af3f-b7440050f3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:26.844557 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a5024-9469-4042-af3f-b7440050f3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:26.845264 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a5024-9469-4042-af3f-b7440050f3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:26.845682 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a5024-9469-4042-af3f-b7440050f3e4 admin admin] PATH_INFO: `/v3/projects/16721a225050435d8a9ab09124d761f2` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:26.847286 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a5024-9469-4042-af3f-b7440050f3e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16721a225050435d8a9ab09124d761f2)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:26.850845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a5024-9469-4042-af3f-b7440050f3e4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:26.911985 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800b246-b80c-4273-836e-3c26f9d507cb service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:26.925037 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8a6a5024-9469-4042-af3f-b7440050f3e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16721a225050435d8a9ab09124d761f2', 'request_id': 'req-8a6a5024-9469-4042-af3f-b7440050f3e4'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.936686 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8a6a5024-9469-4042-af3f-b7440050f3e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16721a225050435d8a9ab09124d761f2', 'request_id': 'req-8a6a5024-9469-4042-af3f-b7440050f3e4'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.946335 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8a6a5024-9469-4042-af3f-b7440050f3e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16721a225050435d8a9ab09124d761f2', 'request_id': 'req-8a6a5024-9469-4042-af3f-b7440050f3e4'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.964462 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8a6a5024-9469-4042-af3f-b7440050f3e4 admin admin] The token cache is being invalidate because project 16721a225050435d8a9ab09124d761f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:26.964811 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8a6a5024-9469-4042-af3f-b7440050f3e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.965468 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8a6a5024-9469-4042-af3f-b7440050f3e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:26.967238 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1014/2026] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:26 2021] DELETE /identity/v3/projects/16721a225050435d8a9ab09124d761f2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:26.968367 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74643941-543e-445d-85f8-6ab0b028b69b None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:26.968645 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74643941-543e-445d-85f8-6ab0b028b69b None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:26.968918 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74643941-543e-445d-85f8-6ab0b028b69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:26.970574 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d469f-cc47-4046-bc2f-0a69fd3d8f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:26.971582 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d469f-cc47-4046-bc2f-0a69fd3d8f03 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:26.971811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d469f-cc47-4046-bc2f-0a69fd3d8f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:26.972090 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d469f-cc47-4046-bc2f-0a69fd3d8f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:26.974044 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-749d469f-cc47-4046-bc2f-0a69fd3d8f03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:26.990592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-74643941-543e-445d-85f8-6ab0b028b69b None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:26.992026 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-74643941-543e-445d-85f8-6ab0b028b69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:27.049592 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d469f-cc47-4046-bc2f-0a69fd3d8f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:27.051128 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d469f-cc47-4046-bc2f-0a69fd3d8f03 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:27.062611 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1013/2027] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:27.063985 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04fdf-3f17-43b2-86f7-6fe3ab4de48e None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:27.064275 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04fdf-3f17-43b2-86f7-6fe3ab4de48e None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:27.064697 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b04fdf-3f17-43b2-86f7-6fe3ab4de48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:27.080725 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1015/2028] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:27.085462 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74643941-543e-445d-85f8-6ab0b028b69b None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:27.113303 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74643941-543e-445d-85f8-6ab0b028b69b None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:27.119753 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-53b04fdf-3f17-43b2-86f7-6fe3ab4de48e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:27.119753 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-53b04fdf-3f17-43b2-86f7-6fe3ab4de48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:27.126222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781fc51-03ff-459b-9585-2d102516faf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:27.127393 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781fc51-03ff-459b-9585-2d102516faf2 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:27.127913 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781fc51-03ff-459b-9585-2d102516faf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:27.128431 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781fc51-03ff-459b-9585-2d102516faf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:27.129990 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781fc51-03ff-459b-9585-2d102516faf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:05:27.130503 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781fc51-03ff-459b-9585-2d102516faf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:27.133434 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781fc51-03ff-459b-9585-2d102516faf2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:27.136903 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1014/2029] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:27.140575 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d82d41-e3ee-46ed-84e2-2ffd7a29116a None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:27.141023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d82d41-e3ee-46ed-84e2-2ffd7a29116a None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:27.141709 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d82d41-e3ee-46ed-84e2-2ffd7a29116a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:27.158019 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1016/2030] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:05:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:05:27.162654 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781fc51-03ff-459b-9585-2d102516faf2 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:27.185606 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781fc51-03ff-459b-9585-2d102516faf2 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:27.191771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-c5d82d41-e3ee-46ed-84e2-2ffd7a29116a None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:27.193115 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c5d82d41-e3ee-46ed-84e2-2ffd7a29116a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:27.195422 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76126720-36dc-4a31-94e0-9266276c5f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:27.197326 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76126720-36dc-4a31-94e0-9266276c5f3d admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:27.198366 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76126720-36dc-4a31-94e0-9266276c5f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:27.199473 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76126720-36dc-4a31-94e0-9266276c5f3d admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:27.202420 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76126720-36dc-4a31-94e0-9266276c5f3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:27.207574 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76126720-36dc-4a31-94e0-9266276c5f3d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:27.216539 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1015/2031] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:27.217525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d82d41-e3ee-46ed-84e2-2ffd7a29116a None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:27.227616 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d82d41-e3ee-46ed-84e2-2ffd7a29116a None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:27.237884 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd553ef3-5fea-4eee-8a1e-483658a424b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:27.239183 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd553ef3-5fea-4eee-8a1e-483658a424b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:27.239631 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd553ef3-5fea-4eee-8a1e-483658a424b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:27.239915 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd553ef3-5fea-4eee-8a1e-483658a424b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:27.240644 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd553ef3-5fea-4eee-8a1e-483658a424b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:05:27.240947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd553ef3-5fea-4eee-8a1e-483658a424b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:27.242737 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd553ef3-5fea-4eee-8a1e-483658a424b3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:27.260458 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1016/2032] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:05:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:05:27.265716 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd553ef3-5fea-4eee-8a1e-483658a424b3 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:27.272196 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1017/2033] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:27 2021] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:27.276455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76126720-36dc-4a31-94e0-9266276c5f3d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:27.277930 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd553ef3-5fea-4eee-8a1e-483658a424b3 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:27.363310 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fa122-de7b-4388-9372-8a1f5e96676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:27.364461 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fa122-de7b-4388-9372-8a1f5e96676c admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:27.364461 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fa122-de7b-4388-9372-8a1f5e96676c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:27.365026 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fa122-de7b-4388-9372-8a1f5e96676c admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:27.365764 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fa122-de7b-4388-9372-8a1f5e96676c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:27.367936 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fa122-de7b-4388-9372-8a1f5e96676c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:27.391498 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76126720-36dc-4a31-94e0-9266276c5f3d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:27.397389 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1e3d7-ea84-4700-ab4b-9d18c603667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:27.398070 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1e3d7-ea84-4700-ab4b-9d18c603667b admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:27.398354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1e3d7-ea84-4700-ab4b-9d18c603667b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:27.398673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1e3d7-ea84-4700-ab4b-9d18c603667b admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:27.399598 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1e3d7-ea84-4700-ab4b-9d18c603667b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:27.402608 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1e3d7-ea84-4700-ab4b-9d18c603667b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:27.406652 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1017/2034] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:27 2021] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:27.411277 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fa122-de7b-4388-9372-8a1f5e96676c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:27.432448 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1018/2035] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:27 2021] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:27.434383 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1e3d7-ea84-4700-ab4b-9d18c603667b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:27.446615 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1e3d7-ea84-4700-ab4b-9d18c603667b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:27.496729 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fa122-de7b-4388-9372-8a1f5e96676c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:27.502896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2fced-72f1-410a-8171-4c7fe1eff8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:27.504227 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2fced-72f1-410a-8171-4c7fe1eff8fc admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:27.504730 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2fced-72f1-410a-8171-4c7fe1eff8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:27.505161 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2fced-72f1-410a-8171-4c7fe1eff8fc admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:27.506075 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2fced-72f1-410a-8171-4c7fe1eff8fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:27.508924 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2fced-72f1-410a-8171-4c7fe1eff8fc admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:27.514488 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65941e3-139e-42c7-b0f6-b6eba64253b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:27.515183 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65941e3-139e-42c7-b0f6-b6eba64253b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:27.515561 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65941e3-139e-42c7-b0f6-b6eba64253b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:27.515849 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65941e3-139e-42c7-b0f6-b6eba64253b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:27.516632 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65941e3-139e-42c7-b0f6-b6eba64253b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:27.518296 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65941e3-139e-42c7-b0f6-b6eba64253b8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:27.537361 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1018/2036] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:27 2021] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:27.541921 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2fced-72f1-410a-8171-4c7fe1eff8fc admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:27.547020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1019/2037] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:27 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:27.552982 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2fced-72f1-410a-8171-4c7fe1eff8fc admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:27.556786 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65941e3-139e-42c7-b0f6-b6eba64253b8 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:27.560424 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6729b4-8a1d-446b-a149-abc67a9ee03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:27.561279 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6729b4-8a1d-446b-a149-abc67a9ee03e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:27.561566 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6729b4-8a1d-446b-a149-abc67a9ee03e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:27.561840 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6729b4-8a1d-446b-a149-abc67a9ee03e admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:27.562581 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6729b4-8a1d-446b-a149-abc67a9ee03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:27.564442 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6729b4-8a1d-446b-a149-abc67a9ee03e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:27.582096 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1019/2038] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:27 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:27.582951 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6729b4-8a1d-446b-a149-abc67a9ee03e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:27.589678 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65941e3-139e-42c7-b0f6-b6eba64253b8 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:27.606405 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6729b4-8a1d-446b-a149-abc67a9ee03e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:27.608361 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9200c3-a06e-4035-8893-6a8e87bca043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:27.609078 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9200c3-a06e-4035-8893-6a8e87bca043 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:27.612476 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9200c3-a06e-4035-8893-6a8e87bca043 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:27.613427 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9200c3-a06e-4035-8893-6a8e87bca043 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:27.615553 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9200c3-a06e-4035-8893-6a8e87bca043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:27.620333 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9200c3-a06e-4035-8893-6a8e87bca043 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:27.622432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca6b86-2806-489e-8c69-ab51ac2ce594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:27.623357 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca6b86-2806-489e-8c69-ab51ac2ce594 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:27.624514 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca6b86-2806-489e-8c69-ab51ac2ce594 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:27.624920 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca6b86-2806-489e-8c69-ab51ac2ce594 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:27.626951 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca6b86-2806-489e-8c69-ab51ac2ce594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:27.635509 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca6b86-2806-489e-8c69-ab51ac2ce594 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:27.643460 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1020/2039] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:27 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:27.644872 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9200c3-a06e-4035-8893-6a8e87bca043 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:27.647312 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-dd9200c3-a06e-4035-8893-6a8e87bca043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:27.655188 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1020/2040] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:27 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:27.656813 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca6b86-2806-489e-8c69-ab51ac2ce594 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:27.669414 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9200c3-a06e-4035-8893-6a8e87bca043 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:27.671124 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca6b86-2806-489e-8c69-ab51ac2ce594 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:27.676488 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018d8be-9398-4599-a745-7970042cdc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:27.677152 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab957735-aef6-405d-bf99-351476d7c30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:27.677386 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018d8be-9398-4599-a745-7970042cdc03 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:27.677674 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018d8be-9398-4599-a745-7970042cdc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:27.677953 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018d8be-9398-4599-a745-7970042cdc03 admin admin] PATH_INFO: `/v3/projects/051c8205afc64ce9b31be400c9d09245/users/51eafb3dc83541ca9c5c248fb30bb814/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:27.679060 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab957735-aef6-405d-bf99-351476d7c30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:27.679602 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab957735-aef6-405d-bf99-351476d7c30d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:27.679880 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab957735-aef6-405d-bf99-351476d7c30d admin admin] PATH_INFO: `/v3/projects/3539db56d7df413e992b9309772b4478` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:27.681170 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab957735-aef6-405d-bf99-351476d7c30d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3539db56d7df413e992b9309772b4478)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:27.684098 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab957735-aef6-405d-bf99-351476d7c30d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:27.702001 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018d8be-9398-4599-a745-7970042cdc03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=051c8205afc64ce9b31be400c9d09245, user_id=51eafb3dc83541ca9c5c248fb30bb814, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:27.704818 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018d8be-9398-4599-a745-7970042cdc03 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:27.728200 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1021/2041] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:27 2021] PUT /identity/v3/projects/051c8205afc64ce9b31be400c9d09245/users/51eafb3dc83541ca9c5c248fb30bb814/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:27.729988 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018d8be-9398-4599-a745-7970042cdc03 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:27.775291 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-ab957735-aef6-405d-bf99-351476d7c30d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3539db56d7df413e992b9309772b4478', 'request_id': 'req-ab957735-aef6-405d-bf99-351476d7c30d'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:27.793179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-ab957735-aef6-405d-bf99-351476d7c30d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3539db56d7df413e992b9309772b4478', 'request_id': 'req-ab957735-aef6-405d-bf99-351476d7c30d'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:27.802736 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-ab957735-aef6-405d-bf99-351476d7c30d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3539db56d7df413e992b9309772b4478', 'request_id': 'req-ab957735-aef6-405d-bf99-351476d7c30d'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:27.821276 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-ab957735-aef6-405d-bf99-351476d7c30d admin admin] The token cache is being invalidate because project 3539db56d7df413e992b9309772b4478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:27.821781 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-ab957735-aef6-405d-bf99-351476d7c30d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:27.822671 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-ab957735-aef6-405d-bf99-351476d7c30d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:27.824688 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1021/2042] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:27 2021] DELETE /identity/v3/projects/3539db56d7df413e992b9309772b4478 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:27.825990 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9c1f6-6999-4907-a47a-a8696ea79677 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:27.826418 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9c1f6-6999-4907-a47a-a8696ea79677 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:27.826894 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9c1f6-6999-4907-a47a-a8696ea79677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:27.836101 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018d8be-9398-4599-a745-7970042cdc03 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:27.863617 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-8bb9c1f6-6999-4907-a47a-a8696ea79677 None None] MFA Rules not processed for user `51eafb3dc83541ca9c5c248fb30bb814`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:27.865097 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-8bb9c1f6-6999-4907-a47a-a8696ea79677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:27.919737 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbc050-e56c-42c4-b14b-32f885e80088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:27.921320 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbc050-e56c-42c4-b14b-32f885e80088 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:27.921715 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbc050-e56c-42c4-b14b-32f885e80088 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:27.922100 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbc050-e56c-42c4-b14b-32f885e80088 admin admin] PATH_INFO: `/v3/projects/18aee3b3e92c40cca3c50988ec0782fa/users/650768425315402a993e11dee939deeb/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:27.940542 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbc050-e56c-42c4-b14b-32f885e80088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18aee3b3e92c40cca3c50988ec0782fa, user_id=650768425315402a993e11dee939deeb, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:27.943098 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbc050-e56c-42c4-b14b-32f885e80088 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:27.961559 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1022/2043] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:27 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:27.961779 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1022/2044] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:27 2021] PUT /identity/v3/projects/18aee3b3e92c40cca3c50988ec0782fa/users/650768425315402a993e11dee939deeb/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:27.961877 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240db79f-25f8-460b-81e6-d2c2535f5583 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:27.961877 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240db79f-25f8-460b-81e6-d2c2535f5583 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:27.961877 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240db79f-25f8-460b-81e6-d2c2535f5583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:27.975437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbc050-e56c-42c4-b14b-32f885e80088 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:27.977448 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-80fbc050-e56c-42c4-b14b-32f885e80088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:27.980972 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-240db79f-25f8-460b-81e6-d2c2535f5583 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:27.982282 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-240db79f-25f8-460b-81e6-d2c2535f5583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:28.045763 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbc050-e56c-42c4-b14b-32f885e80088 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:28.049607 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b88ec-fd41-4134-9cf6-4881ae20f108 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:28.050227 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b88ec-fd41-4134-9cf6-4881ae20f108 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:28.050509 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b88ec-fd41-4134-9cf6-4881ae20f108 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:28.050901 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b88ec-fd41-4134-9cf6-4881ae20f108 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:28.072062 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1023/2045] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:28.072062 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a1301-cb94-4205-867b-707f3fbcf646 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:28.072062 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a1301-cb94-4205-867b-707f3fbcf646 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:28.072062 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a1301-cb94-4205-867b-707f3fbcf646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:28.099637 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-4f9a1301-cb94-4205-867b-707f3fbcf646 None None] MFA Rules not processed for user `650768425315402a993e11dee939deeb`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:28.100845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-4f9a1301-cb94-4205-867b-707f3fbcf646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:28.112681 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b88ec-fd41-4134-9cf6-4881ae20f108 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:28.114074 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b88ec-fd41-4134-9cf6-4881ae20f108 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:28.123818 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1023/2046] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:27 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:28.125367 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d6b76-cfa0-4fc3-a6e4-2d6cac380903 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:28.125661 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d6b76-cfa0-4fc3-a6e4-2d6cac380903 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:28.125937 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d6b76-cfa0-4fc3-a6e4-2d6cac380903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:28.144826 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-dc7d6b76-cfa0-4fc3-a6e4-2d6cac380903 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:28.145815 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-dc7d6b76-cfa0-4fc3-a6e4-2d6cac380903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:28.157742 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1024/2047] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:28.158754 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d6b76-cfa0-4fc3-a6e4-2d6cac380903 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:28.168561 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d6b76-cfa0-4fc3-a6e4-2d6cac380903 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:28.169810 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1024/2048] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:28 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:28.180070 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a1301-cb94-4205-867b-707f3fbcf646 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:28.181824 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-4f9a1301-cb94-4205-867b-707f3fbcf646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:28.182054 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135d0f5-81d9-48a9-b7df-7c116120ef2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:28.182825 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135d0f5-81d9-48a9-b7df-7c116120ef2d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:28.183179 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135d0f5-81d9-48a9-b7df-7c116120ef2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:28.183557 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135d0f5-81d9-48a9-b7df-7c116120ef2d admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:28.184355 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135d0f5-81d9-48a9-b7df-7c116120ef2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:05:28.184733 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135d0f5-81d9-48a9-b7df-7c116120ef2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:28.186397 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135d0f5-81d9-48a9-b7df-7c116120ef2d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:28.196120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a1301-cb94-4205-867b-707f3fbcf646 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:28.200244 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1025/2049] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:05:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:05:28.204002 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f94d1-e99d-4438-aa4b-36ffd84fd846 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:28.204315 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135d0f5-81d9-48a9-b7df-7c116120ef2d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:28.204665 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f94d1-e99d-4438-aa4b-36ffd84fd846 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:28.204955 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f94d1-e99d-4438-aa4b-36ffd84fd846 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:28.205237 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f94d1-e99d-4438-aa4b-36ffd84fd846 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:28.215876 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f94d1-e99d-4438-aa4b-36ffd84fd846 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:28.216036 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135d0f5-81d9-48a9-b7df-7c116120ef2d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:28.217328 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f94d1-e99d-4438-aa4b-36ffd84fd846 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:28.221361 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9ab57-b1a4-4626-8fbb-f409bc83e49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:28.222159 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9ab57-b1a4-4626-8fbb-f409bc83e49f admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:28.222541 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9ab57-b1a4-4626-8fbb-f409bc83e49f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:28.222916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9ab57-b1a4-4626-8fbb-f409bc83e49f admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:28.223772 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9ab57-b1a4-4626-8fbb-f409bc83e49f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:28.225774 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9ab57-b1a4-4626-8fbb-f409bc83e49f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:28.227620 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1025/2050] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:28 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:05:28.258854 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f94d1-e99d-4438-aa4b-36ffd84fd846 service cinder] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:28.261246 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-730f94d1-e99d-4438-aa4b-36ffd84fd846 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:28.270521 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1026/2051] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:28 2021] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:28.271628 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9ab57-b1a4-4626-8fbb-f409bc83e49f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:28.279187 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f94d1-e99d-4438-aa4b-36ffd84fd846 service cinder] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:28.384650 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9ab57-b1a4-4626-8fbb-f409bc83e49f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:28.391843 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cf8b2-1e74-4088-a92d-fd23f347e403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:28.392716 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cf8b2-1e74-4088-a92d-fd23f347e403 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:28.393073 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cf8b2-1e74-4088-a92d-fd23f347e403 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:28.393488 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cf8b2-1e74-4088-a92d-fd23f347e403 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:28.394398 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cf8b2-1e74-4088-a92d-fd23f347e403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:28.405542 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cf8b2-1e74-4088-a92d-fd23f347e403 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:28.405673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48e77e-e8be-4ef5-932c-54c65c8accd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:28.405673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48e77e-e8be-4ef5-932c-54c65c8accd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:28.405885 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48e77e-e8be-4ef5-932c-54c65c8accd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:28.406366 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48e77e-e8be-4ef5-932c-54c65c8accd8 admin admin] PATH_INFO: `/v3/users/650768425315402a993e11dee939deeb` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:28.407894 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48e77e-e8be-4ef5-932c-54c65c8accd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=650768425315402a993e11dee939deeb)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:28.409896 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48e77e-e8be-4ef5-932c-54c65c8accd8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:28.428113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1027/2052] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:28 2021] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:28.430005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cf8b2-1e74-4088-a92d-fd23f347e403 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:28.446442 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cf8b2-1e74-4088-a92d-fd23f347e403 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:28.462783 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90763c-e526-441c-9f35-3033c3481a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:28.463960 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90763c-e526-441c-9f35-3033c3481a75 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:28.465609 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90763c-e526-441c-9f35-3033c3481a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:28.466171 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90763c-e526-441c-9f35-3033c3481a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:28.467246 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90763c-e526-441c-9f35-3033c3481a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:28.470633 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90763c-e526-441c-9f35-3033c3481a75 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:28.496979 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1028/2053] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:28 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:28.503007 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90763c-e526-441c-9f35-3033c3481a75 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:28.520766 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-bc48e77e-e8be-4ef5-932c-54c65c8accd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '650768425315402a993e11dee939deeb'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:28.521834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-bc48e77e-e8be-4ef5-932c-54c65c8accd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '650768425315402a993e11dee939deeb'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:28.522768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-bc48e77e-e8be-4ef5-932c-54c65c8accd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '650768425315402a993e11dee939deeb'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:28.526777 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90763c-e526-441c-9f35-3033c3481a75 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:28.540638 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecaced-3dc3-4e52-94cd-bb811ea50b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:28.541939 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecaced-3dc3-4e52-94cd-bb811ea50b54 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:28.544431 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecaced-3dc3-4e52-94cd-bb811ea50b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:28.544431 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecaced-3dc3-4e52-94cd-bb811ea50b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:28.545263 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ecaced-3dc3-4e52-94cd-bb811ea50b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:28.552301 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-bc48e77e-e8be-4ef5-932c-54c65c8accd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '650768425315402a993e11dee939deeb'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:28.552772 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ecaced-3dc3-4e52-94cd-bb811ea50b54 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:28.571752 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-bc48e77e-e8be-4ef5-932c-54c65c8accd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '650768425315402a993e11dee939deeb'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:28.576360 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1029/2054] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:28 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:28.585883 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecaced-3dc3-4e52-94cd-bb811ea50b54 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:28.588366 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-42ecaced-3dc3-4e52-94cd-bb811ea50b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:28.595121 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1026/2055] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:28 2021] DELETE /identity/v3/users/650768425315402a993e11dee939deeb => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:28.600669 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380ff8-9ecc-4cbd-889e-87c0b3e2ae4e None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:28.600962 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380ff8-9ecc-4cbd-889e-87c0b3e2ae4e None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:28.601298 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380ff8-9ecc-4cbd-889e-87c0b3e2ae4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:28.621849 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecaced-3dc3-4e52-94cd-bb811ea50b54 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:28.646828 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-8c380ff8-9ecc-4cbd-889e-87c0b3e2ae4e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:28.648041 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-8c380ff8-9ecc-4cbd-889e-87c0b3e2ae4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:28.733757 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362f1ff-660f-403b-af4e-937ce0364ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:28.737255 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362f1ff-660f-403b-af4e-937ce0364ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:28.738084 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362f1ff-660f-403b-af4e-937ce0364ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:28.738348 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362f1ff-660f-403b-af4e-937ce0364ae6 admin admin] PATH_INFO: `/v3/projects/8fb76f6ee6ca4f8da2aae61b593dc598/users/513f6d86c0244560b23757e7581712f1/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:28.740638 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1027/2056] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:28.751847 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380ff8-9ecc-4cbd-889e-87c0b3e2ae4e None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:28.753587 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-8c380ff8-9ecc-4cbd-889e-87c0b3e2ae4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:28.759553 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362f1ff-660f-403b-af4e-937ce0364ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb76f6ee6ca4f8da2aae61b593dc598, user_id=513f6d86c0244560b23757e7581712f1, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:28.763556 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362f1ff-660f-403b-af4e-937ce0364ae6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:28.781195 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1030/2057] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:28 2021] PUT /identity/v3/projects/8fb76f6ee6ca4f8da2aae61b593dc598/users/513f6d86c0244560b23757e7581712f1/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:28.806399 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128085fc-a511-429b-a8da-3e0fd68cdfa3 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:28.806614 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128085fc-a511-429b-a8da-3e0fd68cdfa3 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:28.807588 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128085fc-a511-429b-a8da-3e0fd68cdfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:28.852680 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380ff8-9ecc-4cbd-889e-87c0b3e2ae4e None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:28.872783 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-128085fc-a511-429b-a8da-3e0fd68cdfa3 None None] MFA Rules not processed for user `513f6d86c0244560b23757e7581712f1`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:28.874275 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-128085fc-a511-429b-a8da-3e0fd68cdfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:28.940825 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93932617-36ed-439c-867b-751d6b74a474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:28.941485 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93932617-36ed-439c-867b-751d6b74a474 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:28.941938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93932617-36ed-439c-867b-751d6b74a474 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:28.942226 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93932617-36ed-439c-867b-751d6b74a474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:28.973518 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1031/2058] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:28 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:28.980099 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128085fc-a511-429b-a8da-3e0fd68cdfa3 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:29.047620 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93932617-36ed-439c-867b-751d6b74a474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:29.049082 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93932617-36ed-439c-867b-751d6b74a474 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:29.069477 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1028/2059] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:29.072245 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128085fc-a511-429b-a8da-3e0fd68cdfa3 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:29.101894 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdc712-399a-4675-a826-b3512abcb90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:29.103032 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdc712-399a-4675-a826-b3512abcb90c admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:29.104801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdc712-399a-4675-a826-b3512abcb90c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:29.104801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdc712-399a-4675-a826-b3512abcb90c admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:29.109738 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdc712-399a-4675-a826-b3512abcb90c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:29.109738 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdc712-399a-4675-a826-b3512abcb90c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:29.156959 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1032/2060] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:28 2021] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:29.158280 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93932617-36ed-439c-867b-751d6b74a474 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:29.173723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93932617-36ed-439c-867b-751d6b74a474 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:29.249754 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2175d27-0180-42c7-851b-36abf5049911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:29.250633 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2175d27-0180-42c7-851b-36abf5049911 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:29.251699 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2175d27-0180-42c7-851b-36abf5049911 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:29.252068 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2175d27-0180-42c7-851b-36abf5049911 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:29.253119 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2175d27-0180-42c7-851b-36abf5049911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:29.256398 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2175d27-0180-42c7-851b-36abf5049911 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:29.284709 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1029/2061] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:29 2021] POST /identity/v3/users => generated 294 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:29.285948 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdc712-399a-4675-a826-b3512abcb90c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:29.298189 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdc712-399a-4675-a826-b3512abcb90c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:29.304700 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172235e-1953-453a-8c0d-5d6a1c063d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:29.305467 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172235e-1953-453a-8c0d-5d6a1c063d02 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:29.305852 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172235e-1953-453a-8c0d-5d6a1c063d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:29.306136 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172235e-1953-453a-8c0d-5d6a1c063d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:29.306948 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172235e-1953-453a-8c0d-5d6a1c063d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:29.308625 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172235e-1953-453a-8c0d-5d6a1c063d02 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:29.320744 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1033/2062] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:29 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:29.325222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2175d27-0180-42c7-851b-36abf5049911 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:29.338518 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2175d27-0180-42c7-851b-36abf5049911 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:29.344233 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b8ae9-e626-4e44-aecf-2e9573b2f239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:29.345188 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b8ae9-e626-4e44-aecf-2e9573b2f239 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:29.345535 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b8ae9-e626-4e44-aecf-2e9573b2f239 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:29.345874 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b8ae9-e626-4e44-aecf-2e9573b2f239 admin admin] PATH_INFO: `/v3/projects/d43541de37244dc8b5aa8f83dc0e43b7/users/c8cc13bad97b486ebe2162b0a2a093a0/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:29.364392 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b8ae9-e626-4e44-aecf-2e9573b2f239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43541de37244dc8b5aa8f83dc0e43b7, user_id=c8cc13bad97b486ebe2162b0a2a093a0, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:29.367027 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b8ae9-e626-4e44-aecf-2e9573b2f239 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:29.381363 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1030/2063] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:29 2021] PUT /identity/v3/projects/d43541de37244dc8b5aa8f83dc0e43b7/users/c8cc13bad97b486ebe2162b0a2a093a0/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:29.385657 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172235e-1953-453a-8c0d-5d6a1c063d02 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:29.396033 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172235e-1953-453a-8c0d-5d6a1c063d02 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:29.470837 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b8ae9-e626-4e44-aecf-2e9573b2f239 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:29.474981 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-e75b8ae9-e626-4e44-aecf-2e9573b2f239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:29.490133 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea184bca-b35a-4521-a7dd-7f5c9f071c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:29.491151 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea184bca-b35a-4521-a7dd-7f5c9f071c5b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:29.491616 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea184bca-b35a-4521-a7dd-7f5c9f071c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:29.492060 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea184bca-b35a-4521-a7dd-7f5c9f071c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:29.493051 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea184bca-b35a-4521-a7dd-7f5c9f071c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:29.495120 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea184bca-b35a-4521-a7dd-7f5c9f071c5b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:29.511128 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1034/2064] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:29 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:29.512545 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea184bca-b35a-4521-a7dd-7f5c9f071c5b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:29.522826 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea184bca-b35a-4521-a7dd-7f5c9f071c5b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:29.528573 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0bf5d-f944-44b1-b9ee-5368f1a47bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:29.529526 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0bf5d-f944-44b1-b9ee-5368f1a47bab admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:29.529808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0bf5d-f944-44b1-b9ee-5368f1a47bab admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:29.530086 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0bf5d-f944-44b1-b9ee-5368f1a47bab admin admin] PATH_INFO: `/v3/projects/d43541de37244dc8b5aa8f83dc0e43b7/users/c8cc13bad97b486ebe2162b0a2a093a0/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:29.532173 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0bf5d-f944-44b1-b9ee-5368f1a47bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43541de37244dc8b5aa8f83dc0e43b7, user_id=c8cc13bad97b486ebe2162b0a2a093a0, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:29.534810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0bf5d-f944-44b1-b9ee-5368f1a47bab admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:29.545704 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1035/2065] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:29 2021] PUT /identity/v3/projects/d43541de37244dc8b5aa8f83dc0e43b7/users/c8cc13bad97b486ebe2162b0a2a093a0/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:29.547222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b8ae9-e626-4e44-aecf-2e9573b2f239 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:29.555791 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345093e-e355-4262-b874-7ad1312b348e None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:29.556080 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345093e-e355-4262-b874-7ad1312b348e None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:29.556360 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345093e-e355-4262-b874-7ad1312b348e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:29.582096 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-8345093e-e355-4262-b874-7ad1312b348e None None] MFA Rules not processed for user `c8cc13bad97b486ebe2162b0a2a093a0`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:29.583302 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-8345093e-e355-4262-b874-7ad1312b348e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:29.603114 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8f026-a8d3-4d9b-a4e8-717b6031112e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:29.604151 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8f026-a8d3-4d9b-a4e8-717b6031112e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:29.604439 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8f026-a8d3-4d9b-a4e8-717b6031112e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:29.604721 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8f026-a8d3-4d9b-a4e8-717b6031112e admin admin] PATH_INFO: `/v3/projects/18aee3b3e92c40cca3c50988ec0782fa` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:29.605934 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8f026-a8d3-4d9b-a4e8-717b6031112e admin admin] RBAC: Authorizing `identity:delete_project(project_id=18aee3b3e92c40cca3c50988ec0782fa)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:29.607901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8f026-a8d3-4d9b-a4e8-717b6031112e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:29.659585 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1036/2066] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:29 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:29.660401 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-48f8f026-a8d3-4d9b-a4e8-717b6031112e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18aee3b3e92c40cca3c50988ec0782fa', 'request_id': 'req-48f8f026-a8d3-4d9b-a4e8-717b6031112e'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:29.673153 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345093e-e355-4262-b874-7ad1312b348e None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:29.674704 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-8345093e-e355-4262-b874-7ad1312b348e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:29.680557 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-48f8f026-a8d3-4d9b-a4e8-717b6031112e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18aee3b3e92c40cca3c50988ec0782fa', 'request_id': 'req-48f8f026-a8d3-4d9b-a4e8-717b6031112e'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:29.687552 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-48f8f026-a8d3-4d9b-a4e8-717b6031112e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18aee3b3e92c40cca3c50988ec0782fa', 'request_id': 'req-48f8f026-a8d3-4d9b-a4e8-717b6031112e'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:29.703855 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-48f8f026-a8d3-4d9b-a4e8-717b6031112e admin admin] The token cache is being invalidate because project 18aee3b3e92c40cca3c50988ec0782fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:29.704562 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-48f8f026-a8d3-4d9b-a4e8-717b6031112e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:29.705394 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-48f8f026-a8d3-4d9b-a4e8-717b6031112e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:29.707407 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1031/2067] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:29 2021] DELETE /identity/v3/projects/18aee3b3e92c40cca3c50988ec0782fa => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:29.712984 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346295d8-ed77-4bca-b91c-881fb73e7876 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:29.714003 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346295d8-ed77-4bca-b91c-881fb73e7876 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:29.714689 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346295d8-ed77-4bca-b91c-881fb73e7876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:29.736607 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-346295d8-ed77-4bca-b91c-881fb73e7876 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:29.738183 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-346295d8-ed77-4bca-b91c-881fb73e7876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:29.739349 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345093e-e355-4262-b874-7ad1312b348e None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:29.798239 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52855d19-d659-4047-885e-37e565f131f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:29.799062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52855d19-d659-4047-885e-37e565f131f9 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:29.799430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52855d19-d659-4047-885e-37e565f131f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:29.799769 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52855d19-d659-4047-885e-37e565f131f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:29.802317 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-52855d19-d659-4047-885e-37e565f131f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:29.805159 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1032/2068] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:29.812724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084a478-641f-487b-bea6-16111dd0580e None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:29.813099 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084a478-641f-487b-bea6-16111dd0580e None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:29.813451 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084a478-641f-487b-bea6-16111dd0580e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:29.840098 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-9084a478-641f-487b-bea6-16111dd0580e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:29.841665 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-9084a478-641f-487b-bea6-16111dd0580e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:29.855621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1033/2069] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:29.859930 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084a478-641f-487b-bea6-16111dd0580e None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:29.868684 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084a478-641f-487b-bea6-16111dd0580e None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:29.873893 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101faa5-babe-431a-a8c5-81d16238ec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:29.874610 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101faa5-babe-431a-a8c5-81d16238ec84 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:29.874754 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52855d19-d659-4047-885e-37e565f131f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:29.874884 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101faa5-babe-431a-a8c5-81d16238ec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:29.875149 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101faa5-babe-431a-a8c5-81d16238ec84 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:29.875899 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101faa5-babe-431a-a8c5-81d16238ec84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:05:29.876139 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52855d19-d659-4047-885e-37e565f131f9 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:29.876278 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101faa5-babe-431a-a8c5-81d16238ec84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:29.877755 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101faa5-babe-431a-a8c5-81d16238ec84 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:29.886074 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1037/2070] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:29 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:05:29.893529 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1034/2071] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:05:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:05:29.897848 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52855d19-d659-4047-885e-37e565f131f9 service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:29.909210 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52855d19-d659-4047-885e-37e565f131f9 service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:29.913924 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbb916-1125-4221-bee6-a3a2c4d033f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:29.914575 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbb916-1125-4221-bee6-a3a2c4d033f9 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:29.914857 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbb916-1125-4221-bee6-a3a2c4d033f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:29.915137 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbb916-1125-4221-bee6-a3a2c4d033f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:29.915883 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbb916-1125-4221-bee6-a3a2c4d033f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:29.918235 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbb916-1125-4221-bee6-a3a2c4d033f9 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:29.955180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1038/2072] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:29 2021] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:29.959212 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101faa5-babe-431a-a8c5-81d16238ec84 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:29.970162 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101faa5-babe-431a-a8c5-81d16238ec84 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:30.030847 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145cef4-83e2-41ed-948f-1ebccb54b452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:30.030847 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145cef4-83e2-41ed-948f-1ebccb54b452 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:30.030847 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145cef4-83e2-41ed-948f-1ebccb54b452 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:30.030847 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145cef4-83e2-41ed-948f-1ebccb54b452 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:30.034763 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145cef4-83e2-41ed-948f-1ebccb54b452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:30.034763 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145cef4-83e2-41ed-948f-1ebccb54b452 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:30.057940 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1035/2073] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:29 2021] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:30.063777 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbb916-1125-4221-bee6-a3a2c4d033f9 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:30.078323 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbb916-1125-4221-bee6-a3a2c4d033f9 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:30.083322 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf4550-5871-455a-ba78-6224a26d963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:30.084022 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf4550-5871-455a-ba78-6224a26d963c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:30.084306 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf4550-5871-455a-ba78-6224a26d963c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:30.084581 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf4550-5871-455a-ba78-6224a26d963c admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:30.085368 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf4550-5871-455a-ba78-6224a26d963c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:30.100275 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf4550-5871-455a-ba78-6224a26d963c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:30.118203 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1039/2074] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:30 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:05:30.126065 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145cef4-83e2-41ed-948f-1ebccb54b452 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:30.141126 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145cef4-83e2-41ed-948f-1ebccb54b452 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:30.151452 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d56f1b-2732-4a49-8b87-4444c1637b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:30.152032 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d56f1b-2732-4a49-8b87-4444c1637b28 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:30.152317 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d56f1b-2732-4a49-8b87-4444c1637b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:30.152601 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d56f1b-2732-4a49-8b87-4444c1637b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:30.154706 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d56f1b-2732-4a49-8b87-4444c1637b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:30.162509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d56f1b-2732-4a49-8b87-4444c1637b28 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:30.175850 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf4550-5871-455a-ba78-6224a26d963c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:30.177999 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-6ccf4550-5871-455a-ba78-6224a26d963c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:30.179463 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1036/2075] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:30 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:30.184378 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d56f1b-2732-4a49-8b87-4444c1637b28 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:30.196929 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d56f1b-2732-4a49-8b87-4444c1637b28 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:30.205935 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be57b9-b2a0-408b-83d3-46e05e0f3e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:30.207540 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be57b9-b2a0-408b-83d3-46e05e0f3e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:30.208678 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be57b9-b2a0-408b-83d3-46e05e0f3e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:30.209374 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be57b9-b2a0-408b-83d3-46e05e0f3e87 admin admin] PATH_INFO: `/v3/projects/8e39e80825e64d5e9390f9fae29c38cc/users/0205de7c01fb4cedb6f011e067f3f6e1/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:30.212727 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf4550-5871-455a-ba78-6224a26d963c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:30.235297 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3a5d5-ac21-4505-bc7b-7b803cb050e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:30.236286 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3a5d5-ac21-4505-bc7b-7b803cb050e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:30.236397 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be57b9-b2a0-408b-83d3-46e05e0f3e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e39e80825e64d5e9390f9fae29c38cc, user_id=0205de7c01fb4cedb6f011e067f3f6e1, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:30.236590 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3a5d5-ac21-4505-bc7b-7b803cb050e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:30.236833 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3a5d5-ac21-4505-bc7b-7b803cb050e4 admin admin] PATH_INFO: `/v3/users/883364decdef4da181eecd839ada7ea1` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:30.239622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3a5d5-ac21-4505-bc7b-7b803cb050e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=883364decdef4da181eecd839ada7ea1)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:30.240849 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be57b9-b2a0-408b-83d3-46e05e0f3e87 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:30.241544 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3a5d5-ac21-4505-bc7b-7b803cb050e4 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:30.267776 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1037/2076] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:30 2021] PUT /identity/v3/projects/8e39e80825e64d5e9390f9fae29c38cc/users/0205de7c01fb4cedb6f011e067f3f6e1/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:30.272990 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9accb5-36f2-4f7a-8331-32d08350415e None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:30.273287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9accb5-36f2-4f7a-8331-32d08350415e None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:30.273668 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9accb5-36f2-4f7a-8331-32d08350415e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:30.307613 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-7b9accb5-36f2-4f7a-8331-32d08350415e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:30.308907 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-7b9accb5-36f2-4f7a-8331-32d08350415e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:30.341053 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b3d3a5d5-ac21-4505-bc7b-7b803cb050e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '883364decdef4da181eecd839ada7ea1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:30.360227 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b3d3a5d5-ac21-4505-bc7b-7b803cb050e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '883364decdef4da181eecd839ada7ea1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:30.361060 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b3d3a5d5-ac21-4505-bc7b-7b803cb050e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '883364decdef4da181eecd839ada7ea1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:30.368836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b3d3a5d5-ac21-4505-bc7b-7b803cb050e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '883364decdef4da181eecd839ada7ea1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:30.379506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b3d3a5d5-ac21-4505-bc7b-7b803cb050e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '883364decdef4da181eecd839ada7ea1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:30.389819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1038/2077] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:30.390530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1040/2078] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:30 2021] DELETE /identity/v3/users/883364decdef4da181eecd839ada7ea1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:30.397771 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cb4d7-01a9-44d8-afac-3a881b6a9153 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:30.398172 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cb4d7-01a9-44d8-afac-3a881b6a9153 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:30.398547 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cb4d7-01a9-44d8-afac-3a881b6a9153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:30.401991 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3a5d5-ac21-4505-bc7b-7b803cb050e4 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:30.403705 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b3d3a5d5-ac21-4505-bc7b-7b803cb050e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:30.419033 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-763cb4d7-01a9-44d8-afac-3a881b6a9153 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:30.420276 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-763cb4d7-01a9-44d8-afac-3a881b6a9153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:30.468641 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3a5d5-ac21-4505-bc7b-7b803cb050e4 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:30.474072 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a1fa2-96ce-4fdc-909a-cd8127df978d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:30.475152 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a1fa2-96ce-4fdc-909a-cd8127df978d service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:30.475647 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a1fa2-96ce-4fdc-909a-cd8127df978d service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:30.476266 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a1fa2-96ce-4fdc-909a-cd8127df978d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:30.481685 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1039/2079] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:30.491267 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a1fa2-96ce-4fdc-909a-cd8127df978d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:30.492681 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cb4d7-01a9-44d8-afac-3a881b6a9153 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:30.494569 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a1fa2-96ce-4fdc-909a-cd8127df978d service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:30.506958 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cb4d7-01a9-44d8-afac-3a881b6a9153 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:30.507592 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1041/2080] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:05:30.526710 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3945e8a-9a50-461c-a2fc-83d9f4e34be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:30.527915 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3945e8a-9a50-461c-a2fc-83d9f4e34be5 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:30.527915 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3945e8a-9a50-461c-a2fc-83d9f4e34be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:30.528329 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3945e8a-9a50-461c-a2fc-83d9f4e34be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:30.540528 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3945e8a-9a50-461c-a2fc-83d9f4e34be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:30.543166 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3945e8a-9a50-461c-a2fc-83d9f4e34be5 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:30.554158 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1040/2081] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:31.398824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a1fa2-96ce-4fdc-909a-cd8127df978d service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:31.400961 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a28a1fa2-96ce-4fdc-909a-cd8127df978d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:31.413722 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a1fa2-96ce-4fdc-909a-cd8127df978d service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:31.420367 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e64575-0220-4127-8be8-4c1bf892225a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:31.421438 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e64575-0220-4127-8be8-4c1bf892225a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:31.421718 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e64575-0220-4127-8be8-4c1bf892225a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:31.422167 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e64575-0220-4127-8be8-4c1bf892225a admin admin] PATH_INFO: `/v3/projects/7dad9eb2175f45ec9dcd86ad6065ad3f` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:31.423492 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e64575-0220-4127-8be8-4c1bf892225a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dad9eb2175f45ec9dcd86ad6065ad3f)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:31.427108 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e64575-0220-4127-8be8-4c1bf892225a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:31.482403 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d0e64575-0220-4127-8be8-4c1bf892225a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dad9eb2175f45ec9dcd86ad6065ad3f', 'request_id': 'req-d0e64575-0220-4127-8be8-4c1bf892225a'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:31.487978 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d0e64575-0220-4127-8be8-4c1bf892225a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dad9eb2175f45ec9dcd86ad6065ad3f', 'request_id': 'req-d0e64575-0220-4127-8be8-4c1bf892225a'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:31.496747 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d0e64575-0220-4127-8be8-4c1bf892225a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dad9eb2175f45ec9dcd86ad6065ad3f', 'request_id': 'req-d0e64575-0220-4127-8be8-4c1bf892225a'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:31.508403 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d0e64575-0220-4127-8be8-4c1bf892225a admin admin] The token cache is being invalidate because project 7dad9eb2175f45ec9dcd86ad6065ad3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:31.508690 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d0e64575-0220-4127-8be8-4c1bf892225a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:31.509320 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d0e64575-0220-4127-8be8-4c1bf892225a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:31.510829 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1042/2082] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:31 2021] DELETE /identity/v3/projects/7dad9eb2175f45ec9dcd86ad6065ad3f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:31.514885 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3945e8a-9a50-461c-a2fc-83d9f4e34be5 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:31.525001 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3945e8a-9a50-461c-a2fc-83d9f4e34be5 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:31.563965 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3add6-40e9-4fd6-9a3b-ca7ed8cd7393 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:31.564221 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3add6-40e9-4fd6-9a3b-ca7ed8cd7393 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:31.564504 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3add6-40e9-4fd6-9a3b-ca7ed8cd7393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:31.594990 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-5ca3add6-40e9-4fd6-9a3b-ca7ed8cd7393 None None] MFA Rules not processed for user `0205de7c01fb4cedb6f011e067f3f6e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:31.596251 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-5ca3add6-40e9-4fd6-9a3b-ca7ed8cd7393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:31.610928 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a2c9b-81d1-4af6-bc44-4d518facb24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:31.611935 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a2c9b-81d1-4af6-bc44-4d518facb24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:31.612218 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a2c9b-81d1-4af6-bc44-4d518facb24e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:31.612493 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a2c9b-81d1-4af6-bc44-4d518facb24e admin admin] PATH_INFO: `/v3/users/db8c104c88ef41d181c3269bc30d2a15` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:31.613683 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a2c9b-81d1-4af6-bc44-4d518facb24e admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8c104c88ef41d181c3269bc30d2a15)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:31.615634 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a2c9b-81d1-4af6-bc44-4d518facb24e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:31.672975 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c49a2c9b-81d1-4af6-bc44-4d518facb24e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8c104c88ef41d181c3269bc30d2a15'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:31.673671 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c49a2c9b-81d1-4af6-bc44-4d518facb24e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8c104c88ef41d181c3269bc30d2a15'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:31.674278 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c49a2c9b-81d1-4af6-bc44-4d518facb24e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8c104c88ef41d181c3269bc30d2a15'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:31.676230 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1043/2083] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:31 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:31.686784 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c49a2c9b-81d1-4af6-bc44-4d518facb24e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8c104c88ef41d181c3269bc30d2a15'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:31.692284 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3add6-40e9-4fd6-9a3b-ca7ed8cd7393 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:31.694247 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-5ca3add6-40e9-4fd6-9a3b-ca7ed8cd7393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:31.697096 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c49a2c9b-81d1-4af6-bc44-4d518facb24e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8c104c88ef41d181c3269bc30d2a15'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:31.715723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1041/2084] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:31 2021] DELETE /identity/v3/users/db8c104c88ef41d181c3269bc30d2a15 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:31.780313 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3add6-40e9-4fd6-9a3b-ca7ed8cd7393 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:31.843394 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98193093-ed0c-4b37-a593-e249fddf0ef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:31.844143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98193093-ed0c-4b37-a593-e249fddf0ef5 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:31.844493 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98193093-ed0c-4b37-a593-e249fddf0ef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:31.844842 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98193093-ed0c-4b37-a593-e249fddf0ef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:31.846707 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-98193093-ed0c-4b37-a593-e249fddf0ef5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:31.910663 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98193093-ed0c-4b37-a593-e249fddf0ef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:31.912151 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98193093-ed0c-4b37-a593-e249fddf0ef5 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:31.921417 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1044/2085] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:31 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:05:32.020882 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a2c9b-81d1-4af6-bc44-4d518facb24e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:32.022431 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c49a2c9b-81d1-4af6-bc44-4d518facb24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:32.099958 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a2c9b-81d1-4af6-bc44-4d518facb24e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:32.109108 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29952e73-8b39-46a7-89dd-08dfe7d15a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:32.109975 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29952e73-8b39-46a7-89dd-08dfe7d15a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:32.110317 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29952e73-8b39-46a7-89dd-08dfe7d15a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:32.110599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29952e73-8b39-46a7-89dd-08dfe7d15a3f admin admin] PATH_INFO: `/v3/projects/bdf11f7642ec4004b1b0c9832a895e60` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:32.111856 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29952e73-8b39-46a7-89dd-08dfe7d15a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf11f7642ec4004b1b0c9832a895e60)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:32.113799 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29952e73-8b39-46a7-89dd-08dfe7d15a3f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:32.164663 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-29952e73-8b39-46a7-89dd-08dfe7d15a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf11f7642ec4004b1b0c9832a895e60', 'request_id': 'req-29952e73-8b39-46a7-89dd-08dfe7d15a3f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:32.170932 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-29952e73-8b39-46a7-89dd-08dfe7d15a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf11f7642ec4004b1b0c9832a895e60', 'request_id': 'req-29952e73-8b39-46a7-89dd-08dfe7d15a3f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:32.176771 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-29952e73-8b39-46a7-89dd-08dfe7d15a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf11f7642ec4004b1b0c9832a895e60', 'request_id': 'req-29952e73-8b39-46a7-89dd-08dfe7d15a3f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:32.190232 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-29952e73-8b39-46a7-89dd-08dfe7d15a3f admin admin] The token cache is being invalidate because project bdf11f7642ec4004b1b0c9832a895e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:32.190636 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-29952e73-8b39-46a7-89dd-08dfe7d15a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:32.191335 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-29952e73-8b39-46a7-89dd-08dfe7d15a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:32.193045 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1042/2086] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:32 2021] DELETE /identity/v3/projects/bdf11f7642ec4004b1b0c9832a895e60 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:32.197437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98193093-ed0c-4b37-a593-e249fddf0ef5 service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:32.209150 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98193093-ed0c-4b37-a593-e249fddf0ef5 service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:32.265167 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4214878-d5e4-4db2-85dc-1dbb4644f63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:32.266130 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4214878-d5e4-4db2-85dc-1dbb4644f63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:32.266419 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4214878-d5e4-4db2-85dc-1dbb4644f63c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:32.266694 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4214878-d5e4-4db2-85dc-1dbb4644f63c admin admin] PATH_INFO: `/v3/users/08cd0de411b044319d9e6d50db658a2c` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:32.267901 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4214878-d5e4-4db2-85dc-1dbb4644f63c admin admin] RBAC: Authorizing `identity:delete_user(user_id=08cd0de411b044319d9e6d50db658a2c)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:32.269817 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4214878-d5e4-4db2-85dc-1dbb4644f63c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:32.313448 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d4214878-d5e4-4db2-85dc-1dbb4644f63c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08cd0de411b044319d9e6d50db658a2c'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:32.325151 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d4214878-d5e4-4db2-85dc-1dbb4644f63c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08cd0de411b044319d9e6d50db658a2c'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:32.325807 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d4214878-d5e4-4db2-85dc-1dbb4644f63c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08cd0de411b044319d9e6d50db658a2c'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:32.332337 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d4214878-d5e4-4db2-85dc-1dbb4644f63c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08cd0de411b044319d9e6d50db658a2c'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:32.339060 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d4214878-d5e4-4db2-85dc-1dbb4644f63c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08cd0de411b044319d9e6d50db658a2c'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:32.344899 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1045/2087] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:32 2021] DELETE /identity/v3/users/08cd0de411b044319d9e6d50db658a2c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:32.635061 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29952e73-8b39-46a7-89dd-08dfe7d15a3f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:32.636698 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-29952e73-8b39-46a7-89dd-08dfe7d15a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:32.649001 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29952e73-8b39-46a7-89dd-08dfe7d15a3f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:32.706333 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edde819-47f4-444b-81bd-dd0d72cf2a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:32.707176 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edde819-47f4-444b-81bd-dd0d72cf2a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:32.707490 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edde819-47f4-444b-81bd-dd0d72cf2a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:32.707760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edde819-47f4-444b-81bd-dd0d72cf2a48 admin admin] PATH_INFO: `/v3/projects/ca32a1d4e75b40cc97181a5e9dcb0b26` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:32.708901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edde819-47f4-444b-81bd-dd0d72cf2a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca32a1d4e75b40cc97181a5e9dcb0b26)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:32.710793 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edde819-47f4-444b-81bd-dd0d72cf2a48 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:32.754881 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9edde819-47f4-444b-81bd-dd0d72cf2a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca32a1d4e75b40cc97181a5e9dcb0b26', 'request_id': 'req-9edde819-47f4-444b-81bd-dd0d72cf2a48'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:32.760783 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9edde819-47f4-444b-81bd-dd0d72cf2a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca32a1d4e75b40cc97181a5e9dcb0b26', 'request_id': 'req-9edde819-47f4-444b-81bd-dd0d72cf2a48'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:32.766747 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9edde819-47f4-444b-81bd-dd0d72cf2a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca32a1d4e75b40cc97181a5e9dcb0b26', 'request_id': 'req-9edde819-47f4-444b-81bd-dd0d72cf2a48'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:32.779127 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9edde819-47f4-444b-81bd-dd0d72cf2a48 admin admin] The token cache is being invalidate because project ca32a1d4e75b40cc97181a5e9dcb0b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:32.779442 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9edde819-47f4-444b-81bd-dd0d72cf2a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:32.780064 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-9edde819-47f4-444b-81bd-dd0d72cf2a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:32.781568 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1043/2088] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:32 2021] DELETE /identity/v3/projects/ca32a1d4e75b40cc97181a5e9dcb0b26 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:32.788276 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73416d55-0822-40ab-ac7f-4faced54713e None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:32.788732 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73416d55-0822-40ab-ac7f-4faced54713e None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:32.788840 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73416d55-0822-40ab-ac7f-4faced54713e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:32.806541 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-73416d55-0822-40ab-ac7f-4faced54713e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:32.807782 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-73416d55-0822-40ab-ac7f-4faced54713e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:32.865386 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1046/2089] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:32.873802 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180be9c-c985-45c2-9cda-9e5052320c90 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:32.874146 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180be9c-c985-45c2-9cda-9e5052320c90 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:32.874366 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180be9c-c985-45c2-9cda-9e5052320c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:32.892498 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-b180be9c-c985-45c2-9cda-9e5052320c90 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:32.893704 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b180be9c-c985-45c2-9cda-9e5052320c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:32.902361 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1044/2090] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:32.906767 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73416d55-0822-40ab-ac7f-4faced54713e None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:32.916762 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73416d55-0822-40ab-ac7f-4faced54713e None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:32.922255 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da170a15-6b19-4475-8fed-4865f7732cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:32.922918 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da170a15-6b19-4475-8fed-4865f7732cca admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:32.923202 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da170a15-6b19-4475-8fed-4865f7732cca admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:32.923505 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da170a15-6b19-4475-8fed-4865f7732cca admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:32.924228 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da170a15-6b19-4475-8fed-4865f7732cca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:05:32.924535 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da170a15-6b19-4475-8fed-4865f7732cca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:32.926218 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da170a15-6b19-4475-8fed-4865f7732cca admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:32.938343 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1047/2091] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:05:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:05:32.944784 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180be9c-c985-45c2-9cda-9e5052320c90 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:32.957939 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180be9c-c985-45c2-9cda-9e5052320c90 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:32.962985 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37424668-27d1-42cb-8417-7ab8c2a86fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:32.963693 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424668-27d1-42cb-8417-7ab8c2a86fbe admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:32.963976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424668-27d1-42cb-8417-7ab8c2a86fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:32.964247 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424668-27d1-42cb-8417-7ab8c2a86fbe admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:32.965878 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37424668-27d1-42cb-8417-7ab8c2a86fbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:32.969992 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37424668-27d1-42cb-8417-7ab8c2a86fbe admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:33.003694 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1045/2092] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:32 2021] POST /identity/v3/projects => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:33.008031 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da170a15-6b19-4475-8fed-4865f7732cca admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:33.017999 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da170a15-6b19-4475-8fed-4865f7732cca admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:33.074733 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f2279-5940-403e-a5ed-1a3c7da9d2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:33.075432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f2279-5940-403e-a5ed-1a3c7da9d2bc admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:33.075715 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f2279-5940-403e-a5ed-1a3c7da9d2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:33.075991 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f2279-5940-403e-a5ed-1a3c7da9d2bc admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:33.076672 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f2279-5940-403e-a5ed-1a3c7da9d2bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:33.078576 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f2279-5940-403e-a5ed-1a3c7da9d2bc admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:33.098303 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1048/2093] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:33 2021] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:33.102642 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37424668-27d1-42cb-8417-7ab8c2a86fbe admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:33.117181 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37424668-27d1-42cb-8417-7ab8c2a86fbe admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:33.122064 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d24fe9-cd5d-44a4-91b0-f2ad64ff3c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:33.122731 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d24fe9-cd5d-44a4-91b0-f2ad64ff3c99 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:33.123013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d24fe9-cd5d-44a4-91b0-f2ad64ff3c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:33.123308 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d24fe9-cd5d-44a4-91b0-f2ad64ff3c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:33.124044 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d24fe9-cd5d-44a4-91b0-f2ad64ff3c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:33.125645 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d24fe9-cd5d-44a4-91b0-f2ad64ff3c99 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:33.136509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1046/2094] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:33 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:33.140460 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f2279-5940-403e-a5ed-1a3c7da9d2bc admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:33.150111 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f2279-5940-403e-a5ed-1a3c7da9d2bc admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:33.155377 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f83ef3-fd3b-43d2-bd5e-26b5e138501e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:33.156042 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f83ef3-fd3b-43d2-bd5e-26b5e138501e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:33.156325 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f83ef3-fd3b-43d2-bd5e-26b5e138501e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:33.156594 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f83ef3-fd3b-43d2-bd5e-26b5e138501e admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:33.157302 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f83ef3-fd3b-43d2-bd5e-26b5e138501e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:33.158866 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f83ef3-fd3b-43d2-bd5e-26b5e138501e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:33.169234 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1049/2095] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:33 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:33.174104 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d24fe9-cd5d-44a4-91b0-f2ad64ff3c99 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:33.183889 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d24fe9-cd5d-44a4-91b0-f2ad64ff3c99 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:33.188929 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b53c7c-61ac-45ba-b16e-81be8d0d3d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:33.189825 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b53c7c-61ac-45ba-b16e-81be8d0d3d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:33.190106 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b53c7c-61ac-45ba-b16e-81be8d0d3d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:33.190376 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b53c7c-61ac-45ba-b16e-81be8d0d3d8d admin admin] PATH_INFO: `/v3/projects/bcb72c901cbb432fb2a8a99677871cc3/users/3eb693d8d5c548c49a78ef4c9b1ec6b7/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:33.206824 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b53c7c-61ac-45ba-b16e-81be8d0d3d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb72c901cbb432fb2a8a99677871cc3, user_id=3eb693d8d5c548c49a78ef4c9b1ec6b7, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:33.209555 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b53c7c-61ac-45ba-b16e-81be8d0d3d8d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:33.222117 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1047/2096] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:33 2021] PUT /identity/v3/projects/bcb72c901cbb432fb2a8a99677871cc3/users/3eb693d8d5c548c49a78ef4c9b1ec6b7/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:33.233238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecb9e5-23d3-47ea-bc5e-46453e5070fe None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:33.233593 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecb9e5-23d3-47ea-bc5e-46453e5070fe None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:33.233965 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecb9e5-23d3-47ea-bc5e-46453e5070fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:33.259783 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-51ecb9e5-23d3-47ea-bc5e-46453e5070fe None None] MFA Rules not processed for user `3eb693d8d5c548c49a78ef4c9b1ec6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:33.260992 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-51ecb9e5-23d3-47ea-bc5e-46453e5070fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:33.323107 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1050/2097] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:33 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:33.328182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b53c7c-61ac-45ba-b16e-81be8d0d3d8d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:33.388546 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b53c7c-61ac-45ba-b16e-81be8d0d3d8d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:33.393088 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fdd81-b637-4874-8a00-0df02cd5e71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:33.393738 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fdd81-b637-4874-8a00-0df02cd5e71f admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:33.394019 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fdd81-b637-4874-8a00-0df02cd5e71f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:33.394294 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fdd81-b637-4874-8a00-0df02cd5e71f admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:33.394970 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fdd81-b637-4874-8a00-0df02cd5e71f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:33.396890 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fdd81-b637-4874-8a00-0df02cd5e71f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:33.423208 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1048/2098] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:33 2021] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:33.427160 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecb9e5-23d3-47ea-bc5e-46453e5070fe None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:33.438598 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecb9e5-23d3-47ea-bc5e-46453e5070fe None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:33.520232 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f240ef9-0a68-4bec-af08-ceffd313d575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:33.521609 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f240ef9-0a68-4bec-af08-ceffd313d575 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:33.521899 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f240ef9-0a68-4bec-af08-ceffd313d575 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:33.522253 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f240ef9-0a68-4bec-af08-ceffd313d575 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:33.522870 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f240ef9-0a68-4bec-af08-ceffd313d575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:33.524827 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f240ef9-0a68-4bec-af08-ceffd313d575 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:33.560041 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1051/2099] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:33 2021] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:33.560990 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fdd81-b637-4874-8a00-0df02cd5e71f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:33.572057 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fdd81-b637-4874-8a00-0df02cd5e71f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:33.579437 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50654d-92e7-4b11-9f8d-0f59c9420ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:33.583437 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50654d-92e7-4b11-9f8d-0f59c9420ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:33.584853 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50654d-92e7-4b11-9f8d-0f59c9420ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:33.585401 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50654d-92e7-4b11-9f8d-0f59c9420ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:33.587171 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50654d-92e7-4b11-9f8d-0f59c9420ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:33.593993 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50654d-92e7-4b11-9f8d-0f59c9420ae0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:33.611084 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1049/2100] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:33 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:05:33.615384 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f240ef9-0a68-4bec-af08-ceffd313d575 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:33.633972 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f240ef9-0a68-4bec-af08-ceffd313d575 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:33.649305 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5a44a-20a7-4376-bcf5-00b502dd9465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:33.650528 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5a44a-20a7-4376-bcf5-00b502dd9465 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:33.650957 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5a44a-20a7-4376-bcf5-00b502dd9465 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:33.651324 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5a44a-20a7-4376-bcf5-00b502dd9465 admin admin] PATH_INFO: `/v3/projects/7c7e21a14b4948dc9b59f38da9480fa6/users/38ac758b833349ecb519f4a71a6451e8/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:33.679966 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5a44a-20a7-4376-bcf5-00b502dd9465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7e21a14b4948dc9b59f38da9480fa6, user_id=38ac758b833349ecb519f4a71a6451e8, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:33.682854 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5a44a-20a7-4376-bcf5-00b502dd9465 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:33.698603 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1052/2101] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:33 2021] PUT /identity/v3/projects/7c7e21a14b4948dc9b59f38da9480fa6/users/38ac758b833349ecb519f4a71a6451e8/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:33.703420 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50654d-92e7-4b11-9f8d-0f59c9420ae0 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:33.713319 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50654d-92e7-4b11-9f8d-0f59c9420ae0 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:33.774635 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb61bb-c65a-498e-8060-a1811e41ea24 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:33.775045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb61bb-c65a-498e-8060-a1811e41ea24 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:33.775327 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb61bb-c65a-498e-8060-a1811e41ea24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:33.777335 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dfeac-2965-444b-bf58-e6c2b56c79d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:33.778049 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dfeac-2965-444b-bf58-e6c2b56c79d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:33.778365 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dfeac-2965-444b-bf58-e6c2b56c79d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:33.778640 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dfeac-2965-444b-bf58-e6c2b56c79d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:33.779384 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96dfeac-2965-444b-bf58-e6c2b56c79d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:33.781022 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96dfeac-2965-444b-bf58-e6c2b56c79d8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:33.791989 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1050/2102] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:33 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:05:33.793767 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-abcb61bb-c65a-498e-8060-a1811e41ea24 None None] MFA Rules not processed for user `361eb264d0a147e9879a758807cd3eed`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:33.794981 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-abcb61bb-c65a-498e-8060-a1811e41ea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:33.796517 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dfeac-2965-444b-bf58-e6c2b56c79d8 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:33.806345 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dfeac-2965-444b-bf58-e6c2b56c79d8 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:33.812151 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c0a28-371a-4b7a-a219-99ad541213fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:33.813048 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c0a28-371a-4b7a-a219-99ad541213fc admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:33.813329 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c0a28-371a-4b7a-a219-99ad541213fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:33.813604 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c0a28-371a-4b7a-a219-99ad541213fc admin admin] PATH_INFO: `/v3/projects/7c7e21a14b4948dc9b59f38da9480fa6/users/38ac758b833349ecb519f4a71a6451e8/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:33.815877 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c0a28-371a-4b7a-a219-99ad541213fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7e21a14b4948dc9b59f38da9480fa6, user_id=38ac758b833349ecb519f4a71a6451e8, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:33.818787 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c0a28-371a-4b7a-a219-99ad541213fc admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:33.830804 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1051/2103] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:33 2021] PUT /identity/v3/projects/7c7e21a14b4948dc9b59f38da9480fa6/users/38ac758b833349ecb519f4a71a6451e8/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:33.844165 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941438f-9eb3-40b5-abaf-f0cc3327d05a None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:33.844938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941438f-9eb3-40b5-abaf-f0cc3327d05a None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:33.844938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941438f-9eb3-40b5-abaf-f0cc3327d05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:33.852273 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1053/2104] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:33 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:33.873571 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-d941438f-9eb3-40b5-abaf-f0cc3327d05a None None] MFA Rules not processed for user `38ac758b833349ecb519f4a71a6451e8`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:33.874801 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d941438f-9eb3-40b5-abaf-f0cc3327d05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:33.944382 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1052/2105] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:33 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:33.955910 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb61bb-c65a-498e-8060-a1811e41ea24 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:33.957449 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-abcb61bb-c65a-498e-8060-a1811e41ea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:34.019993 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb61bb-c65a-498e-8060-a1811e41ea24 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:34.077040 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a7332-0568-4a09-b155-9b09fafd5897 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:34.077694 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a7332-0568-4a09-b155-9b09fafd5897 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:34.078057 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a7332-0568-4a09-b155-9b09fafd5897 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:34.078338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a7332-0568-4a09-b155-9b09fafd5897 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:34.097833 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a7332-0568-4a09-b155-9b09fafd5897 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:34.097833 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a7332-0568-4a09-b155-9b09fafd5897 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:34.114303 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1054/2106] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:33 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:34.214388 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941438f-9eb3-40b5-abaf-f0cc3327d05a None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:34.225332 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941438f-9eb3-40b5-abaf-f0cc3327d05a None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:34.229417 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62171197-8ef4-4b20-8dd4-a590b38908c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:34.230544 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62171197-8ef4-4b20-8dd4-a590b38908c9 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:34.230830 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62171197-8ef4-4b20-8dd4-a590b38908c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:34.231109 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62171197-8ef4-4b20-8dd4-a590b38908c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:34.299586 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62171197-8ef4-4b20-8dd4-a590b38908c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:34.301027 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62171197-8ef4-4b20-8dd4-a590b38908c9 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:34.313338 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1053/2107] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:34 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:34.338777 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905d401-7c21-4092-a4c1-d9785626f0b5 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:34.339070 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905d401-7c21-4092-a4c1-d9785626f0b5 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:34.339965 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905d401-7c21-4092-a4c1-d9785626f0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:34.357981 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-8905d401-7c21-4092-a4c1-d9785626f0b5 None None] MFA Rules not processed for user `0205de7c01fb4cedb6f011e067f3f6e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:34.359188 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-8905d401-7c21-4092-a4c1-d9785626f0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:34.416593 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1055/2108] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:34 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:34.709416 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62171197-8ef4-4b20-8dd4-a590b38908c9 service cinder] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:34.710851 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-62171197-8ef4-4b20-8dd4-a590b38908c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:34.806187 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62171197-8ef4-4b20-8dd4-a590b38908c9 service cinder] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:34.812933 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fd736-6b19-4dd5-a76e-9d2c15697191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:34.814559 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fd736-6b19-4dd5-a76e-9d2c15697191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:34.815220 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fd736-6b19-4dd5-a76e-9d2c15697191 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:34.815755 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fd736-6b19-4dd5-a76e-9d2c15697191 admin admin] PATH_INFO: `/v3/users/513f6d86c0244560b23757e7581712f1` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:34.817737 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fd736-6b19-4dd5-a76e-9d2c15697191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=513f6d86c0244560b23757e7581712f1)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:34.819756 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fd736-6b19-4dd5-a76e-9d2c15697191 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:34.880184 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f94fd736-6b19-4dd5-a76e-9d2c15697191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '513f6d86c0244560b23757e7581712f1'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:34.880928 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f94fd736-6b19-4dd5-a76e-9d2c15697191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '513f6d86c0244560b23757e7581712f1'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:34.881705 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f94fd736-6b19-4dd5-a76e-9d2c15697191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '513f6d86c0244560b23757e7581712f1'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:34.896985 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f94fd736-6b19-4dd5-a76e-9d2c15697191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '513f6d86c0244560b23757e7581712f1'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:34.905984 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f94fd736-6b19-4dd5-a76e-9d2c15697191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '513f6d86c0244560b23757e7581712f1'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:34.923673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1054/2109] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:34 2021] DELETE /identity/v3/users/513f6d86c0244560b23757e7581712f1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:34.928180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62c4b6-b803-4684-8a7b-8cad3ba4a304 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:34.928652 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62c4b6-b803-4684-8a7b-8cad3ba4a304 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:34.928745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62c4b6-b803-4684-8a7b-8cad3ba4a304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:34.947127 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-db62c4b6-b803-4684-8a7b-8cad3ba4a304 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:34.948369 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-db62c4b6-b803-4684-8a7b-8cad3ba4a304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:35.013598 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1056/2110] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:35.023648 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fd736-6b19-4dd5-a76e-9d2c15697191 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:35.028497 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f94fd736-6b19-4dd5-a76e-9d2c15697191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:35.142885 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fd736-6b19-4dd5-a76e-9d2c15697191 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:35.148211 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484c11e-74cf-4f32-9be6-be75a11417ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:35.151645 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484c11e-74cf-4f32-9be6-be75a11417ea service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:35.151645 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484c11e-74cf-4f32-9be6-be75a11417ea service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:35.151645 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484c11e-74cf-4f32-9be6-be75a11417ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:35.170141 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484c11e-74cf-4f32-9be6-be75a11417ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:35.171647 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484c11e-74cf-4f32-9be6-be75a11417ea service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:35.182518 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1055/2111] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:35.540630 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62c4b6-b803-4684-8a7b-8cad3ba4a304 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:35.542222 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-db62c4b6-b803-4684-8a7b-8cad3ba4a304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:35.557141 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62c4b6-b803-4684-8a7b-8cad3ba4a304 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:35.563445 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7153c-6ae6-4e37-a472-8ad06b6b3868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:35.564418 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7153c-6ae6-4e37-a472-8ad06b6b3868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:35.564909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7153c-6ae6-4e37-a472-8ad06b6b3868 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:35.565258 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7153c-6ae6-4e37-a472-8ad06b6b3868 admin admin] PATH_INFO: `/v3/projects/8fb76f6ee6ca4f8da2aae61b593dc598` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:35.566880 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7153c-6ae6-4e37-a472-8ad06b6b3868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fb76f6ee6ca4f8da2aae61b593dc598)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:35.568920 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7153c-6ae6-4e37-a472-8ad06b6b3868 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:35.628198 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-28b7153c-6ae6-4e37-a472-8ad06b6b3868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fb76f6ee6ca4f8da2aae61b593dc598', 'request_id': 'req-28b7153c-6ae6-4e37-a472-8ad06b6b3868'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:35.637853 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-28b7153c-6ae6-4e37-a472-8ad06b6b3868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fb76f6ee6ca4f8da2aae61b593dc598', 'request_id': 'req-28b7153c-6ae6-4e37-a472-8ad06b6b3868'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:35.646419 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-28b7153c-6ae6-4e37-a472-8ad06b6b3868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fb76f6ee6ca4f8da2aae61b593dc598', 'request_id': 'req-28b7153c-6ae6-4e37-a472-8ad06b6b3868'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:35.658001 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-28b7153c-6ae6-4e37-a472-8ad06b6b3868 admin admin] The token cache is being invalidate because project 8fb76f6ee6ca4f8da2aae61b593dc598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:35.658288 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-28b7153c-6ae6-4e37-a472-8ad06b6b3868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:35.659111 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-28b7153c-6ae6-4e37-a472-8ad06b6b3868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:35.660684 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1057/2112] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:35 2021] DELETE /identity/v3/projects/8fb76f6ee6ca4f8da2aae61b593dc598 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:35.664596 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484c11e-74cf-4f32-9be6-be75a11417ea service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:35.674973 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484c11e-74cf-4f32-9be6-be75a11417ea service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:35.730948 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98aaaf-95ed-43ad-98c1-7f43a4a041fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:35.731831 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98aaaf-95ed-43ad-98c1-7f43a4a041fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:35.732110 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98aaaf-95ed-43ad-98c1-7f43a4a041fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:35.732409 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98aaaf-95ed-43ad-98c1-7f43a4a041fc admin admin] PATH_INFO: `/v3/users/c8cc13bad97b486ebe2162b0a2a093a0` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:35.733621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98aaaf-95ed-43ad-98c1-7f43a4a041fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8cc13bad97b486ebe2162b0a2a093a0)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:35.737246 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98aaaf-95ed-43ad-98c1-7f43a4a041fc admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:35.785818 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-0a98aaaf-95ed-43ad-98c1-7f43a4a041fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8cc13bad97b486ebe2162b0a2a093a0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:35.786467 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-0a98aaaf-95ed-43ad-98c1-7f43a4a041fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8cc13bad97b486ebe2162b0a2a093a0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:35.787076 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-0a98aaaf-95ed-43ad-98c1-7f43a4a041fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8cc13bad97b486ebe2162b0a2a093a0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:35.799087 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-0a98aaaf-95ed-43ad-98c1-7f43a4a041fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8cc13bad97b486ebe2162b0a2a093a0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:35.805257 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-0a98aaaf-95ed-43ad-98c1-7f43a4a041fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8cc13bad97b486ebe2162b0a2a093a0'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:35.818240 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1056/2113] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:35 2021] DELETE /identity/v3/users/c8cc13bad97b486ebe2162b0a2a093a0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:36.087815 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7153c-6ae6-4e37-a472-8ad06b6b3868 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:36.089832 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-28b7153c-6ae6-4e37-a472-8ad06b6b3868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:36.102781 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7153c-6ae6-4e37-a472-8ad06b6b3868 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:36.166475 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2b071-df33-486e-9712-6c98089581d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:36.168158 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2b071-df33-486e-9712-6c98089581d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:36.168463 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2b071-df33-486e-9712-6c98089581d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:36.168539 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2b071-df33-486e-9712-6c98089581d1 admin admin] PATH_INFO: `/v3/projects/d43541de37244dc8b5aa8f83dc0e43b7` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:36.169738 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2b071-df33-486e-9712-6c98089581d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d43541de37244dc8b5aa8f83dc0e43b7)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:36.171756 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2b071-df33-486e-9712-6c98089581d1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:36.219777 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ace2b071-df33-486e-9712-6c98089581d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd43541de37244dc8b5aa8f83dc0e43b7', 'request_id': 'req-ace2b071-df33-486e-9712-6c98089581d1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:36.225029 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ace2b071-df33-486e-9712-6c98089581d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd43541de37244dc8b5aa8f83dc0e43b7', 'request_id': 'req-ace2b071-df33-486e-9712-6c98089581d1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:36.232731 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ace2b071-df33-486e-9712-6c98089581d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd43541de37244dc8b5aa8f83dc0e43b7', 'request_id': 'req-ace2b071-df33-486e-9712-6c98089581d1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:36.243987 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ace2b071-df33-486e-9712-6c98089581d1 admin admin] The token cache is being invalidate because project d43541de37244dc8b5aa8f83dc0e43b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:36.244280 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ace2b071-df33-486e-9712-6c98089581d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:36.244927 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ace2b071-df33-486e-9712-6c98089581d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:36.246843 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1058/2114] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:36 2021] DELETE /identity/v3/projects/d43541de37244dc8b5aa8f83dc0e43b7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:36.252428 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de51f8-3c1e-4c45-abad-910aaf9a3c38 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:36.252717 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de51f8-3c1e-4c45-abad-910aaf9a3c38 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:36.253040 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de51f8-3c1e-4c45-abad-910aaf9a3c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:36.272569 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-51de51f8-3c1e-4c45-abad-910aaf9a3c38 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:36.273791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-51de51f8-3c1e-4c45-abad-910aaf9a3c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:36.329897 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1057/2115] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:36.338724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf6356-6a58-43f6-a87b-874759148bc4 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:36.339006 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf6356-6a58-43f6-a87b-874759148bc4 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:36.340005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf6356-6a58-43f6-a87b-874759148bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:36.357501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-6fdf6356-6a58-43f6-a87b-874759148bc4 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:36.358667 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-6fdf6356-6a58-43f6-a87b-874759148bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:36.366332 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1059/2116] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:36.370482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de51f8-3c1e-4c45-abad-910aaf9a3c38 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:36.380362 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de51f8-3c1e-4c45-abad-910aaf9a3c38 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:36.384955 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73622733-ab17-4a61-873b-3ee47a4fc493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:36.385596 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73622733-ab17-4a61-873b-3ee47a4fc493 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:36.385876 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73622733-ab17-4a61-873b-3ee47a4fc493 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:36.386695 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73622733-ab17-4a61-873b-3ee47a4fc493 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:36.387768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73622733-ab17-4a61-873b-3ee47a4fc493 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:05:36.388076 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73622733-ab17-4a61-873b-3ee47a4fc493 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:36.389661 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73622733-ab17-4a61-873b-3ee47a4fc493 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:36.400609 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1058/2117] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:05:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:05:36.405272 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf6356-6a58-43f6-a87b-874759148bc4 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:36.414104 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf6356-6a58-43f6-a87b-874759148bc4 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:36.418863 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797dfe8-057d-47b3-a9a5-871e65a97434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:36.419539 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797dfe8-057d-47b3-a9a5-871e65a97434 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:36.419820 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797dfe8-057d-47b3-a9a5-871e65a97434 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:36.420092 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797dfe8-057d-47b3-a9a5-871e65a97434 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:36.420770 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797dfe8-057d-47b3-a9a5-871e65a97434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:36.422695 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797dfe8-057d-47b3-a9a5-871e65a97434 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:36.446312 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1060/2118] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:36 2021] POST /identity/v3/projects => generated 383 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:36.451168 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73622733-ab17-4a61-873b-3ee47a4fc493 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:36.460769 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73622733-ab17-4a61-873b-3ee47a4fc493 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:36.514654 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c00c8-e8d3-406a-84c0-6659f048e83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:36.515306 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c00c8-e8d3-406a-84c0-6659f048e83e admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:36.515612 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c00c8-e8d3-406a-84c0-6659f048e83e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:36.515890 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c00c8-e8d3-406a-84c0-6659f048e83e admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:36.516600 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c00c8-e8d3-406a-84c0-6659f048e83e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:36.518552 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c00c8-e8d3-406a-84c0-6659f048e83e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:36.541941 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1059/2119] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:36 2021] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:36.546451 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797dfe8-057d-47b3-a9a5-871e65a97434 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:36.556618 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797dfe8-057d-47b3-a9a5-871e65a97434 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:36.561527 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d12ca6-5954-4250-ae7e-5d6bfe239c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:36.562189 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d12ca6-5954-4250-ae7e-5d6bfe239c17 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:36.562475 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d12ca6-5954-4250-ae7e-5d6bfe239c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:36.562751 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d12ca6-5954-4250-ae7e-5d6bfe239c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:36.563538 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d12ca6-5954-4250-ae7e-5d6bfe239c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:36.565111 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d12ca6-5954-4250-ae7e-5d6bfe239c17 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:36.576304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1061/2120] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:36 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:05:36.580321 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c00c8-e8d3-406a-84c0-6659f048e83e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:36.590811 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c00c8-e8d3-406a-84c0-6659f048e83e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:36.595449 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc05c1-db89-4588-a124-e44d1a5f1c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:36.596108 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc05c1-db89-4588-a124-e44d1a5f1c95 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:36.596388 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc05c1-db89-4588-a124-e44d1a5f1c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:36.596663 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc05c1-db89-4588-a124-e44d1a5f1c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:36.597385 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc05c1-db89-4588-a124-e44d1a5f1c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:36.600240 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc05c1-db89-4588-a124-e44d1a5f1c95 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:36.612008 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1060/2121] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:36 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:36.616502 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d12ca6-5954-4250-ae7e-5d6bfe239c17 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:36.627896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d12ca6-5954-4250-ae7e-5d6bfe239c17 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:36.633583 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a2a71-0662-4329-afdc-8da67c6c9107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:36.634536 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a2a71-0662-4329-afdc-8da67c6c9107 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:36.634824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a2a71-0662-4329-afdc-8da67c6c9107 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:36.635102 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a2a71-0662-4329-afdc-8da67c6c9107 admin admin] PATH_INFO: `/v3/projects/c0def254b8d14b6ba5583c18f3ec14a9/users/0ec3a2741a0a42ac86cb5e8ca3e4c9a8/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:36.654643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a2a71-0662-4329-afdc-8da67c6c9107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0def254b8d14b6ba5583c18f3ec14a9, user_id=0ec3a2741a0a42ac86cb5e8ca3e4c9a8, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:36.658331 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a2a71-0662-4329-afdc-8da67c6c9107 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:36.676359 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1062/2122] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:36 2021] PUT /identity/v3/projects/c0def254b8d14b6ba5583c18f3ec14a9/users/0ec3a2741a0a42ac86cb5e8ca3e4c9a8/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:36.689322 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe1da7-8178-4312-9e4b-2dd3e3633187 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:36.689678 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe1da7-8178-4312-9e4b-2dd3e3633187 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:36.689876 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe1da7-8178-4312-9e4b-2dd3e3633187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:36.729045 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-26fe1da7-8178-4312-9e4b-2dd3e3633187 None None] MFA Rules not processed for user `0ec3a2741a0a42ac86cb5e8ca3e4c9a8`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:36.731590 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-26fe1da7-8178-4312-9e4b-2dd3e3633187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:36.827411 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1061/2123] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:36 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:36.836501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a2a71-0662-4329-afdc-8da67c6c9107 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:36.838198 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-e63a2a71-0662-4329-afdc-8da67c6c9107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:36.894835 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a2a71-0662-4329-afdc-8da67c6c9107 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:36.898646 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0724c-e5e9-461b-b1f5-885b5c1c925c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:36.899288 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0724c-e5e9-461b-b1f5-885b5c1c925c service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:36.899622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0724c-e5e9-461b-b1f5-885b5c1c925c service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:36.899901 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0724c-e5e9-461b-b1f5-885b5c1c925c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:36.908863 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0724c-e5e9-461b-b1f5-885b5c1c925c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:36.910292 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0724c-e5e9-461b-b1f5-885b5c1c925c service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:36.920373 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1063/2124] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:36 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:42.215402 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe1da7-8178-4312-9e4b-2dd3e3633187 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:42.217410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-26fe1da7-8178-4312-9e4b-2dd3e3633187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:42.311069 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe1da7-8178-4312-9e4b-2dd3e3633187 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:42.316525 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0094c6c-5efc-4612-aec6-fbf8ecf10adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:42.317407 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0094c6c-5efc-4612-aec6-fbf8ecf10adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:42.317697 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0094c6c-5efc-4612-aec6-fbf8ecf10adb admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:42.317974 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0094c6c-5efc-4612-aec6-fbf8ecf10adb admin admin] PATH_INFO: `/v3/users/3eb693d8d5c548c49a78ef4c9b1ec6b7` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:42.319356 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0094c6c-5efc-4612-aec6-fbf8ecf10adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb693d8d5c548c49a78ef4c9b1ec6b7)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:42.321327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0094c6c-5efc-4612-aec6-fbf8ecf10adb admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:42.372431 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f0094c6c-5efc-4612-aec6-fbf8ecf10adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb693d8d5c548c49a78ef4c9b1ec6b7'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:42.373135 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f0094c6c-5efc-4612-aec6-fbf8ecf10adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb693d8d5c548c49a78ef4c9b1ec6b7'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:42.373769 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f0094c6c-5efc-4612-aec6-fbf8ecf10adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb693d8d5c548c49a78ef4c9b1ec6b7'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:42.388509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f0094c6c-5efc-4612-aec6-fbf8ecf10adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb693d8d5c548c49a78ef4c9b1ec6b7'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:42.404808 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f0094c6c-5efc-4612-aec6-fbf8ecf10adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb693d8d5c548c49a78ef4c9b1ec6b7'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:42.427685 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1062/2125] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:42 2021] DELETE /identity/v3/users/3eb693d8d5c548c49a78ef4c9b1ec6b7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:42.436195 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc23fc-2612-44b8-b5c8-cb643e9d27e8 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:42.437000 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc23fc-2612-44b8-b5c8-cb643e9d27e8 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:42.438213 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc23fc-2612-44b8-b5c8-cb643e9d27e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:42.472612 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-98bc23fc-2612-44b8-b5c8-cb643e9d27e8 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:42.474931 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-98bc23fc-2612-44b8-b5c8-cb643e9d27e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:42.533091 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef3c6d-b985-4c80-a465-3b8f5da80bd2 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:42.533402 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef3c6d-b985-4c80-a465-3b8f5da80bd2 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:42.533690 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef3c6d-b985-4c80-a465-3b8f5da80bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:42.561741 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-a6ef3c6d-b985-4c80-a465-3b8f5da80bd2 None None] MFA Rules not processed for user `b1918e2aa8f24655875480ef52df324d`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:42.563191 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a6ef3c6d-b985-4c80-a465-3b8f5da80bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:42.583166 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1064/2126] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:42.616604 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc23fc-2612-44b8-b5c8-cb643e9d27e8 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:42.618472 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-98bc23fc-2612-44b8-b5c8-cb643e9d27e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:42.692421 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1063/2127] 10.222.0.39 () {58 vars in 1010 bytes} [Tue Aug 31 03:05:42 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:42.703841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef3c6d-b985-4c80-a465-3b8f5da80bd2 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:42.705501 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a6ef3c6d-b985-4c80-a465-3b8f5da80bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:42.752537 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef3c6d-b985-4c80-a465-3b8f5da80bd2 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:42.763244 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fd57a-5e0b-499d-9a5f-6bf5b67f24cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:42.766412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fd57a-5e0b-499d-9a5f-6bf5b67f24cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:42.766882 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fd57a-5e0b-499d-9a5f-6bf5b67f24cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:42.767165 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fd57a-5e0b-499d-9a5f-6bf5b67f24cb admin admin] PATH_INFO: `/v3/users/0ec3a2741a0a42ac86cb5e8ca3e4c9a8` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:42.771468 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fd57a-5e0b-499d-9a5f-6bf5b67f24cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec3a2741a0a42ac86cb5e8ca3e4c9a8)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:42.774808 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fd57a-5e0b-499d-9a5f-6bf5b67f24cb admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:42.786068 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc23fc-2612-44b8-b5c8-cb643e9d27e8 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:42.801352 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf363a-cca8-4d97-815e-3d6dcf2023a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:42.801454 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf363a-cca8-4d97-815e-3d6dcf2023a2 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:42.801838 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf363a-cca8-4d97-815e-3d6dcf2023a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:42.802047 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf363a-cca8-4d97-815e-3d6dcf2023a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:42.822857 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf363a-cca8-4d97-815e-3d6dcf2023a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:42.826608 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf363a-cca8-4d97-815e-3d6dcf2023a2 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:42.866454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8a9fd57a-5e0b-499d-9a5f-6bf5b67f24cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec3a2741a0a42ac86cb5e8ca3e4c9a8'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:42.867141 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8a9fd57a-5e0b-499d-9a5f-6bf5b67f24cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec3a2741a0a42ac86cb5e8ca3e4c9a8'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:42.867791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8a9fd57a-5e0b-499d-9a5f-6bf5b67f24cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec3a2741a0a42ac86cb5e8ca3e4c9a8'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:42.870053 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1065/2128] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:05:42.873376 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf363a-cca8-4d97-815e-3d6dcf2023a2 service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:42.876143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-8ebf363a-cca8-4d97-815e-3d6dcf2023a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:42.881555 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8a9fd57a-5e0b-499d-9a5f-6bf5b67f24cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec3a2741a0a42ac86cb5e8ca3e4c9a8'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:42.890901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8a9fd57a-5e0b-499d-9a5f-6bf5b67f24cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec3a2741a0a42ac86cb5e8ca3e4c9a8'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:42.906229 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1064/2129] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:42 2021] DELETE /identity/v3/users/0ec3a2741a0a42ac86cb5e8ca3e4c9a8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:42.911686 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b2816-4227-4db5-96ae-7101d5d968ad None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:42.912099 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b2816-4227-4db5-96ae-7101d5d968ad None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:42.912382 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b2816-4227-4db5-96ae-7101d5d968ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:42.937973 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-c49b2816-4227-4db5-96ae-7101d5d968ad None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:42.939568 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c49b2816-4227-4db5-96ae-7101d5d968ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:43.014016 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf363a-cca8-4d97-815e-3d6dcf2023a2 service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:43.036207 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1065/2130] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:43.052723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b2816-4227-4db5-96ae-7101d5d968ad None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:43.054595 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c49b2816-4227-4db5-96ae-7101d5d968ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:43.094147 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9e654-3b18-4db8-b685-95b429b12a23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ed84d2e3ce4c85b552732f3294aac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:43.094798 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9e654-3b18-4db8-b685-95b429b12a23 service swift] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:43.095213 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9e654-3b18-4db8-b685-95b429b12a23 service swift] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:43.096109 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9e654-3b18-4db8-b685-95b429b12a23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:43.100123 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ebb9e654-3b18-4db8-b685-95b429b12a23 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:43.171778 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b2816-4227-4db5-96ae-7101d5d968ad None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:43.184133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca62a5d-6d42-4632-a97b-68816fe8ac34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:43.184967 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca62a5d-6d42-4632-a97b-68816fe8ac34 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:43.185263 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca62a5d-6d42-4632-a97b-68816fe8ac34 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:43.187945 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca62a5d-6d42-4632-a97b-68816fe8ac34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:43.200491 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca62a5d-6d42-4632-a97b-68816fe8ac34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:43.203551 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca62a5d-6d42-4632-a97b-68816fe8ac34 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:43.203959 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9e654-3b18-4db8-b685-95b429b12a23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:43.205895 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9e654-3b18-4db8-b685-95b429b12a23 service swift] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:43.215802 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1066/2131] 10.222.0.39 () {60 vars in 1385 bytes} [Tue Aug 31 03:05:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 03:05:43.218502 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1066/2132] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:05:43.665362 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9e654-3b18-4db8-b685-95b429b12a23 service swift] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:43.668327 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ebb9e654-3b18-4db8-b685-95b429b12a23 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:43.707830 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9e654-3b18-4db8-b685-95b429b12a23 service swift] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:43.732518 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34cb47-e1fb-4cb4-ba6a-c73756185b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:43.733414 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34cb47-e1fb-4cb4-ba6a-c73756185b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:43.733869 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34cb47-e1fb-4cb4-ba6a-c73756185b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:43.734295 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34cb47-e1fb-4cb4-ba6a-c73756185b25 admin admin] PATH_INFO: `/v3/projects/bcb72c901cbb432fb2a8a99677871cc3` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:43.740186 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34cb47-e1fb-4cb4-ba6a-c73756185b25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb72c901cbb432fb2a8a99677871cc3)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:43.742348 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34cb47-e1fb-4cb4-ba6a-c73756185b25 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:43.825779 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2d34cb47-e1fb-4cb4-ba6a-c73756185b25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb72c901cbb432fb2a8a99677871cc3', 'request_id': 'req-2d34cb47-e1fb-4cb4-ba6a-c73756185b25'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:43.841014 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2d34cb47-e1fb-4cb4-ba6a-c73756185b25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb72c901cbb432fb2a8a99677871cc3', 'request_id': 'req-2d34cb47-e1fb-4cb4-ba6a-c73756185b25'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:43.853933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2d34cb47-e1fb-4cb4-ba6a-c73756185b25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb72c901cbb432fb2a8a99677871cc3', 'request_id': 'req-2d34cb47-e1fb-4cb4-ba6a-c73756185b25'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:43.889935 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2d34cb47-e1fb-4cb4-ba6a-c73756185b25 admin admin] The token cache is being invalidate because project bcb72c901cbb432fb2a8a99677871cc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:43.889935 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2d34cb47-e1fb-4cb4-ba6a-c73756185b25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:43.891540 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2d34cb47-e1fb-4cb4-ba6a-c73756185b25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:43.899686 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1067/2133] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:43 2021] DELETE /identity/v3/projects/bcb72c901cbb432fb2a8a99677871cc3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:43.900870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca62a5d-6d42-4632-a97b-68816fe8ac34 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:43.915216 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca62a5d-6d42-4632-a97b-68816fe8ac34 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:43.997715 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7d193-a0c9-4422-b8fd-7f2ca5f072d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:43.998597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7d193-a0c9-4422-b8fd-7f2ca5f072d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:43.998947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7d193-a0c9-4422-b8fd-7f2ca5f072d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:43.999228 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7d193-a0c9-4422-b8fd-7f2ca5f072d4 admin admin] PATH_INFO: `/v3/users/38ac758b833349ecb519f4a71a6451e8` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:44.000642 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7d193-a0c9-4422-b8fd-7f2ca5f072d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ac758b833349ecb519f4a71a6451e8)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:44.002774 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7d193-a0c9-4422-b8fd-7f2ca5f072d4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:44.076756 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-89c7d193-a0c9-4422-b8fd-7f2ca5f072d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ac758b833349ecb519f4a71a6451e8'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:44.077591 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-89c7d193-a0c9-4422-b8fd-7f2ca5f072d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ac758b833349ecb519f4a71a6451e8'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:44.078251 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-89c7d193-a0c9-4422-b8fd-7f2ca5f072d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ac758b833349ecb519f4a71a6451e8'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:44.166006 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-89c7d193-a0c9-4422-b8fd-7f2ca5f072d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ac758b833349ecb519f4a71a6451e8'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:44.179975 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-89c7d193-a0c9-4422-b8fd-7f2ca5f072d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ac758b833349ecb519f4a71a6451e8'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:44.242165 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1067/2134] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:43 2021] DELETE /identity/v3/users/38ac758b833349ecb519f4a71a6451e8 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:44.529587 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34cb47-e1fb-4cb4-ba6a-c73756185b25 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:44.531142 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-2d34cb47-e1fb-4cb4-ba6a-c73756185b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:44.567040 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34cb47-e1fb-4cb4-ba6a-c73756185b25 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:44.709167 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e101e1-4b80-48a6-8969-69ba81616100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:44.710058 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e101e1-4b80-48a6-8969-69ba81616100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:44.710339 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e101e1-4b80-48a6-8969-69ba81616100 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:44.710610 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e101e1-4b80-48a6-8969-69ba81616100 admin admin] PATH_INFO: `/v3/projects/c0def254b8d14b6ba5583c18f3ec14a9` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:44.712278 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e101e1-4b80-48a6-8969-69ba81616100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0def254b8d14b6ba5583c18f3ec14a9)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:44.714656 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e101e1-4b80-48a6-8969-69ba81616100 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:44.793976 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-77e101e1-4b80-48a6-8969-69ba81616100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0def254b8d14b6ba5583c18f3ec14a9', 'request_id': 'req-77e101e1-4b80-48a6-8969-69ba81616100'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:44.812548 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-77e101e1-4b80-48a6-8969-69ba81616100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0def254b8d14b6ba5583c18f3ec14a9', 'request_id': 'req-77e101e1-4b80-48a6-8969-69ba81616100'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:44.827156 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-77e101e1-4b80-48a6-8969-69ba81616100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0def254b8d14b6ba5583c18f3ec14a9', 'request_id': 'req-77e101e1-4b80-48a6-8969-69ba81616100'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:44.857611 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-77e101e1-4b80-48a6-8969-69ba81616100 admin admin] The token cache is being invalidate because project c0def254b8d14b6ba5583c18f3ec14a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:44.857844 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-77e101e1-4b80-48a6-8969-69ba81616100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:44.863147 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-77e101e1-4b80-48a6-8969-69ba81616100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:44.883398 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1068/2135] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:44 2021] DELETE /identity/v3/projects/c0def254b8d14b6ba5583c18f3ec14a9 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:45.294410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7d193-a0c9-4422-b8fd-7f2ca5f072d4 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:45.296902 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-89c7d193-a0c9-4422-b8fd-7f2ca5f072d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:45.313795 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7d193-a0c9-4422-b8fd-7f2ca5f072d4 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:45.407058 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a8efe-4a4d-4925-be2b-e41e49734fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:45.410174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a8efe-4a4d-4925-be2b-e41e49734fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:45.410737 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a8efe-4a4d-4925-be2b-e41e49734fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:45.412127 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a8efe-4a4d-4925-be2b-e41e49734fb2 admin admin] PATH_INFO: `/v3/projects/7c7e21a14b4948dc9b59f38da9480fa6` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:45.415099 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a8efe-4a4d-4925-be2b-e41e49734fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c7e21a14b4948dc9b59f38da9480fa6)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:45.417442 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a8efe-4a4d-4925-be2b-e41e49734fb2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:45.491683 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-770a8efe-4a4d-4925-be2b-e41e49734fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c7e21a14b4948dc9b59f38da9480fa6', 'request_id': 'req-770a8efe-4a4d-4925-be2b-e41e49734fb2'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:45.500920 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-770a8efe-4a4d-4925-be2b-e41e49734fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c7e21a14b4948dc9b59f38da9480fa6', 'request_id': 'req-770a8efe-4a4d-4925-be2b-e41e49734fb2'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:45.510815 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-770a8efe-4a4d-4925-be2b-e41e49734fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c7e21a14b4948dc9b59f38da9480fa6', 'request_id': 'req-770a8efe-4a4d-4925-be2b-e41e49734fb2'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:45.530351 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-770a8efe-4a4d-4925-be2b-e41e49734fb2 admin admin] The token cache is being invalidate because project 7c7e21a14b4948dc9b59f38da9480fa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:45.530853 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-770a8efe-4a4d-4925-be2b-e41e49734fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:45.531674 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-770a8efe-4a4d-4925-be2b-e41e49734fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:45.534244 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1068/2136] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:45 2021] DELETE /identity/v3/projects/7c7e21a14b4948dc9b59f38da9480fa6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:45.540155 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0833fe4-a54b-438f-b008-3eff84c93c57 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:45.540447 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0833fe4-a54b-438f-b008-3eff84c93c57 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:45.540726 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0833fe4-a54b-438f-b008-3eff84c93c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:45.584576 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-a0833fe4-a54b-438f-b008-3eff84c93c57 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:45.585868 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a0833fe4-a54b-438f-b008-3eff84c93c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:45.738713 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1069/2137] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:45.744167 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3d97e-869e-4046-9e61-3c784d8c1e38 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:45.744490 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3d97e-869e-4046-9e61-3c784d8c1e38 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:45.744779 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3d97e-869e-4046-9e61-3c784d8c1e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:45.777834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-83f3d97e-869e-4046-9e61-3c784d8c1e38 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:45.780035 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-83f3d97e-869e-4046-9e61-3c784d8c1e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:45.816740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1069/2138] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:45.822814 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0833fe4-a54b-438f-b008-3eff84c93c57 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:45.834903 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0833fe4-a54b-438f-b008-3eff84c93c57 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:45.840144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba196b2-0a96-4618-aa7d-0819446d6a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:45.840815 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba196b2-0a96-4618-aa7d-0819446d6a8e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:45.841035 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba196b2-0a96-4618-aa7d-0819446d6a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:45.841317 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba196b2-0a96-4618-aa7d-0819446d6a8e admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:45.842048 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba196b2-0a96-4618-aa7d-0819446d6a8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:05:45.842357 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba196b2-0a96-4618-aa7d-0819446d6a8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:45.844656 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba196b2-0a96-4618-aa7d-0819446d6a8e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:45.858498 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1070/2139] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:05:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:05:45.862762 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3d97e-869e-4046-9e61-3c784d8c1e38 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:45.874134 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3d97e-869e-4046-9e61-3c784d8c1e38 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:45.879943 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffbc8a-5e33-43fd-bd81-064d03272e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:45.880611 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffbc8a-5e33-43fd-bd81-064d03272e24 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:45.880899 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffbc8a-5e33-43fd-bd81-064d03272e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:45.881168 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffbc8a-5e33-43fd-bd81-064d03272e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:45.881846 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffbc8a-5e33-43fd-bd81-064d03272e24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:45.884215 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffbc8a-5e33-43fd-bd81-064d03272e24 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:45.912232 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1070/2140] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:45 2021] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:45.919565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba196b2-0a96-4618-aa7d-0819446d6a8e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:45.932777 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba196b2-0a96-4618-aa7d-0819446d6a8e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:46.003323 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc2f5f-9552-4697-982e-a9271352e60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:46.004310 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc2f5f-9552-4697-982e-a9271352e60c admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:46.004624 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc2f5f-9552-4697-982e-a9271352e60c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:46.004866 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc2f5f-9552-4697-982e-a9271352e60c admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:46.005620 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc2f5f-9552-4697-982e-a9271352e60c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:46.007581 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc2f5f-9552-4697-982e-a9271352e60c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:46.030484 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1071/2141] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:45 2021] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:46.034700 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffbc8a-5e33-43fd-bd81-064d03272e24 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:46.045689 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffbc8a-5e33-43fd-bd81-064d03272e24 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:46.055741 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fd11d-5699-4143-931b-08ea8b483208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:46.056424 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fd11d-5699-4143-931b-08ea8b483208 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:46.056711 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fd11d-5699-4143-931b-08ea8b483208 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:46.056990 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fd11d-5699-4143-931b-08ea8b483208 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:46.060384 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340fd11d-5699-4143-931b-08ea8b483208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:46.062022 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340fd11d-5699-4143-931b-08ea8b483208 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:46.074557 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1071/2142] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:46 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:46.079327 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc2f5f-9552-4697-982e-a9271352e60c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:46.093155 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc2f5f-9552-4697-982e-a9271352e60c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:46.102968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b0698-be96-4cdd-b5e9-af910e561c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:46.104035 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b0698-be96-4cdd-b5e9-af910e561c63 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:46.105008 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b0698-be96-4cdd-b5e9-af910e561c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:46.115421 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b0698-be96-4cdd-b5e9-af910e561c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:46.116641 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b0698-be96-4cdd-b5e9-af910e561c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:46.118458 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b0698-be96-4cdd-b5e9-af910e561c63 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:46.139256 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1072/2143] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:46 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:46.140736 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fd11d-5699-4143-931b-08ea8b483208 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:46.151158 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fd11d-5699-4143-931b-08ea8b483208 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:46.158542 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c27bd-67da-4bf2-b358-4b2a01cd1287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:46.158830 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c27bd-67da-4bf2-b358-4b2a01cd1287 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:46.159151 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c27bd-67da-4bf2-b358-4b2a01cd1287 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:46.159494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c27bd-67da-4bf2-b358-4b2a01cd1287 admin admin] PATH_INFO: `/v3/projects/15d9c6ea97514037bc84881cc9b63cbf/users/dce34364f9824ce48a461fdd8e3f8ae4/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:46.178159 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c27bd-67da-4bf2-b358-4b2a01cd1287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d9c6ea97514037bc84881cc9b63cbf, user_id=dce34364f9824ce48a461fdd8e3f8ae4, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:46.181126 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c27bd-67da-4bf2-b358-4b2a01cd1287 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:46.196889 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1072/2144] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:46 2021] PUT /identity/v3/projects/15d9c6ea97514037bc84881cc9b63cbf/users/dce34364f9824ce48a461fdd8e3f8ae4/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:46.209168 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760a7cc-97f7-4978-9c29-889d02611d03 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:46.209525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760a7cc-97f7-4978-9c29-889d02611d03 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:46.209819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760a7cc-97f7-4978-9c29-889d02611d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:46.240703 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-d760a7cc-97f7-4978-9c29-889d02611d03 None None] MFA Rules not processed for user `dce34364f9824ce48a461fdd8e3f8ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:46.241981 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-d760a7cc-97f7-4978-9c29-889d02611d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:46.319098 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1073/2145] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:46 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:46.332375 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c27bd-67da-4bf2-b358-4b2a01cd1287 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:46.334753 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-4f0c27bd-67da-4bf2-b358-4b2a01cd1287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:46.406567 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c27bd-67da-4bf2-b358-4b2a01cd1287 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:46.410901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f2c8f-00bc-46aa-8ccd-5b6f9b482627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:46.411585 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f2c8f-00bc-46aa-8ccd-5b6f9b482627 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:46.411870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f2c8f-00bc-46aa-8ccd-5b6f9b482627 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:46.412144 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f2c8f-00bc-46aa-8ccd-5b6f9b482627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:46.422287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f2c8f-00bc-46aa-8ccd-5b6f9b482627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:46.435753 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f2c8f-00bc-46aa-8ccd-5b6f9b482627 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:46.446212 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1073/2146] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:46 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:46.472308 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760a7cc-97f7-4978-9c29-889d02611d03 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:46.560908 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760a7cc-97f7-4978-9c29-889d02611d03 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:46.567171 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c128dc-788f-4c8e-8cd5-633dc573bccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:46.568196 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c128dc-788f-4c8e-8cd5-633dc573bccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:46.568583 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c128dc-788f-4c8e-8cd5-633dc573bccb admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:46.569042 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c128dc-788f-4c8e-8cd5-633dc573bccb admin admin] PATH_INFO: `/v3/users/dce34364f9824ce48a461fdd8e3f8ae4` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:46.570296 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c128dc-788f-4c8e-8cd5-633dc573bccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce34364f9824ce48a461fdd8e3f8ae4)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:46.572638 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c128dc-788f-4c8e-8cd5-633dc573bccb admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:46.627063 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b9c128dc-788f-4c8e-8cd5-633dc573bccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce34364f9824ce48a461fdd8e3f8ae4'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:46.641021 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b9c128dc-788f-4c8e-8cd5-633dc573bccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce34364f9824ce48a461fdd8e3f8ae4'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:46.641732 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b9c128dc-788f-4c8e-8cd5-633dc573bccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce34364f9824ce48a461fdd8e3f8ae4'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:46.649020 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b9c128dc-788f-4c8e-8cd5-633dc573bccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce34364f9824ce48a461fdd8e3f8ae4'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:46.658612 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b9c128dc-788f-4c8e-8cd5-633dc573bccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce34364f9824ce48a461fdd8e3f8ae4'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:46.667609 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1074/2147] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:46 2021] DELETE /identity/v3/users/dce34364f9824ce48a461fdd8e3f8ae4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:46.673229 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407003a8-906a-4c3f-9783-9d2a6d01cf40 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:46.673915 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407003a8-906a-4c3f-9783-9d2a6d01cf40 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:46.674524 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407003a8-906a-4c3f-9783-9d2a6d01cf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:46.693217 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-407003a8-906a-4c3f-9783-9d2a6d01cf40 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:46.694903 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-407003a8-906a-4c3f-9783-9d2a6d01cf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:46.767881 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1074/2148] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:46.774962 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c128dc-788f-4c8e-8cd5-633dc573bccb admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:46.777190 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b9c128dc-788f-4c8e-8cd5-633dc573bccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:46.864005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c128dc-788f-4c8e-8cd5-633dc573bccb admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:46.892553 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23b657-c020-4ea6-9a47-80bf14c57067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:46.893994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23b657-c020-4ea6-9a47-80bf14c57067 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:46.894490 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23b657-c020-4ea6-9a47-80bf14c57067 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:46.895066 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23b657-c020-4ea6-9a47-80bf14c57067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:46.918530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23b657-c020-4ea6-9a47-80bf14c57067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:46.920959 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23b657-c020-4ea6-9a47-80bf14c57067 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:46.943997 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1075/2149] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:47.396782 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407003a8-906a-4c3f-9783-9d2a6d01cf40 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:47.398311 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-407003a8-906a-4c3f-9783-9d2a6d01cf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:47.418425 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407003a8-906a-4c3f-9783-9d2a6d01cf40 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:47.432287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee81af5-b6a7-4de9-8ecc-b91af00bf66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:47.433723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee81af5-b6a7-4de9-8ecc-b91af00bf66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:47.434293 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee81af5-b6a7-4de9-8ecc-b91af00bf66a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:47.434631 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee81af5-b6a7-4de9-8ecc-b91af00bf66a admin admin] PATH_INFO: `/v3/projects/15d9c6ea97514037bc84881cc9b63cbf` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:47.436011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee81af5-b6a7-4de9-8ecc-b91af00bf66a admin admin] RBAC: Authorizing `identity:delete_project(project_id=15d9c6ea97514037bc84881cc9b63cbf)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:47.437964 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee81af5-b6a7-4de9-8ecc-b91af00bf66a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:47.521580 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-5ee81af5-b6a7-4de9-8ecc-b91af00bf66a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15d9c6ea97514037bc84881cc9b63cbf', 'request_id': 'req-5ee81af5-b6a7-4de9-8ecc-b91af00bf66a'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:47.530891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-5ee81af5-b6a7-4de9-8ecc-b91af00bf66a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15d9c6ea97514037bc84881cc9b63cbf', 'request_id': 'req-5ee81af5-b6a7-4de9-8ecc-b91af00bf66a'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:47.537414 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-5ee81af5-b6a7-4de9-8ecc-b91af00bf66a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15d9c6ea97514037bc84881cc9b63cbf', 'request_id': 'req-5ee81af5-b6a7-4de9-8ecc-b91af00bf66a'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:47.552791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-5ee81af5-b6a7-4de9-8ecc-b91af00bf66a admin admin] The token cache is being invalidate because project 15d9c6ea97514037bc84881cc9b63cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:47.553184 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-5ee81af5-b6a7-4de9-8ecc-b91af00bf66a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:47.553863 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-5ee81af5-b6a7-4de9-8ecc-b91af00bf66a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:47.555639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1075/2150] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:47 2021] DELETE /identity/v3/projects/15d9c6ea97514037bc84881cc9b63cbf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:47.562760 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad93ff-7727-4d60-8cc9-5dc77942aa25 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:47.563057 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad93ff-7727-4d60-8cc9-5dc77942aa25 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:47.563489 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad93ff-7727-4d60-8cc9-5dc77942aa25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:47.590938 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-b4ad93ff-7727-4d60-8cc9-5dc77942aa25 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:47.592531 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b4ad93ff-7727-4d60-8cc9-5dc77942aa25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:47.667094 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1076/2151] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:47.674948 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788f33e-dac3-4a92-a1aa-2476515005c6 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:47.675768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788f33e-dac3-4a92-a1aa-2476515005c6 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:47.676269 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788f33e-dac3-4a92-a1aa-2476515005c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:47.697614 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-6788f33e-dac3-4a92-a1aa-2476515005c6 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:47.700082 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-6788f33e-dac3-4a92-a1aa-2476515005c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:47.709661 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1076/2152] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:47.713875 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad93ff-7727-4d60-8cc9-5dc77942aa25 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:47.724306 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad93ff-7727-4d60-8cc9-5dc77942aa25 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:47.731558 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8a951-a4fd-4e55-b9ef-c8a9acc25acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:47.732247 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8a951-a4fd-4e55-b9ef-c8a9acc25acc admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:47.732546 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8a951-a4fd-4e55-b9ef-c8a9acc25acc admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:47.732980 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8a951-a4fd-4e55-b9ef-c8a9acc25acc admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:47.733570 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8a951-a4fd-4e55-b9ef-c8a9acc25acc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:05:47.733896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8a951-a4fd-4e55-b9ef-c8a9acc25acc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:47.735777 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8a951-a4fd-4e55-b9ef-c8a9acc25acc admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:47.753583 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1077/2153] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:05:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:05:47.758328 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788f33e-dac3-4a92-a1aa-2476515005c6 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:47.774457 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788f33e-dac3-4a92-a1aa-2476515005c6 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:47.781994 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9209a-bb53-4f9d-8723-293e9aaa8e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:47.782939 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9209a-bb53-4f9d-8723-293e9aaa8e53 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:47.783325 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9209a-bb53-4f9d-8723-293e9aaa8e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:47.783737 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9209a-bb53-4f9d-8723-293e9aaa8e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:47.784534 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9209a-bb53-4f9d-8723-293e9aaa8e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:47.786744 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9209a-bb53-4f9d-8723-293e9aaa8e53 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:47.821916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1077/2154] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:47 2021] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:47.827266 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8a951-a4fd-4e55-b9ef-c8a9acc25acc admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:47.838213 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8a951-a4fd-4e55-b9ef-c8a9acc25acc admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:47.925578 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb5de6-d1c0-41cd-a6d7-cbc62b365353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:47.926463 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb5de6-d1c0-41cd-a6d7-cbc62b365353 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:47.926860 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb5de6-d1c0-41cd-a6d7-cbc62b365353 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:47.927206 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb5de6-d1c0-41cd-a6d7-cbc62b365353 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:47.930339 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb5de6-d1c0-41cd-a6d7-cbc62b365353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:47.932533 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb5de6-d1c0-41cd-a6d7-cbc62b365353 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:47.973369 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1078/2155] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:47 2021] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:47.973814 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9209a-bb53-4f9d-8723-293e9aaa8e53 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:47.985654 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9209a-bb53-4f9d-8723-293e9aaa8e53 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:47.997669 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40135f96-8d0a-4338-b389-cf0b8e52f26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:47.998462 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40135f96-8d0a-4338-b389-cf0b8e52f26e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:47.998810 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40135f96-8d0a-4338-b389-cf0b8e52f26e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:47.999263 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40135f96-8d0a-4338-b389-cf0b8e52f26e admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:48.000739 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40135f96-8d0a-4338-b389-cf0b8e52f26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:48.002656 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40135f96-8d0a-4338-b389-cf0b8e52f26e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:48.024187 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1078/2156] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:47 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:05:48.025511 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb5de6-d1c0-41cd-a6d7-cbc62b365353 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:48.041051 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb5de6-d1c0-41cd-a6d7-cbc62b365353 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:48.048696 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d37f0e-3c1a-41fa-98e4-10d2407faa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:48.049538 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d37f0e-3c1a-41fa-98e4-10d2407faa16 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:48.049824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d37f0e-3c1a-41fa-98e4-10d2407faa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:48.050157 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d37f0e-3c1a-41fa-98e4-10d2407faa16 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:48.051178 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d37f0e-3c1a-41fa-98e4-10d2407faa16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:48.053349 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d37f0e-3c1a-41fa-98e4-10d2407faa16 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:48.071082 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1079/2157] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:48 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:48.071487 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40135f96-8d0a-4338-b389-cf0b8e52f26e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:48.082414 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40135f96-8d0a-4338-b389-cf0b8e52f26e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:48.088753 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2aa85-71f9-40a8-aae4-92b2993a0a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:48.089736 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2aa85-71f9-40a8-aae4-92b2993a0a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:48.090018 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2aa85-71f9-40a8-aae4-92b2993a0a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:48.090293 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2aa85-71f9-40a8-aae4-92b2993a0a51 admin admin] PATH_INFO: `/v3/projects/11e8813df1734442ab271c50806450e5/users/9e6102881e6e41f2861f35e4d71eb1ac/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:48.112829 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2aa85-71f9-40a8-aae4-92b2993a0a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e8813df1734442ab271c50806450e5, user_id=9e6102881e6e41f2861f35e4d71eb1ac, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:48.115513 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2aa85-71f9-40a8-aae4-92b2993a0a51 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:48.143027 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1079/2158] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:48 2021] PUT /identity/v3/projects/11e8813df1734442ab271c50806450e5/users/9e6102881e6e41f2861f35e4d71eb1ac/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:05:48.153121 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912826e-5ccc-445b-aa59-13b16a3e28a0 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:48.153454 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912826e-5ccc-445b-aa59-13b16a3e28a0 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:48.153666 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912826e-5ccc-445b-aa59-13b16a3e28a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:48.187900 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-4912826e-5ccc-445b-aa59-13b16a3e28a0 None None] MFA Rules not processed for user `9e6102881e6e41f2861f35e4d71eb1ac`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:48.189126 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-4912826e-5ccc-445b-aa59-13b16a3e28a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:48.270259 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1080/2159] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:48 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:48.284569 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2aa85-71f9-40a8-aae4-92b2993a0a51 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:48.287179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c3a2aa85-71f9-40a8-aae4-92b2993a0a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:48.350979 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2aa85-71f9-40a8-aae4-92b2993a0a51 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:48.355815 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fe9e7-f4e6-4539-92f4-27da2a473907 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d763da11c58473c9c2cf981b02835f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:48.356276 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fe9e7-f4e6-4539-92f4-27da2a473907 service glance] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:48.356554 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fe9e7-f4e6-4539-92f4-27da2a473907 service glance] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:48.356822 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fe9e7-f4e6-4539-92f4-27da2a473907 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:48.366144 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fe9e7-f4e6-4539-92f4-27da2a473907 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:48.367603 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fe9e7-f4e6-4539-92f4-27da2a473907 service glance] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:48.377068 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1080/2160] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:48 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:05:54.097464 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912826e-5ccc-445b-aa59-13b16a3e28a0 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:54.098953 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-4912826e-5ccc-445b-aa59-13b16a3e28a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:54.195643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912826e-5ccc-445b-aa59-13b16a3e28a0 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:54.201767 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2e7a9-4eaa-48f6-9607-b8c515db4d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:54.203357 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2e7a9-4eaa-48f6-9607-b8c515db4d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:54.203828 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2e7a9-4eaa-48f6-9607-b8c515db4d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:54.204286 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2e7a9-4eaa-48f6-9607-b8c515db4d47 admin admin] PATH_INFO: `/v3/users/51eafb3dc83541ca9c5c248fb30bb814` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:54.205701 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2e7a9-4eaa-48f6-9607-b8c515db4d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51eafb3dc83541ca9c5c248fb30bb814)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:54.207884 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2e7a9-4eaa-48f6-9607-b8c515db4d47 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:54.285369 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-97b2e7a9-4eaa-48f6-9607-b8c515db4d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51eafb3dc83541ca9c5c248fb30bb814'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:54.308886 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-97b2e7a9-4eaa-48f6-9607-b8c515db4d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51eafb3dc83541ca9c5c248fb30bb814'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:54.310031 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-97b2e7a9-4eaa-48f6-9607-b8c515db4d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51eafb3dc83541ca9c5c248fb30bb814'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:54.320668 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-97b2e7a9-4eaa-48f6-9607-b8c515db4d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51eafb3dc83541ca9c5c248fb30bb814'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:54.333971 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-97b2e7a9-4eaa-48f6-9607-b8c515db4d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51eafb3dc83541ca9c5c248fb30bb814'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:54.341589 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1081/2161] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:05:54 2021] DELETE /identity/v3/users/51eafb3dc83541ca9c5c248fb30bb814 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:54.346737 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e59e61-19dd-4ee2-b3f5-bf445b3e23c2 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:54.347328 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e59e61-19dd-4ee2-b3f5-bf445b3e23c2 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:54.347328 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e59e61-19dd-4ee2-b3f5-bf445b3e23c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:54.366206 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-d9e59e61-19dd-4ee2-b3f5-bf445b3e23c2 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:54.367871 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d9e59e61-19dd-4ee2-b3f5-bf445b3e23c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:54.432299 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1081/2162] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:54.443940 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2e7a9-4eaa-48f6-9607-b8c515db4d47 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:54.445410 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-97b2e7a9-4eaa-48f6-9607-b8c515db4d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:54.537637 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2e7a9-4eaa-48f6-9607-b8c515db4d47 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:54.548997 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cf389-f5e3-4e82-b528-f09384346807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:54.549669 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cf389-f5e3-4e82-b528-f09384346807 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:54.549953 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cf389-f5e3-4e82-b528-f09384346807 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:54.550230 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cf389-f5e3-4e82-b528-f09384346807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:54.566337 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0cf389-f5e3-4e82-b528-f09384346807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:54.571177 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0cf389-f5e3-4e82-b528-f09384346807 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:54.596444 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1082/2163] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:05:54.966355 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e59e61-19dd-4ee2-b3f5-bf445b3e23c2 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:54.967853 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d9e59e61-19dd-4ee2-b3f5-bf445b3e23c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:54.981482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e59e61-19dd-4ee2-b3f5-bf445b3e23c2 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:54.987054 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0051bf-897d-4f9b-a7da-c48ecb999de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:54.987956 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0051bf-897d-4f9b-a7da-c48ecb999de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:54.988240 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0051bf-897d-4f9b-a7da-c48ecb999de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:54.988521 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0051bf-897d-4f9b-a7da-c48ecb999de5 admin admin] PATH_INFO: `/v3/projects/051c8205afc64ce9b31be400c9d09245` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:54.989726 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0051bf-897d-4f9b-a7da-c48ecb999de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=051c8205afc64ce9b31be400c9d09245)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:54.991940 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0051bf-897d-4f9b-a7da-c48ecb999de5 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:55.048236 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8b0051bf-897d-4f9b-a7da-c48ecb999de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '051c8205afc64ce9b31be400c9d09245', 'request_id': 'req-8b0051bf-897d-4f9b-a7da-c48ecb999de5'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:55.054628 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8b0051bf-897d-4f9b-a7da-c48ecb999de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '051c8205afc64ce9b31be400c9d09245', 'request_id': 'req-8b0051bf-897d-4f9b-a7da-c48ecb999de5'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:55.064329 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8b0051bf-897d-4f9b-a7da-c48ecb999de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '051c8205afc64ce9b31be400c9d09245', 'request_id': 'req-8b0051bf-897d-4f9b-a7da-c48ecb999de5'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:55.078127 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8b0051bf-897d-4f9b-a7da-c48ecb999de5 admin admin] The token cache is being invalidate because project 051c8205afc64ce9b31be400c9d09245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:05:55.078421 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8b0051bf-897d-4f9b-a7da-c48ecb999de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:55.079054 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8b0051bf-897d-4f9b-a7da-c48ecb999de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:05:55.080733 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1082/2164] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:05:54 2021] DELETE /identity/v3/projects/051c8205afc64ce9b31be400c9d09245 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:55.086637 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ca64f-c994-4608-b514-0c27fd1825f2 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:55.086933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ca64f-c994-4608-b514-0c27fd1825f2 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:55.087212 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ca64f-c994-4608-b514-0c27fd1825f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:55.109040 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-6d8ca64f-c994-4608-b514-0c27fd1825f2 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:55.110932 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-6d8ca64f-c994-4608-b514-0c27fd1825f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:55.179078 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1083/2165] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:55.187710 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b558f84-47ab-4712-bb89-a16f3fa05246 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:55.188065 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b558f84-47ab-4712-bb89-a16f3fa05246 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:55.188348 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b558f84-47ab-4712-bb89-a16f3fa05246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:55.209460 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-1b558f84-47ab-4712-bb89-a16f3fa05246 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:55.210763 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1b558f84-47ab-4712-bb89-a16f3fa05246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:55.219175 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1083/2166] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:05:55.223585 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ca64f-c994-4608-b514-0c27fd1825f2 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:55.234605 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ca64f-c994-4608-b514-0c27fd1825f2 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:55.239229 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ae124-2a6a-48f5-9bfe-764d39265a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:55.239913 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ae124-2a6a-48f5-9bfe-764d39265a01 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:55.240196 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ae124-2a6a-48f5-9bfe-764d39265a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:55.240470 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ae124-2a6a-48f5-9bfe-764d39265a01 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:55.241181 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ae124-2a6a-48f5-9bfe-764d39265a01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:05:55.241486 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ae124-2a6a-48f5-9bfe-764d39265a01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:55.243112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ae124-2a6a-48f5-9bfe-764d39265a01 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:55.254940 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1084/2167] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:05:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:05:55.259507 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b558f84-47ab-4712-bb89-a16f3fa05246 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:55.269759 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b558f84-47ab-4712-bb89-a16f3fa05246 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:55.274715 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de650e4-980f-4178-ba3c-e9b558ba458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:55.275404 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de650e4-980f-4178-ba3c-e9b558ba458c admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:55.275693 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de650e4-980f-4178-ba3c-e9b558ba458c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:55.275971 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de650e4-980f-4178-ba3c-e9b558ba458c admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:55.277234 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de650e4-980f-4178-ba3c-e9b558ba458c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:55.282334 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de650e4-980f-4178-ba3c-e9b558ba458c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:55.311412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1084/2168] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:05:55 2021] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:05:55.315669 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ae124-2a6a-48f5-9bfe-764d39265a01 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:55.325888 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ae124-2a6a-48f5-9bfe-764d39265a01 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:55.389968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7f70d-de69-463b-8d2b-9c9b7944772c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:55.390942 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7f70d-de69-463b-8d2b-9c9b7944772c admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:55.391418 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7f70d-de69-463b-8d2b-9c9b7944772c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:55.391749 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7f70d-de69-463b-8d2b-9c9b7944772c admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:55.392525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7f70d-de69-463b-8d2b-9c9b7944772c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:55.394521 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7f70d-de69-463b-8d2b-9c9b7944772c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:55.416678 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1085/2169] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:05:55 2021] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:05:55.420732 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de650e4-980f-4178-ba3c-e9b558ba458c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:55.431841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de650e4-980f-4178-ba3c-e9b558ba458c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:55.437074 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866439a-8b2c-4752-bfac-ada63e483bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:55.437836 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866439a-8b2c-4752-bfac-ada63e483bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:55.438118 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866439a-8b2c-4752-bfac-ada63e483bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:55.438393 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866439a-8b2c-4752-bfac-ada63e483bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:55.439154 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866439a-8b2c-4752-bfac-ada63e483bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:55.440774 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866439a-8b2c-4752-bfac-ada63e483bd7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:55.452210 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1085/2170] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:55 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:05:55.456709 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7f70d-de69-463b-8d2b-9c9b7944772c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:55.468522 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7f70d-de69-463b-8d2b-9c9b7944772c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:55.473288 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7b223-385e-415c-a4ca-607b460d12d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:55.473944 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7b223-385e-415c-a4ca-607b460d12d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:55.474222 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7b223-385e-415c-a4ca-607b460d12d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:55.474495 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7b223-385e-415c-a4ca-607b460d12d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:55.475216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7b223-385e-415c-a4ca-607b460d12d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:55.476819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7b223-385e-415c-a4ca-607b460d12d1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:55.488496 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1086/2171] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:05:55 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:05:55.494892 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866439a-8b2c-4752-bfac-ada63e483bd7 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:55.506253 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866439a-8b2c-4752-bfac-ada63e483bd7 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:55.512221 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4bcb1-c22a-4451-b5eb-f6229a66c3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:55.512979 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4bcb1-c22a-4451-b5eb-f6229a66c3d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:55.513256 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4bcb1-c22a-4451-b5eb-f6229a66c3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:55.513533 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4bcb1-c22a-4451-b5eb-f6229a66c3d1 admin admin] PATH_INFO: `/v3/projects/1cb7442f56da4ed08bd964a5cd5af18f/users/863e1031965a4bba82d345acb07e5856/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:55.532013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4bcb1-c22a-4451-b5eb-f6229a66c3d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb7442f56da4ed08bd964a5cd5af18f, user_id=863e1031965a4bba82d345acb07e5856, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:55.536488 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4bcb1-c22a-4451-b5eb-f6229a66c3d1 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:55.554026 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1086/2172] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:05:55 2021] PUT /identity/v3/projects/1cb7442f56da4ed08bd964a5cd5af18f/users/863e1031965a4bba82d345acb07e5856/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:05:55.560959 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acdbfa-0806-4be0-83f3-717c923ef125 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:55.561247 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acdbfa-0806-4be0-83f3-717c923ef125 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:55.561682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acdbfa-0806-4be0-83f3-717c923ef125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:55.584748 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-d0acdbfa-0806-4be0-83f3-717c923ef125 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:05:55.585946 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-d0acdbfa-0806-4be0-83f3-717c923ef125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:55.656799 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1087/2173] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:05:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:05:55.667329 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4bcb1-c22a-4451-b5eb-f6229a66c3d1 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:05:55.670107 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-8ef4bcb1-c22a-4451-b5eb-f6229a66c3d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:05:55.729375 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4bcb1-c22a-4451-b5eb-f6229a66c3d1 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:05:55.733382 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3edd6-23c9-407c-9358-da7a50dcfc89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:05:55.734112 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3edd6-23c9-407c-9358-da7a50dcfc89 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:05:55.734400 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3edd6-23c9-407c-9358-da7a50dcfc89 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:05:55.734929 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3edd6-23c9-407c-9358-da7a50dcfc89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:05:55.743846 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3edd6-23c9-407c-9358-da7a50dcfc89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:05:55.745339 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3edd6-23c9-407c-9358-da7a50dcfc89 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:05:55.755559 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1087/2174] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:05:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:06:01.507749 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876fbe-6106-4dc2-87be-d0c2fc531e53 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:01.508284 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876fbe-6106-4dc2-87be-d0c2fc531e53 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:01.508469 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876fbe-6106-4dc2-87be-d0c2fc531e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:01.549858 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-7f876fbe-6106-4dc2-87be-d0c2fc531e53 None None] MFA Rules not processed for user `863e1031965a4bba82d345acb07e5856`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:01.551104 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-7f876fbe-6106-4dc2-87be-d0c2fc531e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:01.651063 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1088/2175] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:06:01 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:06:01.652263 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3edd6-23c9-407c-9358-da7a50dcfc89 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:01.670311 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3edd6-23c9-407c-9358-da7a50dcfc89 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:01.680034 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1c22d-48c3-4a01-8d23-24508e2bbba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:01.682017 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1c22d-48c3-4a01-8d23-24508e2bbba1 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:01.684227 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1c22d-48c3-4a01-8d23-24508e2bbba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:01.684700 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1c22d-48c3-4a01-8d23-24508e2bbba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:01.685586 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1c22d-48c3-4a01-8d23-24508e2bbba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:01.688015 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1c22d-48c3-4a01-8d23-24508e2bbba1 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:01.731802 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1088/2176] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:06:01 2021] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:06:01.733203 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f876fbe-6106-4dc2-87be-d0c2fc531e53 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:01.745480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f876fbe-6106-4dc2-87be-d0c2fc531e53 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:01.813356 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2701b0-59fb-448a-986d-041db22399ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:01.814176 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2701b0-59fb-448a-986d-041db22399ad admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:01.814478 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2701b0-59fb-448a-986d-041db22399ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:01.814756 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2701b0-59fb-448a-986d-041db22399ad admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:01.815488 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2701b0-59fb-448a-986d-041db22399ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:01.817489 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2701b0-59fb-448a-986d-041db22399ad admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:01.857334 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1089/2177] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:06:01 2021] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:06:01.858887 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1c22d-48c3-4a01-8d23-24508e2bbba1 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:01.876206 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1c22d-48c3-4a01-8d23-24508e2bbba1 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:01.890567 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2cf90-f749-4f52-a647-f46048082b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:01.891565 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2cf90-f749-4f52-a647-f46048082b80 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:01.892020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2cf90-f749-4f52-a647-f46048082b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:01.892456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2cf90-f749-4f52-a647-f46048082b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:01.893339 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2cf90-f749-4f52-a647-f46048082b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:01.895151 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2cf90-f749-4f52-a647-f46048082b80 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:01.925341 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1089/2178] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:06:01 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:06:01.930194 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2701b0-59fb-448a-986d-041db22399ad admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:01.945341 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2701b0-59fb-448a-986d-041db22399ad admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:01.950667 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72baa1-cb69-479d-9ba0-d868cff85067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:01.952187 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72baa1-cb69-479d-9ba0-d868cff85067 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:01.952811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72baa1-cb69-479d-9ba0-d868cff85067 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:01.953192 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72baa1-cb69-479d-9ba0-d868cff85067 admin admin] PATH_INFO: `/v3/projects/94900671da2f46c8b89002501fb08336/users/3262df9719f84bd39b7941076a3f527a/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:01.983669 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72baa1-cb69-479d-9ba0-d868cff85067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94900671da2f46c8b89002501fb08336, user_id=3262df9719f84bd39b7941076a3f527a, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:01.986516 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72baa1-cb69-479d-9ba0-d868cff85067 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:02.010080 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1090/2179] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:06:01 2021] PUT /identity/v3/projects/94900671da2f46c8b89002501fb08336/users/3262df9719f84bd39b7941076a3f527a/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:06:02.016776 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2cf90-f749-4f52-a647-f46048082b80 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:02.038839 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2cf90-f749-4f52-a647-f46048082b80 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:02.133144 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116bb55-2bca-45d9-8e73-7551380dbb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:02.133855 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116bb55-2bca-45d9-8e73-7551380dbb7f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:02.134107 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116bb55-2bca-45d9-8e73-7551380dbb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:02.134594 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116bb55-2bca-45d9-8e73-7551380dbb7f admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:02.135138 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116bb55-2bca-45d9-8e73-7551380dbb7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:02.137615 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116bb55-2bca-45d9-8e73-7551380dbb7f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:02.148391 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1090/2180] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:06:02 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:06:02.152707 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72baa1-cb69-479d-9ba0-d868cff85067 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:02.163525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72baa1-cb69-479d-9ba0-d868cff85067 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:02.169499 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3f835-3006-4c48-b12b-7e9c3607c13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:02.170432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3f835-3006-4c48-b12b-7e9c3607c13f admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:02.170837 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3f835-3006-4c48-b12b-7e9c3607c13f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:02.170942 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3f835-3006-4c48-b12b-7e9c3607c13f admin admin] PATH_INFO: `/v3/projects/94900671da2f46c8b89002501fb08336/users/3262df9719f84bd39b7941076a3f527a/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:02.173133 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3f835-3006-4c48-b12b-7e9c3607c13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=94900671da2f46c8b89002501fb08336, user_id=3262df9719f84bd39b7941076a3f527a, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:02.175917 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3f835-3006-4c48-b12b-7e9c3607c13f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:02.190445 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1091/2181] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:06:02 2021] PUT /identity/v3/projects/94900671da2f46c8b89002501fb08336/users/3262df9719f84bd39b7941076a3f527a/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:06:09.146858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d444b76-6bfe-4ab3-8a13-03a41e4b6784 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:09.152395 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d444b76-6bfe-4ab3-8a13-03a41e4b6784 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:09.152920 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d444b76-6bfe-4ab3-8a13-03a41e4b6784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:09.200120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-0d444b76-6bfe-4ab3-8a13-03a41e4b6784 None None] MFA Rules not processed for user `3262df9719f84bd39b7941076a3f527a`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:09.201791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0d444b76-6bfe-4ab3-8a13-03a41e4b6784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:09.325407 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1091/2182] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:06:09 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:06:09.340779 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3f835-3006-4c48-b12b-7e9c3607c13f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:09.343153 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f8c3f835-3006-4c48-b12b-7e9c3607c13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:09.434339 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3f835-3006-4c48-b12b-7e9c3607c13f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:09.440124 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad157c-acc8-4ccd-bdf6-482b9412c78c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:09.440770 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad157c-acc8-4ccd-bdf6-482b9412c78c service nova] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:09.441049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad157c-acc8-4ccd-bdf6-482b9412c78c service nova] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:09.441326 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad157c-acc8-4ccd-bdf6-482b9412c78c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:09.496859 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad157c-acc8-4ccd-bdf6-482b9412c78c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:09.498539 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad157c-acc8-4ccd-bdf6-482b9412c78c service nova] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:09.509302 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1092/2183] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:06:09 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:06:12.199566 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00b931-a6ad-413b-a8ce-55a511ba9bb2 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:12.200124 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00b931-a6ad-413b-a8ce-55a511ba9bb2 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:12.200124 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00b931-a6ad-413b-a8ce-55a511ba9bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:12.222197 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-fb00b931-a6ad-413b-a8ce-55a511ba9bb2 None None] MFA Rules not processed for user `361eb264d0a147e9879a758807cd3eed`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:12.223478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-fb00b931-a6ad-413b-a8ce-55a511ba9bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:12.298115 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1092/2184] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:06:12 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:06:23.822956 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad157c-acc8-4ccd-bdf6-482b9412c78c service nova] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:23.826486 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-cbad157c-acc8-4ccd-bdf6-482b9412c78c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:23.906088 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad157c-acc8-4ccd-bdf6-482b9412c78c service nova] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:23.910740 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd68f8d-525e-451e-9987-34fb77b07a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:23.911719 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd68f8d-525e-451e-9987-34fb77b07a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:23.912081 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd68f8d-525e-451e-9987-34fb77b07a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:23.912408 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd68f8d-525e-451e-9987-34fb77b07a27 admin admin] PATH_INFO: `/v3/users/9e6102881e6e41f2861f35e4d71eb1ac` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:23.913659 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd68f8d-525e-451e-9987-34fb77b07a27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6102881e6e41f2861f35e4d71eb1ac)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:23.915973 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd68f8d-525e-451e-9987-34fb77b07a27 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:23.964768 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ecd68f8d-525e-451e-9987-34fb77b07a27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6102881e6e41f2861f35e4d71eb1ac'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:23.977344 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ecd68f8d-525e-451e-9987-34fb77b07a27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6102881e6e41f2861f35e4d71eb1ac'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:23.978148 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ecd68f8d-525e-451e-9987-34fb77b07a27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6102881e6e41f2861f35e4d71eb1ac'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:23.993084 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ecd68f8d-525e-451e-9987-34fb77b07a27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6102881e6e41f2861f35e4d71eb1ac'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:24.001329 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ecd68f8d-525e-451e-9987-34fb77b07a27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6102881e6e41f2861f35e4d71eb1ac'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:24.007500 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1093/2185] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:06:23 2021] DELETE /identity/v3/users/9e6102881e6e41f2861f35e4d71eb1ac => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:06:24.011960 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa638e-c029-4388-ba0a-f0f555cfd69e None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:24.012499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa638e-c029-4388-ba0a-f0f555cfd69e None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:24.012499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa638e-c029-4388-ba0a-f0f555cfd69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:24.031536 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-a1fa638e-c029-4388-ba0a-f0f555cfd69e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:24.032732 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a1fa638e-c029-4388-ba0a-f0f555cfd69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:24.093970 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1093/2186] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:06:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:06:24.109501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd68f8d-525e-451e-9987-34fb77b07a27 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:24.110915 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ecd68f8d-525e-451e-9987-34fb77b07a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:24.166945 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd68f8d-525e-451e-9987-34fb77b07a27 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:24.171238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544e3c7-d74c-4292-bc9f-6d01ce3cc778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:24.171918 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544e3c7-d74c-4292-bc9f-6d01ce3cc778 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:24.172203 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544e3c7-d74c-4292-bc9f-6d01ce3cc778 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:24.172472 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544e3c7-d74c-4292-bc9f-6d01ce3cc778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:24.181735 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544e3c7-d74c-4292-bc9f-6d01ce3cc778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:24.183232 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544e3c7-d74c-4292-bc9f-6d01ce3cc778 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:24.193606 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1094/2187] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:06:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:06:24.514448 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa638e-c029-4388-ba0a-f0f555cfd69e None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:24.515884 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a1fa638e-c029-4388-ba0a-f0f555cfd69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:24.527414 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa638e-c029-4388-ba0a-f0f555cfd69e None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:24.532245 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1ee89-ac9c-43a9-860b-bc17a91f6c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:24.533193 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1ee89-ac9c-43a9-860b-bc17a91f6c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:24.533538 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1ee89-ac9c-43a9-860b-bc17a91f6c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:24.533818 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1ee89-ac9c-43a9-860b-bc17a91f6c66 admin admin] PATH_INFO: `/v3/projects/11e8813df1734442ab271c50806450e5` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:24.536334 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1ee89-ac9c-43a9-860b-bc17a91f6c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11e8813df1734442ab271c50806450e5)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:24.538372 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1ee89-ac9c-43a9-860b-bc17a91f6c66 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:24.587295 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-62a1ee89-ac9c-43a9-860b-bc17a91f6c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11e8813df1734442ab271c50806450e5', 'request_id': 'req-62a1ee89-ac9c-43a9-860b-bc17a91f6c66'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:24.593297 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-62a1ee89-ac9c-43a9-860b-bc17a91f6c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11e8813df1734442ab271c50806450e5', 'request_id': 'req-62a1ee89-ac9c-43a9-860b-bc17a91f6c66'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:24.598512 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-62a1ee89-ac9c-43a9-860b-bc17a91f6c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11e8813df1734442ab271c50806450e5', 'request_id': 'req-62a1ee89-ac9c-43a9-860b-bc17a91f6c66'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:24.609966 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-62a1ee89-ac9c-43a9-860b-bc17a91f6c66 admin admin] The token cache is being invalidate because project 11e8813df1734442ab271c50806450e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:06:24.610254 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-62a1ee89-ac9c-43a9-860b-bc17a91f6c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:24.610879 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-62a1ee89-ac9c-43a9-860b-bc17a91f6c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:24.612467 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1094/2188] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:06:24 2021] DELETE /identity/v3/projects/11e8813df1734442ab271c50806450e5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:06:24.618227 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254154e9-1dd4-4f12-93ba-1c02a5dcdcee None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:24.618531 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254154e9-1dd4-4f12-93ba-1c02a5dcdcee None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:24.618814 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254154e9-1dd4-4f12-93ba-1c02a5dcdcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:24.641159 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-254154e9-1dd4-4f12-93ba-1c02a5dcdcee None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:24.642377 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-254154e9-1dd4-4f12-93ba-1c02a5dcdcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:24.704000 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1095/2189] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:06:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:06:24.713296 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85983b01-720a-44cc-88d0-1d697dce9165 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:24.713581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85983b01-720a-44cc-88d0-1d697dce9165 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:24.713858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85983b01-720a-44cc-88d0-1d697dce9165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:24.733896 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-85983b01-720a-44cc-88d0-1d697dce9165 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:24.735115 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-85983b01-720a-44cc-88d0-1d697dce9165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:24.743051 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1095/2190] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:06:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:06:24.748194 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254154e9-1dd4-4f12-93ba-1c02a5dcdcee None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:24.758287 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254154e9-1dd4-4f12-93ba-1c02a5dcdcee None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:24.763492 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950952db-9c1a-48f4-8dbb-d3ae185a618f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:24.764162 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950952db-9c1a-48f4-8dbb-d3ae185a618f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:24.764447 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950952db-9c1a-48f4-8dbb-d3ae185a618f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:24.764742 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950952db-9c1a-48f4-8dbb-d3ae185a618f admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:24.765467 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950952db-9c1a-48f4-8dbb-d3ae185a618f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:06:24.765801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950952db-9c1a-48f4-8dbb-d3ae185a618f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:24.767457 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950952db-9c1a-48f4-8dbb-d3ae185a618f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:24.780120 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1096/2191] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:06:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:06:24.784895 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85983b01-720a-44cc-88d0-1d697dce9165 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:24.794644 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85983b01-720a-44cc-88d0-1d697dce9165 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:24.799405 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f1b53-09d8-41d6-94b6-fd58c8ee289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:24.800057 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f1b53-09d8-41d6-94b6-fd58c8ee289f admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:24.800338 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f1b53-09d8-41d6-94b6-fd58c8ee289f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:24.800609 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f1b53-09d8-41d6-94b6-fd58c8ee289f admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:24.801303 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f1b53-09d8-41d6-94b6-fd58c8ee289f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:24.803209 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f1b53-09d8-41d6-94b6-fd58c8ee289f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:24.837208 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1096/2192] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:06:24 2021] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:06:24.838348 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950952db-9c1a-48f4-8dbb-d3ae185a618f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:24.849581 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950952db-9c1a-48f4-8dbb-d3ae185a618f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:24.908293 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd12d79-0d8c-4703-967f-9df02796d3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:24.908964 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd12d79-0d8c-4703-967f-9df02796d3fc admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:24.909251 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd12d79-0d8c-4703-967f-9df02796d3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:24.909530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd12d79-0d8c-4703-967f-9df02796d3fc admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:24.910221 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd12d79-0d8c-4703-967f-9df02796d3fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:24.912172 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd12d79-0d8c-4703-967f-9df02796d3fc admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:24.932027 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1097/2193] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:06:24 2021] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:06:24.936309 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f1b53-09d8-41d6-94b6-fd58c8ee289f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:24.946754 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f1b53-09d8-41d6-94b6-fd58c8ee289f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:24.951690 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d41a7-6a9b-42eb-9ac7-843c61f4789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:24.952351 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d41a7-6a9b-42eb-9ac7-843c61f4789f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:24.952659 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d41a7-6a9b-42eb-9ac7-843c61f4789f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:24.952931 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d41a7-6a9b-42eb-9ac7-843c61f4789f admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:24.953650 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d41a7-6a9b-42eb-9ac7-843c61f4789f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:24.955289 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d41a7-6a9b-42eb-9ac7-843c61f4789f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:24.965596 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1097/2194] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:06:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:06:24.970435 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd12d79-0d8c-4703-967f-9df02796d3fc admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:24.980106 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd12d79-0d8c-4703-967f-9df02796d3fc admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:24.985367 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2a747-1af1-4285-8eb4-4d9a956c53ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:24.986014 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2a747-1af1-4285-8eb4-4d9a956c53ce admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:24.986296 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2a747-1af1-4285-8eb4-4d9a956c53ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:24.986571 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2a747-1af1-4285-8eb4-4d9a956c53ce admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:24.987290 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2a747-1af1-4285-8eb4-4d9a956c53ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:24.988894 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2a747-1af1-4285-8eb4-4d9a956c53ce admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:24.998611 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1098/2195] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:06:24 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:06:25.002640 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d41a7-6a9b-42eb-9ac7-843c61f4789f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:25.012463 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d41a7-6a9b-42eb-9ac7-843c61f4789f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:25.017635 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee3808-6be4-4f6b-bccd-7d2dcef3d175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:25.018658 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee3808-6be4-4f6b-bccd-7d2dcef3d175 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:25.018769 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee3808-6be4-4f6b-bccd-7d2dcef3d175 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:25.019062 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee3808-6be4-4f6b-bccd-7d2dcef3d175 admin admin] PATH_INFO: `/v3/projects/081a7e63a6c74c848d5b08c29d1a94e7/users/90109d081f874af4a037e0a2ea8e5658/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:25.035167 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee3808-6be4-4f6b-bccd-7d2dcef3d175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=081a7e63a6c74c848d5b08c29d1a94e7, user_id=90109d081f874af4a037e0a2ea8e5658, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:25.037855 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee3808-6be4-4f6b-bccd-7d2dcef3d175 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:25.058639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1098/2196] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:06:25 2021] PUT /identity/v3/projects/081a7e63a6c74c848d5b08c29d1a94e7/users/90109d081f874af4a037e0a2ea8e5658/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:06:25.069600 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad82ef-d6d6-4245-8f54-aa45826be51c None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:25.069983 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad82ef-d6d6-4245-8f54-aa45826be51c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:25.070333 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad82ef-d6d6-4245-8f54-aa45826be51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:25.100055 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-4cad82ef-d6d6-4245-8f54-aa45826be51c None None] MFA Rules not processed for user `90109d081f874af4a037e0a2ea8e5658`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:25.101307 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-4cad82ef-d6d6-4245-8f54-aa45826be51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:25.166874 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1099/2197] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:06:25 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:06:25.177162 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee3808-6be4-4f6b-bccd-7d2dcef3d175 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:25.179033 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-2bee3808-6be4-4f6b-bccd-7d2dcef3d175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:25.236686 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee3808-6be4-4f6b-bccd-7d2dcef3d175 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:25.240233 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710bf26-c76f-418c-9dce-834d9ce0a3ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:25.240865 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710bf26-c76f-418c-9dce-834d9ce0a3ed service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:25.241145 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710bf26-c76f-418c-9dce-834d9ce0a3ed service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:25.241416 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710bf26-c76f-418c-9dce-834d9ce0a3ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:25.249514 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710bf26-c76f-418c-9dce-834d9ce0a3ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:25.250938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710bf26-c76f-418c-9dce-834d9ce0a3ed service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:25.259680 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1099/2198] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:06:25 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:06:28.301105 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad82ef-d6d6-4245-8f54-aa45826be51c None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:28.367674 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad82ef-d6d6-4245-8f54-aa45826be51c None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:28.373695 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3de66-f78c-43fc-b9aa-95d6a90c4086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:28.374568 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3de66-f78c-43fc-b9aa-95d6a90c4086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:28.374856 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3de66-f78c-43fc-b9aa-95d6a90c4086 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:28.375131 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3de66-f78c-43fc-b9aa-95d6a90c4086 admin admin] PATH_INFO: `/v3/users/90109d081f874af4a037e0a2ea8e5658` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:28.376363 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3de66-f78c-43fc-b9aa-95d6a90c4086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90109d081f874af4a037e0a2ea8e5658)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:28.378331 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3de66-f78c-43fc-b9aa-95d6a90c4086 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:28.432556 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-64f3de66-f78c-43fc-b9aa-95d6a90c4086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90109d081f874af4a037e0a2ea8e5658'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:28.447884 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-64f3de66-f78c-43fc-b9aa-95d6a90c4086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90109d081f874af4a037e0a2ea8e5658'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:28.448626 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-64f3de66-f78c-43fc-b9aa-95d6a90c4086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90109d081f874af4a037e0a2ea8e5658'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:28.459703 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-64f3de66-f78c-43fc-b9aa-95d6a90c4086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90109d081f874af4a037e0a2ea8e5658'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:28.464133 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-64f3de66-f78c-43fc-b9aa-95d6a90c4086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90109d081f874af4a037e0a2ea8e5658'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:28.470770 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1100/2199] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:06:28 2021] DELETE /identity/v3/users/90109d081f874af4a037e0a2ea8e5658 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:06:28.475150 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f3452-a937-46fc-8233-efa32708990b None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:28.475650 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f3452-a937-46fc-8233-efa32708990b None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:28.475941 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f3452-a937-46fc-8233-efa32708990b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:28.494420 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-355f3452-a937-46fc-8233-efa32708990b None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:28.496279 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-355f3452-a937-46fc-8233-efa32708990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:28.580667 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1100/2200] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:06:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:06:28.594808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3de66-f78c-43fc-b9aa-95d6a90c4086 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:28.596453 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-64f3de66-f78c-43fc-b9aa-95d6a90c4086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:28.655753 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3de66-f78c-43fc-b9aa-95d6a90c4086 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:28.659534 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e57900-8343-4066-8e13-b0a34978e7c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:28.660425 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e57900-8343-4066-8e13-b0a34978e7c4 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:28.660767 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e57900-8343-4066-8e13-b0a34978e7c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:28.660993 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e57900-8343-4066-8e13-b0a34978e7c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:28.672420 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e57900-8343-4066-8e13-b0a34978e7c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:28.673459 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e57900-8343-4066-8e13-b0a34978e7c4 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:28.683409 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1101/2201] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:06:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:06:28.971732 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f3452-a937-46fc-8233-efa32708990b None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:28.973406 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-355f3452-a937-46fc-8233-efa32708990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:28.992875 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f3452-a937-46fc-8233-efa32708990b None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:28.998867 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2b95f-b1e0-48d1-9af5-2b688c6af6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:28.999927 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2b95f-b1e0-48d1-9af5-2b688c6af6ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:29.000148 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2b95f-b1e0-48d1-9af5-2b688c6af6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:29.000589 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2b95f-b1e0-48d1-9af5-2b688c6af6ec admin admin] PATH_INFO: `/v3/projects/081a7e63a6c74c848d5b08c29d1a94e7` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:29.001801 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2b95f-b1e0-48d1-9af5-2b688c6af6ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=081a7e63a6c74c848d5b08c29d1a94e7)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:29.003782 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2b95f-b1e0-48d1-9af5-2b688c6af6ec admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:29.050273 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-67e2b95f-b1e0-48d1-9af5-2b688c6af6ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '081a7e63a6c74c848d5b08c29d1a94e7', 'request_id': 'req-67e2b95f-b1e0-48d1-9af5-2b688c6af6ec'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:29.056917 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-67e2b95f-b1e0-48d1-9af5-2b688c6af6ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '081a7e63a6c74c848d5b08c29d1a94e7', 'request_id': 'req-67e2b95f-b1e0-48d1-9af5-2b688c6af6ec'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:29.062411 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-67e2b95f-b1e0-48d1-9af5-2b688c6af6ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '081a7e63a6c74c848d5b08c29d1a94e7', 'request_id': 'req-67e2b95f-b1e0-48d1-9af5-2b688c6af6ec'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:29.074300 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-67e2b95f-b1e0-48d1-9af5-2b688c6af6ec admin admin] The token cache is being invalidate because project 081a7e63a6c74c848d5b08c29d1a94e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:06:29.074591 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-67e2b95f-b1e0-48d1-9af5-2b688c6af6ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:29.075833 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-67e2b95f-b1e0-48d1-9af5-2b688c6af6ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:29.077382 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1101/2202] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:06:28 2021] DELETE /identity/v3/projects/081a7e63a6c74c848d5b08c29d1a94e7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:06:29.083129 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a18f95-887a-4396-a74a-910e4c1ed5b9 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:29.083450 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a18f95-887a-4396-a74a-910e4c1ed5b9 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:29.083729 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a18f95-887a-4396-a74a-910e4c1ed5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:29.101523 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-f6a18f95-887a-4396-a74a-910e4c1ed5b9 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:29.102712 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f6a18f95-887a-4396-a74a-910e4c1ed5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:29.164079 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1102/2203] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:06:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:06:29.173804 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce5b82-bdba-481a-bef7-0822062b0c81 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:29.174094 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce5b82-bdba-481a-bef7-0822062b0c81 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:29.174367 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce5b82-bdba-481a-bef7-0822062b0c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:29.192407 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-83ce5b82-bdba-481a-bef7-0822062b0c81 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:29.193639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-83ce5b82-bdba-481a-bef7-0822062b0c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:29.201556 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1102/2204] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:06:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:06:29.205946 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a18f95-887a-4396-a74a-910e4c1ed5b9 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:29.215474 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a18f95-887a-4396-a74a-910e4c1ed5b9 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:29.220638 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa3c8d-00dd-4a1c-9041-8eb5df611d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:29.221283 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa3c8d-00dd-4a1c-9041-8eb5df611d4e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:29.221567 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa3c8d-00dd-4a1c-9041-8eb5df611d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:29.221852 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa3c8d-00dd-4a1c-9041-8eb5df611d4e admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:29.222564 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa3c8d-00dd-4a1c-9041-8eb5df611d4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:06:29.222974 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa3c8d-00dd-4a1c-9041-8eb5df611d4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:29.224683 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa3c8d-00dd-4a1c-9041-8eb5df611d4e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:29.237909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1103/2205] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:06:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:06:29.242262 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce5b82-bdba-481a-bef7-0822062b0c81 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:29.251348 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce5b82-bdba-481a-bef7-0822062b0c81 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:29.256335 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e732cf-0433-4c37-a200-57af39ef274a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:29.256973 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e732cf-0433-4c37-a200-57af39ef274a admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:29.257256 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e732cf-0433-4c37-a200-57af39ef274a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:29.257533 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e732cf-0433-4c37-a200-57af39ef274a admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:29.258224 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e732cf-0433-4c37-a200-57af39ef274a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:29.260145 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e732cf-0433-4c37-a200-57af39ef274a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:29.287333 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1103/2206] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:06:29 2021] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:06:29.290060 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa3c8d-00dd-4a1c-9041-8eb5df611d4e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:29.300676 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa3c8d-00dd-4a1c-9041-8eb5df611d4e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:29.353952 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5763e8e-1a39-46c9-a917-96a636b2167d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:29.354659 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5763e8e-1a39-46c9-a917-96a636b2167d admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:29.354882 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5763e8e-1a39-46c9-a917-96a636b2167d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:29.355153 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5763e8e-1a39-46c9-a917-96a636b2167d admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:29.356090 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5763e8e-1a39-46c9-a917-96a636b2167d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:29.358785 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5763e8e-1a39-46c9-a917-96a636b2167d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:29.378532 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1104/2207] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:06:29 2021] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:06:29.382904 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e732cf-0433-4c37-a200-57af39ef274a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:29.393178 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e732cf-0433-4c37-a200-57af39ef274a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:29.397769 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3afa2f-9b4a-4bcd-83ed-fcc3731c1017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:29.398417 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3afa2f-9b4a-4bcd-83ed-fcc3731c1017 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:29.398697 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3afa2f-9b4a-4bcd-83ed-fcc3731c1017 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:29.398970 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3afa2f-9b4a-4bcd-83ed-fcc3731c1017 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:29.399724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3afa2f-9b4a-4bcd-83ed-fcc3731c1017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:29.401305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3afa2f-9b4a-4bcd-83ed-fcc3731c1017 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:29.414035 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1104/2208] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:06:29 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:06:29.418574 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5763e8e-1a39-46c9-a917-96a636b2167d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:29.430085 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5763e8e-1a39-46c9-a917-96a636b2167d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:29.435631 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bded4-f461-4c5c-b5e5-1aefdd12e650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:29.436298 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bded4-f461-4c5c-b5e5-1aefdd12e650 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:29.436585 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bded4-f461-4c5c-b5e5-1aefdd12e650 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:29.436865 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bded4-f461-4c5c-b5e5-1aefdd12e650 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:29.437587 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bded4-f461-4c5c-b5e5-1aefdd12e650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:29.439182 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bded4-f461-4c5c-b5e5-1aefdd12e650 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:29.450962 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1105/2209] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:06:29 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:06:29.454738 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3afa2f-9b4a-4bcd-83ed-fcc3731c1017 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:29.464723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3afa2f-9b4a-4bcd-83ed-fcc3731c1017 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:29.469785 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f7301-f234-4846-ba69-e366417f2fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:29.470747 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f7301-f234-4846-ba69-e366417f2fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:29.471030 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f7301-f234-4846-ba69-e366417f2fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:29.473488 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f7301-f234-4846-ba69-e366417f2fbb admin admin] PATH_INFO: `/v3/projects/3bb6d3ec2d034d1098558ec97069c416/users/84d7fc391ca94607a05c1a7a6031bb62/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:29.488795 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f7301-f234-4846-ba69-e366417f2fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb6d3ec2d034d1098558ec97069c416, user_id=84d7fc391ca94607a05c1a7a6031bb62, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:29.491458 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f7301-f234-4846-ba69-e366417f2fbb admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:29.504893 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1105/2210] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:06:29 2021] PUT /identity/v3/projects/3bb6d3ec2d034d1098558ec97069c416/users/84d7fc391ca94607a05c1a7a6031bb62/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:06:29.515321 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a9c21-388c-4197-9bfc-0e0d764d2ec2 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:29.515846 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a9c21-388c-4197-9bfc-0e0d764d2ec2 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:29.515968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a9c21-388c-4197-9bfc-0e0d764d2ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:29.542171 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-308a9c21-388c-4197-9bfc-0e0d764d2ec2 None None] MFA Rules not processed for user `84d7fc391ca94607a05c1a7a6031bb62`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:29.543396 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-308a9c21-388c-4197-9bfc-0e0d764d2ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:29.609860 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1106/2211] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:06:29 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:06:29.611259 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f7301-f234-4846-ba69-e366417f2fbb admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:29.675174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f7301-f234-4846-ba69-e366417f2fbb admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:29.679806 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f575710-a573-4033-89e8-b59cbbea43ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:29.680455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f575710-a573-4033-89e8-b59cbbea43ca admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:29.680737 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f575710-a573-4033-89e8-b59cbbea43ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:29.681012 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f575710-a573-4033-89e8-b59cbbea43ca admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:29.681727 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f575710-a573-4033-89e8-b59cbbea43ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:29.683649 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f575710-a573-4033-89e8-b59cbbea43ca admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:29.711570 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1106/2212] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:06:29 2021] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:06:29.714989 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a9c21-388c-4197-9bfc-0e0d764d2ec2 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:29.728260 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a9c21-388c-4197-9bfc-0e0d764d2ec2 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:29.792906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef9672-66d6-4357-a820-ff77c62987d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:29.793608 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef9672-66d6-4357-a820-ff77c62987d0 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:29.793906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef9672-66d6-4357-a820-ff77c62987d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:29.794178 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef9672-66d6-4357-a820-ff77c62987d0 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:29.794861 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef9672-66d6-4357-a820-ff77c62987d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:29.796806 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef9672-66d6-4357-a820-ff77c62987d0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:29.818276 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1107/2213] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:06:29 2021] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:06:29.822375 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f575710-a573-4033-89e8-b59cbbea43ca admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:29.838717 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f575710-a573-4033-89e8-b59cbbea43ca admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:29.845301 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde3722-44cc-4157-b31f-f039abab743d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:29.845977 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde3722-44cc-4157-b31f-f039abab743d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:29.846262 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde3722-44cc-4157-b31f-f039abab743d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:29.846540 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde3722-44cc-4157-b31f-f039abab743d admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:29.847268 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde3722-44cc-4157-b31f-f039abab743d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:29.848894 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde3722-44cc-4157-b31f-f039abab743d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:29.863404 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1107/2214] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:06:29 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:06:29.864661 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef9672-66d6-4357-a820-ff77c62987d0 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:29.875539 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef9672-66d6-4357-a820-ff77c62987d0 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:29.881178 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56706c1-97a2-4c30-8c01-c7fb28406f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:29.881855 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56706c1-97a2-4c30-8c01-c7fb28406f2d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:29.882132 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56706c1-97a2-4c30-8c01-c7fb28406f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:29.882403 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56706c1-97a2-4c30-8c01-c7fb28406f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:29.883124 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56706c1-97a2-4c30-8c01-c7fb28406f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:29.884748 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56706c1-97a2-4c30-8c01-c7fb28406f2d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:29.895759 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1108/2215] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:06:29 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:06:29.899726 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde3722-44cc-4157-b31f-f039abab743d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:29.909541 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde3722-44cc-4157-b31f-f039abab743d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:29.914239 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1b8f6-b963-4579-95ac-b7778160e35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:29.915182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1b8f6-b963-4579-95ac-b7778160e35d admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:29.915495 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1b8f6-b963-4579-95ac-b7778160e35d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:29.915774 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1b8f6-b963-4579-95ac-b7778160e35d admin admin] PATH_INFO: `/v3/projects/540bf3d17b6640cfa88c25e0cbcaf191/users/e8d26ae75c0a4e3da825e43e8739896e/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:29.932166 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1b8f6-b963-4579-95ac-b7778160e35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=540bf3d17b6640cfa88c25e0cbcaf191, user_id=e8d26ae75c0a4e3da825e43e8739896e, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:29.935229 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1b8f6-b963-4579-95ac-b7778160e35d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:29.947840 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1108/2216] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:06:29 2021] PUT /identity/v3/projects/540bf3d17b6640cfa88c25e0cbcaf191/users/e8d26ae75c0a4e3da825e43e8739896e/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:06:29.958824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa4476-9787-439b-8e11-c921590030a4 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:29.959120 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa4476-9787-439b-8e11-c921590030a4 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:29.959424 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa4476-9787-439b-8e11-c921590030a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:29.986934 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-effa4476-9787-439b-8e11-c921590030a4 None None] MFA Rules not processed for user `e8d26ae75c0a4e3da825e43e8739896e`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:29.988195 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-effa4476-9787-439b-8e11-c921590030a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:30.054884 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1109/2217] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:06:29 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:06:30.060025 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1b8f6-b963-4579-95ac-b7778160e35d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:30.120331 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1b8f6-b963-4579-95ac-b7778160e35d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:30.125018 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f901e8-f3a0-410f-a221-255d9a77b332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:30.125674 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f901e8-f3a0-410f-a221-255d9a77b332 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:30.125974 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f901e8-f3a0-410f-a221-255d9a77b332 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:30.126247 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f901e8-f3a0-410f-a221-255d9a77b332 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:30.126929 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f901e8-f3a0-410f-a221-255d9a77b332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:30.128879 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f901e8-f3a0-410f-a221-255d9a77b332 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:30.154259 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1109/2218] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:06:30 2021] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:06:30.158296 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa4476-9787-439b-8e11-c921590030a4 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:30.169463 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa4476-9787-439b-8e11-c921590030a4 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:30.225477 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869ae79-96ed-48f1-a98f-916ac0dbc21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:30.226065 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869ae79-96ed-48f1-a98f-916ac0dbc21f admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:30.226360 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869ae79-96ed-48f1-a98f-916ac0dbc21f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:30.226615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869ae79-96ed-48f1-a98f-916ac0dbc21f admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:30.227322 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869ae79-96ed-48f1-a98f-916ac0dbc21f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:30.229250 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869ae79-96ed-48f1-a98f-916ac0dbc21f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:30.250135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1110/2219] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:06:30 2021] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:06:30.253649 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f901e8-f3a0-410f-a221-255d9a77b332 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:30.264442 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f901e8-f3a0-410f-a221-255d9a77b332 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:30.269096 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2f97b-6423-42fc-9c10-94247557f168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:30.269748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2f97b-6423-42fc-9c10-94247557f168 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:30.270032 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2f97b-6423-42fc-9c10-94247557f168 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:30.270308 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2f97b-6423-42fc-9c10-94247557f168 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:30.271061 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2f97b-6423-42fc-9c10-94247557f168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:30.272684 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2f97b-6423-42fc-9c10-94247557f168 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:30.283707 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1110/2220] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:06:30 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:06:30.287756 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869ae79-96ed-48f1-a98f-916ac0dbc21f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:30.297917 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869ae79-96ed-48f1-a98f-916ac0dbc21f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:30.302591 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb54f5-98c6-4d3a-9497-a3b63d6980ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:30.303501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb54f5-98c6-4d3a-9497-a3b63d6980ce admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:30.303787 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb54f5-98c6-4d3a-9497-a3b63d6980ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:30.304065 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb54f5-98c6-4d3a-9497-a3b63d6980ce admin admin] PATH_INFO: `/v3/projects/5239486920164119a95d62023d271bcc/users/420f01c9219b481ca01f9ad1c2cfbee2/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:30.318821 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb54f5-98c6-4d3a-9497-a3b63d6980ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=5239486920164119a95d62023d271bcc, user_id=420f01c9219b481ca01f9ad1c2cfbee2, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:30.321574 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb54f5-98c6-4d3a-9497-a3b63d6980ce admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:30.334928 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1111/2221] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:06:30 2021] PUT /identity/v3/projects/5239486920164119a95d62023d271bcc/users/420f01c9219b481ca01f9ad1c2cfbee2/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:06:30.338917 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2f97b-6423-42fc-9c10-94247557f168 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:30.349269 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2f97b-6423-42fc-9c10-94247557f168 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:30.403025 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26592887-e2f3-4224-8864-e1a5c1109d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:30.404484 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26592887-e2f3-4224-8864-e1a5c1109d74 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:30.405529 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26592887-e2f3-4224-8864-e1a5c1109d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:30.405857 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26592887-e2f3-4224-8864-e1a5c1109d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:30.406616 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26592887-e2f3-4224-8864-e1a5c1109d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:30.408294 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26592887-e2f3-4224-8864-e1a5c1109d74 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:30.418735 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1111/2222] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:06:30 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:06:30.424565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb54f5-98c6-4d3a-9497-a3b63d6980ce admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:30.433917 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb54f5-98c6-4d3a-9497-a3b63d6980ce admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:30.438788 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df0aa0-c940-44a0-9828-e3ee266be631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:30.439727 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df0aa0-c940-44a0-9828-e3ee266be631 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:30.440014 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df0aa0-c940-44a0-9828-e3ee266be631 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:30.440290 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df0aa0-c940-44a0-9828-e3ee266be631 admin admin] PATH_INFO: `/v3/projects/5239486920164119a95d62023d271bcc/users/420f01c9219b481ca01f9ad1c2cfbee2/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:30.442282 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df0aa0-c940-44a0-9828-e3ee266be631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5239486920164119a95d62023d271bcc, user_id=420f01c9219b481ca01f9ad1c2cfbee2, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:30.444982 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df0aa0-c940-44a0-9828-e3ee266be631 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:30.455591 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1112/2223] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:06:30 2021] PUT /identity/v3/projects/5239486920164119a95d62023d271bcc/users/420f01c9219b481ca01f9ad1c2cfbee2/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:06:30.467526 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338e34e-8eef-46f7-8147-70f781f4ed63 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:30.467819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338e34e-8eef-46f7-8147-70f781f4ed63 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:30.468095 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338e34e-8eef-46f7-8147-70f781f4ed63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:30.493834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-8338e34e-8eef-46f7-8147-70f781f4ed63 None None] MFA Rules not processed for user `420f01c9219b481ca01f9ad1c2cfbee2`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:30.494929 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-8338e34e-8eef-46f7-8147-70f781f4ed63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:30.563526 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1112/2224] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:06:30 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:06:30.574639 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df0aa0-c940-44a0-9828-e3ee266be631 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:30.577294 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-73df0aa0-c940-44a0-9828-e3ee266be631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:30.635371 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df0aa0-c940-44a0-9828-e3ee266be631 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:30.639835 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bb2b9-bbf1-4c8a-adb9-f57e5c94acdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:30.640480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bb2b9-bbf1-4c8a-adb9-f57e5c94acdd service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:30.640755 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bb2b9-bbf1-4c8a-adb9-f57e5c94acdd service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:30.641029 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bb2b9-bbf1-4c8a-adb9-f57e5c94acdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:30.701905 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bb2b9-bbf1-4c8a-adb9-f57e5c94acdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:30.703347 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bb2b9-bbf1-4c8a-adb9-f57e5c94acdd service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:30.714903 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1113/2225] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:06:30 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:06:32.231312 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338e34e-8eef-46f7-8147-70f781f4ed63 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:32.242552 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338e34e-8eef-46f7-8147-70f781f4ed63 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:32.246149 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680d925-0031-4264-809c-f6478ec1ce1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:32.246821 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680d925-0031-4264-809c-f6478ec1ce1d service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:32.247105 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680d925-0031-4264-809c-f6478ec1ce1d service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:32.247404 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680d925-0031-4264-809c-f6478ec1ce1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:32.302858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680d925-0031-4264-809c-f6478ec1ce1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:32.304425 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680d925-0031-4264-809c-f6478ec1ce1d service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:32.314158 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1113/2226] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:06:32 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:06:32.868430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bb2b9-bbf1-4c8a-adb9-f57e5c94acdd service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:32.869822 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-aa3bb2b9-bbf1-4c8a-adb9-f57e5c94acdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:32.881688 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bb2b9-bbf1-4c8a-adb9-f57e5c94acdd service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:32.885366 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283f0ad-4575-4572-970c-48247ac06460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:32.886011 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283f0ad-4575-4572-970c-48247ac06460 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:32.886293 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283f0ad-4575-4572-970c-48247ac06460 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:32.886569 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283f0ad-4575-4572-970c-48247ac06460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:32.896263 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283f0ad-4575-4572-970c-48247ac06460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:32.897691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283f0ad-4575-4572-970c-48247ac06460 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:32.907853 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1114/2227] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:06:32 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:06:36.793136 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680d925-0031-4264-809c-f6478ec1ce1d service cinder] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:36.860940 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680d925-0031-4264-809c-f6478ec1ce1d service cinder] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:36.867127 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adfb13-bced-4fce-ac5c-9f49b2e6e7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:36.868443 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adfb13-bced-4fce-ac5c-9f49b2e6e7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:36.868839 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adfb13-bced-4fce-ac5c-9f49b2e6e7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:36.869219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adfb13-bced-4fce-ac5c-9f49b2e6e7d1 admin admin] PATH_INFO: `/v3/users/84d7fc391ca94607a05c1a7a6031bb62` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:36.870846 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adfb13-bced-4fce-ac5c-9f49b2e6e7d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d7fc391ca94607a05c1a7a6031bb62)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:36.874367 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adfb13-bced-4fce-ac5c-9f49b2e6e7d1 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:36.933154 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-01adfb13-bced-4fce-ac5c-9f49b2e6e7d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d7fc391ca94607a05c1a7a6031bb62'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:36.933805 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-01adfb13-bced-4fce-ac5c-9f49b2e6e7d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d7fc391ca94607a05c1a7a6031bb62'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:36.934411 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-01adfb13-bced-4fce-ac5c-9f49b2e6e7d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d7fc391ca94607a05c1a7a6031bb62'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:36.952889 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-01adfb13-bced-4fce-ac5c-9f49b2e6e7d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d7fc391ca94607a05c1a7a6031bb62'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:36.961045 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-01adfb13-bced-4fce-ac5c-9f49b2e6e7d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d7fc391ca94607a05c1a7a6031bb62'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:36.981236 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1114/2228] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:06:36 2021] DELETE /identity/v3/users/84d7fc391ca94607a05c1a7a6031bb62 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:06:36.987112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bf4a8-d015-4d2f-a24b-3ee95fb8f349 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:36.987751 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bf4a8-d015-4d2f-a24b-3ee95fb8f349 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:36.987751 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bf4a8-d015-4d2f-a24b-3ee95fb8f349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:37.006059 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-326bf4a8-d015-4d2f-a24b-3ee95fb8f349 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:37.019205 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-326bf4a8-d015-4d2f-a24b-3ee95fb8f349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:37.099225 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1115/2229] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:06:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:06:37.110275 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adfb13-bced-4fce-ac5c-9f49b2e6e7d1 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:37.111812 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-01adfb13-bced-4fce-ac5c-9f49b2e6e7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:37.172853 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adfb13-bced-4fce-ac5c-9f49b2e6e7d1 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:37.176656 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d468b70-e189-4dcd-a802-c20f4eb0b174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:37.177326 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d468b70-e189-4dcd-a802-c20f4eb0b174 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:37.177605 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d468b70-e189-4dcd-a802-c20f4eb0b174 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:37.177879 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d468b70-e189-4dcd-a802-c20f4eb0b174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:37.188410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d468b70-e189-4dcd-a802-c20f4eb0b174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:37.189966 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d468b70-e189-4dcd-a802-c20f4eb0b174 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:37.200909 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1115/2230] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:06:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:06:37.525174 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bf4a8-d015-4d2f-a24b-3ee95fb8f349 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:37.526648 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-326bf4a8-d015-4d2f-a24b-3ee95fb8f349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:37.543440 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bf4a8-d015-4d2f-a24b-3ee95fb8f349 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:37.549437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f95179-22be-4972-9190-ef9830b20902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:37.550331 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f95179-22be-4972-9190-ef9830b20902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:37.550671 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f95179-22be-4972-9190-ef9830b20902 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:37.550966 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f95179-22be-4972-9190-ef9830b20902 admin admin] PATH_INFO: `/v3/projects/3bb6d3ec2d034d1098558ec97069c416` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:37.552268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f95179-22be-4972-9190-ef9830b20902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb6d3ec2d034d1098558ec97069c416)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:37.554515 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f95179-22be-4972-9190-ef9830b20902 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:37.602737 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-e3f95179-22be-4972-9190-ef9830b20902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb6d3ec2d034d1098558ec97069c416', 'request_id': 'req-e3f95179-22be-4972-9190-ef9830b20902'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:37.608663 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-e3f95179-22be-4972-9190-ef9830b20902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb6d3ec2d034d1098558ec97069c416', 'request_id': 'req-e3f95179-22be-4972-9190-ef9830b20902'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:37.618756 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-e3f95179-22be-4972-9190-ef9830b20902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb6d3ec2d034d1098558ec97069c416', 'request_id': 'req-e3f95179-22be-4972-9190-ef9830b20902'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:37.630599 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-e3f95179-22be-4972-9190-ef9830b20902 admin admin] The token cache is being invalidate because project 3bb6d3ec2d034d1098558ec97069c416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:06:37.630885 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-e3f95179-22be-4972-9190-ef9830b20902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:37.631539 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-e3f95179-22be-4972-9190-ef9830b20902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:37.633044 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1116/2231] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:06:37 2021] DELETE /identity/v3/projects/3bb6d3ec2d034d1098558ec97069c416 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:06:37.637037 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d468b70-e189-4dcd-a802-c20f4eb0b174 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:37.648288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d468b70-e189-4dcd-a802-c20f4eb0b174 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:37.706851 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a72122-1120-480f-8548-862559206a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:37.707755 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a72122-1120-480f-8548-862559206a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:37.708040 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a72122-1120-480f-8548-862559206a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:37.708318 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a72122-1120-480f-8548-862559206a70 admin admin] PATH_INFO: `/v3/users/e8d26ae75c0a4e3da825e43e8739896e` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:37.709500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a72122-1120-480f-8548-862559206a70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8d26ae75c0a4e3da825e43e8739896e)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:37.711458 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a72122-1120-480f-8548-862559206a70 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:37.760346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e3a72122-1120-480f-8548-862559206a70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8d26ae75c0a4e3da825e43e8739896e'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:37.761181 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e3a72122-1120-480f-8548-862559206a70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8d26ae75c0a4e3da825e43e8739896e'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:37.761948 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e3a72122-1120-480f-8548-862559206a70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8d26ae75c0a4e3da825e43e8739896e'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:37.774886 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e3a72122-1120-480f-8548-862559206a70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8d26ae75c0a4e3da825e43e8739896e'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:37.782104 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e3a72122-1120-480f-8548-862559206a70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8d26ae75c0a4e3da825e43e8739896e'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:37.794170 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1116/2232] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:06:37 2021] DELETE /identity/v3/users/e8d26ae75c0a4e3da825e43e8739896e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:06:38.159974 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f95179-22be-4972-9190-ef9830b20902 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:38.162143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-e3f95179-22be-4972-9190-ef9830b20902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:38.179170 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f95179-22be-4972-9190-ef9830b20902 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:38.243659 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3025eca-7dd5-4fd7-aeb8-458776e94941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:38.244656 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3025eca-7dd5-4fd7-aeb8-458776e94941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:38.245137 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3025eca-7dd5-4fd7-aeb8-458776e94941 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:38.245661 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3025eca-7dd5-4fd7-aeb8-458776e94941 admin admin] PATH_INFO: `/v3/projects/540bf3d17b6640cfa88c25e0cbcaf191` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:38.246952 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3025eca-7dd5-4fd7-aeb8-458776e94941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=540bf3d17b6640cfa88c25e0cbcaf191)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:38.252451 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3025eca-7dd5-4fd7-aeb8-458776e94941 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:38.329508 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-a3025eca-7dd5-4fd7-aeb8-458776e94941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '540bf3d17b6640cfa88c25e0cbcaf191', 'request_id': 'req-a3025eca-7dd5-4fd7-aeb8-458776e94941'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:38.334967 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-a3025eca-7dd5-4fd7-aeb8-458776e94941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '540bf3d17b6640cfa88c25e0cbcaf191', 'request_id': 'req-a3025eca-7dd5-4fd7-aeb8-458776e94941'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:38.368773 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-a3025eca-7dd5-4fd7-aeb8-458776e94941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '540bf3d17b6640cfa88c25e0cbcaf191', 'request_id': 'req-a3025eca-7dd5-4fd7-aeb8-458776e94941'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:38.389758 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-a3025eca-7dd5-4fd7-aeb8-458776e94941 admin admin] The token cache is being invalidate because project 540bf3d17b6640cfa88c25e0cbcaf191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:06:38.390081 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-a3025eca-7dd5-4fd7-aeb8-458776e94941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:38.390724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-a3025eca-7dd5-4fd7-aeb8-458776e94941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:38.392326 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1117/2233] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:06:38 2021] DELETE /identity/v3/projects/540bf3d17b6640cfa88c25e0cbcaf191 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:06:38.396244 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a72122-1120-480f-8548-862559206a70 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:38.397633 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-e3a72122-1120-480f-8548-862559206a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:38.411521 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a72122-1120-480f-8548-862559206a70 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:38.472004 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4315de0-5275-4539-95ab-992610d4dbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:38.473074 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4315de0-5275-4539-95ab-992610d4dbf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:38.473363 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4315de0-5275-4539-95ab-992610d4dbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:38.473802 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4315de0-5275-4539-95ab-992610d4dbf6 admin admin] PATH_INFO: `/v3/users/420f01c9219b481ca01f9ad1c2cfbee2` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:38.475149 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4315de0-5275-4539-95ab-992610d4dbf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=420f01c9219b481ca01f9ad1c2cfbee2)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:38.477177 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4315de0-5275-4539-95ab-992610d4dbf6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:38.534257 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f4315de0-5275-4539-95ab-992610d4dbf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '420f01c9219b481ca01f9ad1c2cfbee2'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:38.534918 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f4315de0-5275-4539-95ab-992610d4dbf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '420f01c9219b481ca01f9ad1c2cfbee2'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:38.535576 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f4315de0-5275-4539-95ab-992610d4dbf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '420f01c9219b481ca01f9ad1c2cfbee2'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:38.549583 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f4315de0-5275-4539-95ab-992610d4dbf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '420f01c9219b481ca01f9ad1c2cfbee2'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:38.556743 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f4315de0-5275-4539-95ab-992610d4dbf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '420f01c9219b481ca01f9ad1c2cfbee2'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:38.569114 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1117/2234] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:06:38 2021] DELETE /identity/v3/users/420f01c9219b481ca01f9ad1c2cfbee2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:06:39.089356 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3025eca-7dd5-4fd7-aeb8-458776e94941 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:39.090787 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a3025eca-7dd5-4fd7-aeb8-458776e94941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:39.108947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3025eca-7dd5-4fd7-aeb8-458776e94941 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:39.178112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e420d7f-54c1-4c0b-bf00-35aea33afc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:39.179544 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e420d7f-54c1-4c0b-bf00-35aea33afc1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:39.180035 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e420d7f-54c1-4c0b-bf00-35aea33afc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:39.180614 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e420d7f-54c1-4c0b-bf00-35aea33afc1c admin admin] PATH_INFO: `/v3/projects/5239486920164119a95d62023d271bcc` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:39.182909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e420d7f-54c1-4c0b-bf00-35aea33afc1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5239486920164119a95d62023d271bcc)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:39.187153 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e420d7f-54c1-4c0b-bf00-35aea33afc1c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:39.250757 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-8e420d7f-54c1-4c0b-bf00-35aea33afc1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5239486920164119a95d62023d271bcc', 'request_id': 'req-8e420d7f-54c1-4c0b-bf00-35aea33afc1c'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:39.257087 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-8e420d7f-54c1-4c0b-bf00-35aea33afc1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5239486920164119a95d62023d271bcc', 'request_id': 'req-8e420d7f-54c1-4c0b-bf00-35aea33afc1c'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:39.265751 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-8e420d7f-54c1-4c0b-bf00-35aea33afc1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5239486920164119a95d62023d271bcc', 'request_id': 'req-8e420d7f-54c1-4c0b-bf00-35aea33afc1c'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:39.277766 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-8e420d7f-54c1-4c0b-bf00-35aea33afc1c admin admin] The token cache is being invalidate because project 5239486920164119a95d62023d271bcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:06:39.278137 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-8e420d7f-54c1-4c0b-bf00-35aea33afc1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:39.278962 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-8e420d7f-54c1-4c0b-bf00-35aea33afc1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:39.280771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1118/2235] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:06:39 2021] DELETE /identity/v3/projects/5239486920164119a95d62023d271bcc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:06:39.642921 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde432b-5a1c-4ac3-ab81-8c7541a0fb16 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:39.643346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde432b-5a1c-4ac3-ab81-8c7541a0fb16 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:39.643716 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde432b-5a1c-4ac3-ab81-8c7541a0fb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:39.663481 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-0dde432b-5a1c-4ac3-ab81-8c7541a0fb16 None None] MFA Rules not processed for user `b1918e2aa8f24655875480ef52df324d`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:39.664362 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0dde432b-5a1c-4ac3-ab81-8c7541a0fb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:39.725594 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1118/2236] 10.222.0.39 () {58 vars in 968 bytes} [Tue Aug 31 03:06:39 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:06:39.740582 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e420d7f-54c1-4c0b-bf00-35aea33afc1c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:39.741959 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-8e420d7f-54c1-4c0b-bf00-35aea33afc1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:39.821785 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e420d7f-54c1-4c0b-bf00-35aea33afc1c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:39.827060 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5f126-69a5-4249-a41a-611da4dc3aac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ed84d2e3ce4c85b552732f3294aac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:39.827729 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5f126-69a5-4249-a41a-611da4dc3aac service swift] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:39.828008 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5f126-69a5-4249-a41a-611da4dc3aac service swift] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:39.828279 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5f126-69a5-4249-a41a-611da4dc3aac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:39.837715 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5f126-69a5-4249-a41a-611da4dc3aac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:39.839330 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5f126-69a5-4249-a41a-611da4dc3aac service swift] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:39.849264 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1119/2237] 10.222.0.39 () {60 vars in 1385 bytes} [Tue Aug 31 03:06:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 03:06:41.896365 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde432b-5a1c-4ac3-ab81-8c7541a0fb16 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:41.898028 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0dde432b-5a1c-4ac3-ab81-8c7541a0fb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:41.961710 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde432b-5a1c-4ac3-ab81-8c7541a0fb16 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:41.966156 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc127c-b9ae-4e94-98d3-520334a5ed98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:41.967009 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc127c-b9ae-4e94-98d3-520334a5ed98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:41.967292 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc127c-b9ae-4e94-98d3-520334a5ed98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:41.967595 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc127c-b9ae-4e94-98d3-520334a5ed98 admin admin] PATH_INFO: `/v3/users/c7bbc84e02454949a8936c856f19bace` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:41.969013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc127c-b9ae-4e94-98d3-520334a5ed98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7bbc84e02454949a8936c856f19bace)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:41.970947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc127c-b9ae-4e94-98d3-520334a5ed98 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:42.015120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a0bc127c-b9ae-4e94-98d3-520334a5ed98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7bbc84e02454949a8936c856f19bace'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:42.016359 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a0bc127c-b9ae-4e94-98d3-520334a5ed98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7bbc84e02454949a8936c856f19bace'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:42.016973 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a0bc127c-b9ae-4e94-98d3-520334a5ed98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7bbc84e02454949a8936c856f19bace'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:42.028350 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a0bc127c-b9ae-4e94-98d3-520334a5ed98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7bbc84e02454949a8936c856f19bace'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:42.037308 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a0bc127c-b9ae-4e94-98d3-520334a5ed98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7bbc84e02454949a8936c856f19bace'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:42.050132 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1119/2238] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:06:41 2021] DELETE /identity/v3/users/c7bbc84e02454949a8936c856f19bace => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:06:42.356664 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5f126-69a5-4249-a41a-611da4dc3aac service swift] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:42.367092 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5f126-69a5-4249-a41a-611da4dc3aac service swift] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:42.450740 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d2e6c-7dc1-4342-98b4-f1749d225e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:42.451639 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d2e6c-7dc1-4342-98b4-f1749d225e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:42.451920 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d2e6c-7dc1-4342-98b4-f1749d225e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:42.453922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d2e6c-7dc1-4342-98b4-f1749d225e69 admin admin] PATH_INFO: `/v3/projects/0b83cf6947e84bd288bbe7ae3d8a51ee` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:42.455257 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d2e6c-7dc1-4342-98b4-f1749d225e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b83cf6947e84bd288bbe7ae3d8a51ee)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:42.457206 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d2e6c-7dc1-4342-98b4-f1749d225e69 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:42.502916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-120d2e6c-7dc1-4342-98b4-f1749d225e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b83cf6947e84bd288bbe7ae3d8a51ee', 'request_id': 'req-120d2e6c-7dc1-4342-98b4-f1749d225e69'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:42.508651 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-120d2e6c-7dc1-4342-98b4-f1749d225e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b83cf6947e84bd288bbe7ae3d8a51ee', 'request_id': 'req-120d2e6c-7dc1-4342-98b4-f1749d225e69'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:42.516994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-120d2e6c-7dc1-4342-98b4-f1749d225e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b83cf6947e84bd288bbe7ae3d8a51ee', 'request_id': 'req-120d2e6c-7dc1-4342-98b4-f1749d225e69'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:42.528340 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-120d2e6c-7dc1-4342-98b4-f1749d225e69 admin admin] The token cache is being invalidate because project 0b83cf6947e84bd288bbe7ae3d8a51ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:06:42.528692 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-120d2e6c-7dc1-4342-98b4-f1749d225e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:42.529266 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-120d2e6c-7dc1-4342-98b4-f1749d225e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:06:42.531828 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1120/2239] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:06:42 2021] DELETE /identity/v3/projects/0b83cf6947e84bd288bbe7ae3d8a51ee => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:06:42.537374 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a4e09-a8eb-4c9a-96ec-067777c7770d None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:42.537660 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a4e09-a8eb-4c9a-96ec-067777c7770d None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:42.537933 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a4e09-a8eb-4c9a-96ec-067777c7770d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:42.558490 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-e47a4e09-a8eb-4c9a-96ec-067777c7770d None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:42.560336 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-e47a4e09-a8eb-4c9a-96ec-067777c7770d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:42.644840 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1120/2240] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:06:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:06:42.653059 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd3587-b5f0-43aa-8742-dba19e183d06 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:42.653408 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd3587-b5f0-43aa-8742-dba19e183d06 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:42.653687 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd3587-b5f0-43aa-8742-dba19e183d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:42.687972 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-cfcd3587-b5f0-43aa-8742-dba19e183d06 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:42.689710 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-cfcd3587-b5f0-43aa-8742-dba19e183d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:42.699861 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1121/2241] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:06:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:06:42.704702 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a4e09-a8eb-4c9a-96ec-067777c7770d None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:42.714941 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a4e09-a8eb-4c9a-96ec-067777c7770d None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:42.721437 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6f5d4-a1f9-4b3b-abbc-6505298a6cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:42.722104 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6f5d4-a1f9-4b3b-abbc-6505298a6cdf admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:42.722382 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6f5d4-a1f9-4b3b-abbc-6505298a6cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:42.722663 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6f5d4-a1f9-4b3b-abbc-6505298a6cdf admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:42.723414 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6f5d4-a1f9-4b3b-abbc-6505298a6cdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:06:42.723722 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6f5d4-a1f9-4b3b-abbc-6505298a6cdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:42.725576 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6f5d4-a1f9-4b3b-abbc-6505298a6cdf admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:42.752850 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1121/2242] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:06:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:06:42.757196 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd3587-b5f0-43aa-8742-dba19e183d06 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:42.768020 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd3587-b5f0-43aa-8742-dba19e183d06 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:42.773150 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bcf04-98a7-47dd-8790-6a3ad9b9ad35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:42.773811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bcf04-98a7-47dd-8790-6a3ad9b9ad35 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:42.774095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bcf04-98a7-47dd-8790-6a3ad9b9ad35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:42.774369 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bcf04-98a7-47dd-8790-6a3ad9b9ad35 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:42.775236 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bcf04-98a7-47dd-8790-6a3ad9b9ad35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:42.777206 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bcf04-98a7-47dd-8790-6a3ad9b9ad35 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:42.812722 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1122/2243] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:06:42 2021] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:06:42.817069 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6f5d4-a1f9-4b3b-abbc-6505298a6cdf admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:42.827957 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6f5d4-a1f9-4b3b-abbc-6505298a6cdf admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:42.888797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb8ba5-c0d4-4a1b-b27e-bb4d9afc8800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:42.889470 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb8ba5-c0d4-4a1b-b27e-bb4d9afc8800 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:42.889754 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb8ba5-c0d4-4a1b-b27e-bb4d9afc8800 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:42.890037 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb8ba5-c0d4-4a1b-b27e-bb4d9afc8800 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:42.890879 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb8ba5-c0d4-4a1b-b27e-bb4d9afc8800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:42.892842 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb8ba5-c0d4-4a1b-b27e-bb4d9afc8800 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:42.920652 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1122/2244] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:06:42 2021] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:06:42.925523 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bcf04-98a7-47dd-8790-6a3ad9b9ad35 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:42.935846 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bcf04-98a7-47dd-8790-6a3ad9b9ad35 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:42.940728 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef098900-177d-47d7-b3a5-abb0a5ee0689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:42.941383 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef098900-177d-47d7-b3a5-abb0a5ee0689 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:42.941667 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef098900-177d-47d7-b3a5-abb0a5ee0689 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:42.941945 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef098900-177d-47d7-b3a5-abb0a5ee0689 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:42.942815 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef098900-177d-47d7-b3a5-abb0a5ee0689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:42.944431 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef098900-177d-47d7-b3a5-abb0a5ee0689 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:42.956517 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1123/2245] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:06:42 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:06:42.960507 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb8ba5-c0d4-4a1b-b27e-bb4d9afc8800 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:42.970808 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb8ba5-c0d4-4a1b-b27e-bb4d9afc8800 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:42.975353 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe4136-ef45-4617-99fc-f2c8c7c7ca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:42.976041 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe4136-ef45-4617-99fc-f2c8c7c7ca7f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:42.976327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe4136-ef45-4617-99fc-f2c8c7c7ca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:42.976604 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe4136-ef45-4617-99fc-f2c8c7c7ca7f admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:42.977323 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe4136-ef45-4617-99fc-f2c8c7c7ca7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:42.978944 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe4136-ef45-4617-99fc-f2c8c7c7ca7f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:42.988596 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1123/2246] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:06:42 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:06:42.992470 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef098900-177d-47d7-b3a5-abb0a5ee0689 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:43.002297 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef098900-177d-47d7-b3a5-abb0a5ee0689 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:43.007325 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14e06d-c82f-4147-9dc3-c63d74d38252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:43.008165 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14e06d-c82f-4147-9dc3-c63d74d38252 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:43.008441 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14e06d-c82f-4147-9dc3-c63d74d38252 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:43.008714 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14e06d-c82f-4147-9dc3-c63d74d38252 admin admin] PATH_INFO: `/v3/projects/37da423f787d4271945189638ce213ea/users/1ffd3cf445d34d96ae2f3162de6170b6/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:43.023049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14e06d-c82f-4147-9dc3-c63d74d38252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37da423f787d4271945189638ce213ea, user_id=1ffd3cf445d34d96ae2f3162de6170b6, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:43.025709 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14e06d-c82f-4147-9dc3-c63d74d38252 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:43.038198 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1124/2247] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:06:42 2021] PUT /identity/v3/projects/37da423f787d4271945189638ce213ea/users/1ffd3cf445d34d96ae2f3162de6170b6/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:06:43.048672 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0a60d-72c3-4df2-bfb2-811a0553e1dd None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:43.048961 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0a60d-72c3-4df2-bfb2-811a0553e1dd None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:43.049241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0a60d-72c3-4df2-bfb2-811a0553e1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:43.075074 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-52f0a60d-72c3-4df2-bfb2-811a0553e1dd None None] MFA Rules not processed for user `1ffd3cf445d34d96ae2f3162de6170b6`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:43.076315 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-52f0a60d-72c3-4df2-bfb2-811a0553e1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:43.138806 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1124/2248] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:06:43 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:06:43.150961 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14e06d-c82f-4147-9dc3-c63d74d38252 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:06:43.152646 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-bc14e06d-c82f-4147-9dc3-c63d74d38252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:43.211733 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14e06d-c82f-4147-9dc3-c63d74d38252 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:06:43.216820 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ae287-3c17-4656-8ace-648a5fad4981 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d763da11c58473c9c2cf981b02835f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:06:43.217465 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ae287-3c17-4656-8ace-648a5fad4981 service glance] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:43.218075 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ae287-3c17-4656-8ace-648a5fad4981 service glance] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:43.218075 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ae287-3c17-4656-8ace-648a5fad4981 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:43.235933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ae287-3c17-4656-8ace-648a5fad4981 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:06:43.237384 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ae287-3c17-4656-8ace-648a5fad4981 service glance] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:06:43.247793 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1125/2249] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:06:43 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:06:47.771410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c7cb1-568f-44bb-b7dd-88ecd8cb3297 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:06:47.772331 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c7cb1-568f-44bb-b7dd-88ecd8cb3297 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:06:47.772612 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c7cb1-568f-44bb-b7dd-88ecd8cb3297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:06:47.791119 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-113c7cb1-568f-44bb-b7dd-88ecd8cb3297 None None] MFA Rules not processed for user `863e1031965a4bba82d345acb07e5856`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:06:47.792715 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-113c7cb1-568f-44bb-b7dd-88ecd8cb3297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:06:47.853055 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1125/2250] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:06:47 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:03.780125 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ae287-3c17-4656-8ace-648a5fad4981 service glance] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:03.781592 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-282ae287-3c17-4656-8ace-648a5fad4981 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:03.905258 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ae287-3c17-4656-8ace-648a5fad4981 service glance] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:03.910578 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe666b6-1698-417f-baf6-a1a371c7dc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:03.911393 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe666b6-1698-417f-baf6-a1a371c7dc16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:03.911695 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe666b6-1698-417f-baf6-a1a371c7dc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:03.911970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe666b6-1698-417f-baf6-a1a371c7dc16 admin admin] PATH_INFO: `/v3/users/361eb264d0a147e9879a758807cd3eed` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:03.913166 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe666b6-1698-417f-baf6-a1a371c7dc16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=361eb264d0a147e9879a758807cd3eed)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:03.915072 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe666b6-1698-417f-baf6-a1a371c7dc16 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:03.964095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-bfe666b6-1698-417f-baf6-a1a371c7dc16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '361eb264d0a147e9879a758807cd3eed'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:03.976979 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-bfe666b6-1698-417f-baf6-a1a371c7dc16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '361eb264d0a147e9879a758807cd3eed'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:03.979244 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-bfe666b6-1698-417f-baf6-a1a371c7dc16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '361eb264d0a147e9879a758807cd3eed'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:03.988158 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-bfe666b6-1698-417f-baf6-a1a371c7dc16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '361eb264d0a147e9879a758807cd3eed'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:03.995875 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-bfe666b6-1698-417f-baf6-a1a371c7dc16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '361eb264d0a147e9879a758807cd3eed'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:04.003311 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1126/2251] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:07:03 2021] DELETE /identity/v3/users/361eb264d0a147e9879a758807cd3eed => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:04.195399 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c7cb1-568f-44bb-b7dd-88ecd8cb3297 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:04.233100 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c7cb1-568f-44bb-b7dd-88ecd8cb3297 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:04.286839 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca1489-02b5-4df3-b39f-e85b8c9411e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:04.287744 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca1489-02b5-4df3-b39f-e85b8c9411e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:04.288068 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca1489-02b5-4df3-b39f-e85b8c9411e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:04.288646 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca1489-02b5-4df3-b39f-e85b8c9411e8 admin admin] PATH_INFO: `/v3/projects/0060db79d68e4bb492cfc5e672c9d4a1` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:04.289946 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca1489-02b5-4df3-b39f-e85b8c9411e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0060db79d68e4bb492cfc5e672c9d4a1)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:04.291901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca1489-02b5-4df3-b39f-e85b8c9411e8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:04.342723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-25ca1489-02b5-4df3-b39f-e85b8c9411e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0060db79d68e4bb492cfc5e672c9d4a1', 'request_id': 'req-25ca1489-02b5-4df3-b39f-e85b8c9411e8'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:04.350107 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-25ca1489-02b5-4df3-b39f-e85b8c9411e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0060db79d68e4bb492cfc5e672c9d4a1', 'request_id': 'req-25ca1489-02b5-4df3-b39f-e85b8c9411e8'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:04.358820 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-25ca1489-02b5-4df3-b39f-e85b8c9411e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0060db79d68e4bb492cfc5e672c9d4a1', 'request_id': 'req-25ca1489-02b5-4df3-b39f-e85b8c9411e8'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:04.372948 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-25ca1489-02b5-4df3-b39f-e85b8c9411e8 admin admin] The token cache is being invalidate because project 0060db79d68e4bb492cfc5e672c9d4a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:07:04.373235 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-25ca1489-02b5-4df3-b39f-e85b8c9411e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:04.374303 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-25ca1489-02b5-4df3-b39f-e85b8c9411e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:04.375854 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1126/2252] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:07:04 2021] DELETE /identity/v3/projects/0060db79d68e4bb492cfc5e672c9d4a1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:04.382372 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd40b5-58cf-4464-bce8-bc531238acf9 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:04.382658 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd40b5-58cf-4464-bce8-bc531238acf9 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:04.382962 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd40b5-58cf-4464-bce8-bc531238acf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:04.431247 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-29cd40b5-58cf-4464-bce8-bc531238acf9 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:04.432540 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-29cd40b5-58cf-4464-bce8-bc531238acf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:04.493724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1127/2253] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:04.501906 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fad98f-a631-4141-9bbb-884e34b203da None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:04.502401 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fad98f-a631-4141-9bbb-884e34b203da None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:04.502988 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fad98f-a631-4141-9bbb-884e34b203da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:04.522594 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-f6fad98f-a631-4141-9bbb-884e34b203da None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:04.524024 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f6fad98f-a631-4141-9bbb-884e34b203da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:04.532735 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1127/2254] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:04.537471 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd40b5-58cf-4464-bce8-bc531238acf9 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:04.547389 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd40b5-58cf-4464-bce8-bc531238acf9 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:04.553011 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c191a-ac4b-480a-aab6-db9835f4638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:04.553668 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c191a-ac4b-480a-aab6-db9835f4638f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:04.553951 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c191a-ac4b-480a-aab6-db9835f4638f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:04.554228 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c191a-ac4b-480a-aab6-db9835f4638f admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:04.554954 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c191a-ac4b-480a-aab6-db9835f4638f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:07:04.555259 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c191a-ac4b-480a-aab6-db9835f4638f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:04.556891 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c191a-ac4b-480a-aab6-db9835f4638f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:04.569076 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1128/2255] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:07:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:07:04.573519 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fad98f-a631-4141-9bbb-884e34b203da None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:04.583298 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fad98f-a631-4141-9bbb-884e34b203da None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:04.587928 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d0944-18ee-4c96-a883-ca01fa60fd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:04.588582 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d0944-18ee-4c96-a883-ca01fa60fd6a admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:04.588867 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d0944-18ee-4c96-a883-ca01fa60fd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:04.589145 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d0944-18ee-4c96-a883-ca01fa60fd6a admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:04.589830 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d0944-18ee-4c96-a883-ca01fa60fd6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:04.591751 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d0944-18ee-4c96-a883-ca01fa60fd6a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:04.618461 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1128/2256] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:07:04 2021] POST /identity/v3/projects => generated 357 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:04.622750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c191a-ac4b-480a-aab6-db9835f4638f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:04.633980 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c191a-ac4b-480a-aab6-db9835f4638f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:04.690081 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2859f-46ef-489a-8a18-678ccb6b554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:04.690741 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2859f-46ef-489a-8a18-678ccb6b554b admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:04.691021 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2859f-46ef-489a-8a18-678ccb6b554b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:04.691293 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2859f-46ef-489a-8a18-678ccb6b554b admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:04.691994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2859f-46ef-489a-8a18-678ccb6b554b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:04.694035 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2859f-46ef-489a-8a18-678ccb6b554b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:04.712911 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1129/2257] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:07:04 2021] POST /identity/v3/users => generated 279 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:04.716962 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d0944-18ee-4c96-a883-ca01fa60fd6a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:04.727590 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d0944-18ee-4c96-a883-ca01fa60fd6a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:04.732103 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c47af5-73c6-4768-8266-6381a7933aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:04.732747 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c47af5-73c6-4768-8266-6381a7933aea admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:04.733029 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c47af5-73c6-4768-8266-6381a7933aea admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:04.733297 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c47af5-73c6-4768-8266-6381a7933aea admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:04.734005 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c47af5-73c6-4768-8266-6381a7933aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:04.735598 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c47af5-73c6-4768-8266-6381a7933aea admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:04.746266 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1129/2258] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:04 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:04.750161 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2859f-46ef-489a-8a18-678ccb6b554b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:04.760045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2859f-46ef-489a-8a18-678ccb6b554b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:04.764637 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deb06e-aa79-43b7-afce-ba32ded803da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:04.765286 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deb06e-aa79-43b7-afce-ba32ded803da admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:04.765563 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deb06e-aa79-43b7-afce-ba32ded803da admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:04.765832 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deb06e-aa79-43b7-afce-ba32ded803da admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:04.766544 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09deb06e-aa79-43b7-afce-ba32ded803da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:04.768657 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09deb06e-aa79-43b7-afce-ba32ded803da admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:04.778234 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1130/2259] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:04 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:04.782654 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c47af5-73c6-4768-8266-6381a7933aea admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:04.798383 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c47af5-73c6-4768-8266-6381a7933aea admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:04.804218 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94f235-031a-4361-bc32-ff1b5a9fe9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:04.805090 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94f235-031a-4361-bc32-ff1b5a9fe9d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:04.805371 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94f235-031a-4361-bc32-ff1b5a9fe9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:04.805648 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94f235-031a-4361-bc32-ff1b5a9fe9d9 admin admin] PATH_INFO: `/v3/projects/f8db1c80ab0c48b98b0d8d17d0612484/users/5e88bb13ac2e4a06a7aa2f8bfcecfe14/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:04.821399 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94f235-031a-4361-bc32-ff1b5a9fe9d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8db1c80ab0c48b98b0d8d17d0612484, user_id=5e88bb13ac2e4a06a7aa2f8bfcecfe14, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:04.824072 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94f235-031a-4361-bc32-ff1b5a9fe9d9 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:04.837191 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1130/2260] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:07:04 2021] PUT /identity/v3/projects/f8db1c80ab0c48b98b0d8d17d0612484/users/5e88bb13ac2e4a06a7aa2f8bfcecfe14/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:07:04.847064 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56ff54-2b57-462a-a47c-22b85b907c84 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:04.847591 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56ff54-2b57-462a-a47c-22b85b907c84 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:04.847689 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56ff54-2b57-462a-a47c-22b85b907c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:04.874575 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-1b56ff54-2b57-462a-a47c-22b85b907c84 None None] MFA Rules not processed for user `5e88bb13ac2e4a06a7aa2f8bfcecfe14`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:04.875820 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-1b56ff54-2b57-462a-a47c-22b85b907c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:04.942656 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1131/2261] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:04 2021] POST /identity/v3/auth/tokens => generated 3377 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:04.947047 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94f235-031a-4361-bc32-ff1b5a9fe9d9 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:05.006041 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94f235-031a-4361-bc32-ff1b5a9fe9d9 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:05.010646 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eec3af-01f7-431b-8026-32623e49844a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:05.011289 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eec3af-01f7-431b-8026-32623e49844a admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:05.011601 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eec3af-01f7-431b-8026-32623e49844a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:05.011876 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eec3af-01f7-431b-8026-32623e49844a admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:05.012568 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eec3af-01f7-431b-8026-32623e49844a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:05.014446 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eec3af-01f7-431b-8026-32623e49844a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:05.038558 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1131/2262] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:07:04 2021] POST /identity/v3/projects => generated 355 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:05.042679 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56ff54-2b57-462a-a47c-22b85b907c84 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:05.053818 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56ff54-2b57-462a-a47c-22b85b907c84 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:05.110001 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0b1e8-1273-4179-9cf9-58706da1b4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:05.110665 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0b1e8-1273-4179-9cf9-58706da1b4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:05.111095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0b1e8-1273-4179-9cf9-58706da1b4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:05.111401 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0b1e8-1273-4179-9cf9-58706da1b4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:05.112821 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0b1e8-1273-4179-9cf9-58706da1b4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:05.114785 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0b1e8-1273-4179-9cf9-58706da1b4b1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:05.138012 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1132/2263] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:07:05 2021] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:07:05.139390 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eec3af-01f7-431b-8026-32623e49844a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:05.150253 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eec3af-01f7-431b-8026-32623e49844a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:05.155160 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b71476-7a3b-4e11-9251-4d864bffdae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:05.155875 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b71476-7a3b-4e11-9251-4d864bffdae5 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:05.156279 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b71476-7a3b-4e11-9251-4d864bffdae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:05.156558 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b71476-7a3b-4e11-9251-4d864bffdae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:05.157306 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b71476-7a3b-4e11-9251-4d864bffdae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:05.159434 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b71476-7a3b-4e11-9251-4d864bffdae5 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:05.173138 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1132/2264] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:05 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:05.177816 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0b1e8-1273-4179-9cf9-58706da1b4b1 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:05.187658 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0b1e8-1273-4179-9cf9-58706da1b4b1 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:05.192937 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203340b8-b456-4ec1-b35f-2bc8ae3ee052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:05.193814 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203340b8-b456-4ec1-b35f-2bc8ae3ee052 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:05.194097 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203340b8-b456-4ec1-b35f-2bc8ae3ee052 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:05.194369 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203340b8-b456-4ec1-b35f-2bc8ae3ee052 admin admin] PATH_INFO: `/v3/projects/e139a0ab06ac439eba546d7e6f46c507/users/e54e174883f04ab4a33706dead2063b9/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:05.209119 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203340b8-b456-4ec1-b35f-2bc8ae3ee052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e139a0ab06ac439eba546d7e6f46c507, user_id=e54e174883f04ab4a33706dead2063b9, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:05.211873 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203340b8-b456-4ec1-b35f-2bc8ae3ee052 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:05.225934 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1133/2265] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:07:05 2021] PUT /identity/v3/projects/e139a0ab06ac439eba546d7e6f46c507/users/e54e174883f04ab4a33706dead2063b9/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:05.229909 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b71476-7a3b-4e11-9251-4d864bffdae5 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:05.240115 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b71476-7a3b-4e11-9251-4d864bffdae5 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:05.294358 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd2f17-2e51-4ede-b1c4-a5a77da54a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:05.295011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd2f17-2e51-4ede-b1c4-a5a77da54a91 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:05.295294 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd2f17-2e51-4ede-b1c4-a5a77da54a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:05.295603 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd2f17-2e51-4ede-b1c4-a5a77da54a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:05.296540 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd2f17-2e51-4ede-b1c4-a5a77da54a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:05.298160 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd2f17-2e51-4ede-b1c4-a5a77da54a91 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:05.307636 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1133/2266] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:05 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:05.311888 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203340b8-b456-4ec1-b35f-2bc8ae3ee052 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:05.322700 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203340b8-b456-4ec1-b35f-2bc8ae3ee052 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:05.327474 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fced0-ba1c-4d62-9afc-59bcb5a5fd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:05.328340 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fced0-ba1c-4d62-9afc-59bcb5a5fd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:05.328622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fced0-ba1c-4d62-9afc-59bcb5a5fd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:05.328897 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fced0-ba1c-4d62-9afc-59bcb5a5fd56 admin admin] PATH_INFO: `/v3/projects/e139a0ab06ac439eba546d7e6f46c507/users/e54e174883f04ab4a33706dead2063b9/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:05.331664 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fced0-ba1c-4d62-9afc-59bcb5a5fd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e139a0ab06ac439eba546d7e6f46c507, user_id=e54e174883f04ab4a33706dead2063b9, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:05.334277 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fced0-ba1c-4d62-9afc-59bcb5a5fd56 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:05.345490 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1134/2267] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:07:05 2021] PUT /identity/v3/projects/e139a0ab06ac439eba546d7e6f46c507/users/e54e174883f04ab4a33706dead2063b9/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:05.357456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd410c8-ec2d-455f-b9c6-98e558753070 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:05.357746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd410c8-ec2d-455f-b9c6-98e558753070 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:05.358021 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd410c8-ec2d-455f-b9c6-98e558753070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:05.385247 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-0fd410c8-ec2d-455f-b9c6-98e558753070 None None] MFA Rules not processed for user `e54e174883f04ab4a33706dead2063b9`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:05.386782 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0fd410c8-ec2d-455f-b9c6-98e558753070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:05.453113 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1134/2268] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:05 2021] POST /identity/v3/auth/tokens => generated 3442 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:05.463558 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fced0-ba1c-4d62-9afc-59bcb5a5fd56 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:05.465477 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-151fced0-ba1c-4d62-9afc-59bcb5a5fd56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:05.537882 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fced0-ba1c-4d62-9afc-59bcb5a5fd56 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:05.541591 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd0b0e-8e3a-4406-ada9-79e5572f3a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:05.542229 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd0b0e-8e3a-4406-ada9-79e5572f3a9e service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:05.542506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd0b0e-8e3a-4406-ada9-79e5572f3a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:05.542773 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd0b0e-8e3a-4406-ada9-79e5572f3a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:05.552732 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd0b0e-8e3a-4406-ada9-79e5572f3a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:05.554146 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd0b0e-8e3a-4406-ada9-79e5572f3a9e service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:05.563570 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1135/2269] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:05 2021] GET /identity/v3/auth/tokens => generated 3442 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:07:05.634953 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd410c8-ec2d-455f-b9c6-98e558753070 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:05.644415 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd410c8-ec2d-455f-b9c6-98e558753070 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:05.648052 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0ad60-2b7e-4fe6-8671-e6f85e2b1eb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:05.648687 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0ad60-2b7e-4fe6-8671-e6f85e2b1eb8 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:05.648970 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0ad60-2b7e-4fe6-8671-e6f85e2b1eb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:05.649247 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0ad60-2b7e-4fe6-8671-e6f85e2b1eb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:05.706946 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0ad60-2b7e-4fe6-8671-e6f85e2b1eb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:05.708447 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0ad60-2b7e-4fe6-8671-e6f85e2b1eb8 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:05.717317 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1135/2270] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:05 2021] GET /identity/v3/auth/tokens => generated 3377 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:07:08.952787 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c059f-4aba-412c-a80b-cf21019cd020 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:08.953217 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c059f-4aba-412c-a80b-cf21019cd020 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:08.953379 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c059f-4aba-412c-a80b-cf21019cd020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:08.989678 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-c42c059f-4aba-412c-a80b-cf21019cd020 None None] MFA Rules not processed for user `b1918e2aa8f24655875480ef52df324d`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:08.990977 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c42c059f-4aba-412c-a80b-cf21019cd020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:09.059584 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1136/2271] 10.222.0.39 () {58 vars in 1010 bytes} [Tue Aug 31 03:07:08 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:09.087394 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0ad60-2b7e-4fe6-8671-e6f85e2b1eb8 service cinder] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:09.089035 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-8fb0ad60-2b7e-4fe6-8671-e6f85e2b1eb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:09.165970 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0ad60-2b7e-4fe6-8671-e6f85e2b1eb8 service cinder] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:09.171309 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a5a37-bd98-47ef-a829-2042930c9bff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ed84d2e3ce4c85b552732f3294aac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:09.171999 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a5a37-bd98-47ef-a829-2042930c9bff service swift] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:09.172379 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a5a37-bd98-47ef-a829-2042930c9bff service swift] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:09.172661 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a5a37-bd98-47ef-a829-2042930c9bff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:09.181297 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a5a37-bd98-47ef-a829-2042930c9bff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:09.182874 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a5a37-bd98-47ef-a829-2042930c9bff service swift] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:09.191337 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1136/2272] 10.222.0.39 () {60 vars in 1385 bytes} [Tue Aug 31 03:07:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 03:07:15.112872 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c059f-4aba-412c-a80b-cf21019cd020 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:15.114339 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c42c059f-4aba-412c-a80b-cf21019cd020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:15.265172 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c059f-4aba-412c-a80b-cf21019cd020 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:15.278546 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7838d-fd53-4662-98e4-b7c0871a0c6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcf0359f8bc4f55be3307f235f8aac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:15.279306 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7838d-fd53-4662-98e4-b7c0871a0c6a service placement] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:15.279630 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7838d-fd53-4662-98e4-b7c0871a0c6a service placement] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:15.280725 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7838d-fd53-4662-98e4-b7c0871a0c6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:15.282765 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a8f7838d-fd53-4662-98e4-b7c0871a0c6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:15.296080 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7838d-fd53-4662-98e4-b7c0871a0c6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:15.297679 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7838d-fd53-4662-98e4-b7c0871a0c6a service placement] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:15.309265 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1137/2273] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:15 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:07:16.740644 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a5a37-bd98-47ef-a829-2042930c9bff service swift] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:16.742780 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-bb4a5a37-bd98-47ef-a829-2042930c9bff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:16.832259 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a5a37-bd98-47ef-a829-2042930c9bff service swift] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:16.836040 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7269b-4889-4886-915d-2d40ea710ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:16.836701 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7269b-4889-4886-915d-2d40ea710ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:16.836963 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7269b-4889-4886-915d-2d40ea710ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:16.837234 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7269b-4889-4886-915d-2d40ea710ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:16.839113 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-8bf7269b-4889-4886-915d-2d40ea710ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:16.911264 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7269b-4889-4886-915d-2d40ea710ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:16.913258 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7269b-4889-4886-915d-2d40ea710ab3 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:16.926237 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1137/2274] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:16 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:07:20.131008 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7838d-fd53-4662-98e4-b7c0871a0c6a service placement] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:20.132811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a8f7838d-fd53-4662-98e4-b7c0871a0c6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:20.201027 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7838d-fd53-4662-98e4-b7c0871a0c6a service placement] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:20.206059 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dea2ca-8054-45fc-9e6e-904d8d799ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:20.207229 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dea2ca-8054-45fc-9e6e-904d8d799ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:20.207698 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dea2ca-8054-45fc-9e6e-904d8d799ade admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:20.208119 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dea2ca-8054-45fc-9e6e-904d8d799ade admin admin] PATH_INFO: `/v3/users/1ffd3cf445d34d96ae2f3162de6170b6` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:20.209561 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dea2ca-8054-45fc-9e6e-904d8d799ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ffd3cf445d34d96ae2f3162de6170b6)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:20.211702 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dea2ca-8054-45fc-9e6e-904d8d799ade admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:20.262572 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-07dea2ca-8054-45fc-9e6e-904d8d799ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ffd3cf445d34d96ae2f3162de6170b6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:20.275310 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-07dea2ca-8054-45fc-9e6e-904d8d799ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ffd3cf445d34d96ae2f3162de6170b6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:20.276556 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-07dea2ca-8054-45fc-9e6e-904d8d799ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ffd3cf445d34d96ae2f3162de6170b6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:20.285419 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-07dea2ca-8054-45fc-9e6e-904d8d799ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ffd3cf445d34d96ae2f3162de6170b6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:20.295437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-07dea2ca-8054-45fc-9e6e-904d8d799ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ffd3cf445d34d96ae2f3162de6170b6'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:20.304393 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1138/2275] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:07:20 2021] DELETE /identity/v3/users/1ffd3cf445d34d96ae2f3162de6170b6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:20.308871 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fef86a-6b4a-471a-9cf3-887c4d4e52ad None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:20.309349 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fef86a-6b4a-471a-9cf3-887c4d4e52ad None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:20.309439 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fef86a-6b4a-471a-9cf3-887c4d4e52ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:20.328954 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-10fef86a-6b4a-471a-9cf3-887c4d4e52ad None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:20.330735 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-10fef86a-6b4a-471a-9cf3-887c4d4e52ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:20.420576 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1138/2276] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:20.430610 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dea2ca-8054-45fc-9e6e-904d8d799ade admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:20.432132 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-07dea2ca-8054-45fc-9e6e-904d8d799ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:20.492724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dea2ca-8054-45fc-9e6e-904d8d799ade admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:20.496849 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67295f-59c8-4629-99d9-f33e53a4e481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:20.497723 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67295f-59c8-4629-99d9-f33e53a4e481 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:20.498336 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67295f-59c8-4629-99d9-f33e53a4e481 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:20.507269 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67295f-59c8-4629-99d9-f33e53a4e481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:20.513262 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67295f-59c8-4629-99d9-f33e53a4e481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:20.514873 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67295f-59c8-4629-99d9-f33e53a4e481 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:20.549497 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1139/2277] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:07:20.910774 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fef86a-6b4a-471a-9cf3-887c4d4e52ad None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:20.912325 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-10fef86a-6b4a-471a-9cf3-887c4d4e52ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:20.936034 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fef86a-6b4a-471a-9cf3-887c4d4e52ad None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:20.944139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cf4a3-6671-4a11-94c8-5a9d95bbb986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:20.946013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cf4a3-6671-4a11-94c8-5a9d95bbb986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:20.946510 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cf4a3-6671-4a11-94c8-5a9d95bbb986 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:20.946846 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cf4a3-6671-4a11-94c8-5a9d95bbb986 admin admin] PATH_INFO: `/v3/projects/37da423f787d4271945189638ce213ea` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:20.948319 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30cf4a3-6671-4a11-94c8-5a9d95bbb986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37da423f787d4271945189638ce213ea)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:20.950510 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30cf4a3-6671-4a11-94c8-5a9d95bbb986 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:21.023329 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f30cf4a3-6671-4a11-94c8-5a9d95bbb986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37da423f787d4271945189638ce213ea', 'request_id': 'req-f30cf4a3-6671-4a11-94c8-5a9d95bbb986'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:21.031423 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f30cf4a3-6671-4a11-94c8-5a9d95bbb986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37da423f787d4271945189638ce213ea', 'request_id': 'req-f30cf4a3-6671-4a11-94c8-5a9d95bbb986'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:21.037952 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f30cf4a3-6671-4a11-94c8-5a9d95bbb986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37da423f787d4271945189638ce213ea', 'request_id': 'req-f30cf4a3-6671-4a11-94c8-5a9d95bbb986'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:21.053764 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f30cf4a3-6671-4a11-94c8-5a9d95bbb986 admin admin] The token cache is being invalidate because project 37da423f787d4271945189638ce213ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:07:21.054061 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f30cf4a3-6671-4a11-94c8-5a9d95bbb986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:21.054724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f30cf4a3-6671-4a11-94c8-5a9d95bbb986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:21.060603 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1139/2278] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:07:20 2021] DELETE /identity/v3/projects/37da423f787d4271945189638ce213ea => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:21.062177 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5782f-6fb0-4da5-bcbd-f441b63eb82a None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:21.062478 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5782f-6fb0-4da5-bcbd-f441b63eb82a None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:21.062752 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5782f-6fb0-4da5-bcbd-f441b63eb82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:21.093038 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-dfe5782f-6fb0-4da5-bcbd-f441b63eb82a None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:21.094248 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-dfe5782f-6fb0-4da5-bcbd-f441b63eb82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:21.176040 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1140/2279] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:21.184739 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cd181-c8e8-4018-9f69-02e302b5dc6d None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:21.185023 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cd181-c8e8-4018-9f69-02e302b5dc6d None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:21.185298 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cd181-c8e8-4018-9f69-02e302b5dc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:21.208114 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-e09cd181-c8e8-4018-9f69-02e302b5dc6d None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:21.209318 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-e09cd181-c8e8-4018-9f69-02e302b5dc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:21.217666 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1140/2280] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:21.223587 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5782f-6fb0-4da5-bcbd-f441b63eb82a None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:21.235104 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5782f-6fb0-4da5-bcbd-f441b63eb82a None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:21.240718 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c59723-6fb1-4a4e-ba78-d279ffecb985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:21.241599 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c59723-6fb1-4a4e-ba78-d279ffecb985 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:21.241721 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c59723-6fb1-4a4e-ba78-d279ffecb985 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:21.241996 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c59723-6fb1-4a4e-ba78-d279ffecb985 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:21.247797 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c59723-6fb1-4a4e-ba78-d279ffecb985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:07:21.248480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c59723-6fb1-4a4e-ba78-d279ffecb985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:21.251901 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c59723-6fb1-4a4e-ba78-d279ffecb985 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:21.265274 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1141/2281] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:07:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:07:21.270308 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cd181-c8e8-4018-9f69-02e302b5dc6d None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:21.280027 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cd181-c8e8-4018-9f69-02e302b5dc6d None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:21.285672 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c727235-bcf2-415b-8dd9-077fa8ec0602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:21.286371 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c727235-bcf2-415b-8dd9-077fa8ec0602 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:21.286651 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c727235-bcf2-415b-8dd9-077fa8ec0602 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:21.286922 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c727235-bcf2-415b-8dd9-077fa8ec0602 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:21.291667 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c727235-bcf2-415b-8dd9-077fa8ec0602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:21.294400 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c727235-bcf2-415b-8dd9-077fa8ec0602 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:21.324287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1141/2282] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:07:21 2021] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:21.328485 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c59723-6fb1-4a4e-ba78-d279ffecb985 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:21.341053 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c59723-6fb1-4a4e-ba78-d279ffecb985 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:21.417268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313285d-cdb9-4c76-bdde-199a74dc3e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:21.418131 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313285d-cdb9-4c76-bdde-199a74dc3e20 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:21.418635 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313285d-cdb9-4c76-bdde-199a74dc3e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:21.419053 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313285d-cdb9-4c76-bdde-199a74dc3e20 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:21.419970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313285d-cdb9-4c76-bdde-199a74dc3e20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:21.422470 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313285d-cdb9-4c76-bdde-199a74dc3e20 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:21.449473 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1142/2283] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:07:21 2021] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:07:21.450391 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c727235-bcf2-415b-8dd9-077fa8ec0602 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:21.466888 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c727235-bcf2-415b-8dd9-077fa8ec0602 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:21.475236 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dfa12-a023-4e1c-8c77-3bb10bb842b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:21.476034 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dfa12-a023-4e1c-8c77-3bb10bb842b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:21.476549 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dfa12-a023-4e1c-8c77-3bb10bb842b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:21.477200 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dfa12-a023-4e1c-8c77-3bb10bb842b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:21.478412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dfa12-a023-4e1c-8c77-3bb10bb842b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:21.480188 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dfa12-a023-4e1c-8c77-3bb10bb842b7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:21.499040 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313285d-cdb9-4c76-bdde-199a74dc3e20 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:21.503634 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1142/2284] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:21 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:07:21.514175 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313285d-cdb9-4c76-bdde-199a74dc3e20 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:21.522354 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f88b8-7361-4697-bbe4-b9fc06b46a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:21.523613 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f88b8-7361-4697-bbe4-b9fc06b46a96 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:21.524252 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f88b8-7361-4697-bbe4-b9fc06b46a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:21.524676 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f88b8-7361-4697-bbe4-b9fc06b46a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:21.525660 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f88b8-7361-4697-bbe4-b9fc06b46a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:21.528090 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f88b8-7361-4697-bbe4-b9fc06b46a96 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:21.545268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1143/2285] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:21 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:21.546127 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dfa12-a023-4e1c-8c77-3bb10bb842b7 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:21.557459 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dfa12-a023-4e1c-8c77-3bb10bb842b7 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:21.562865 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee7b80-8d2d-44bc-8c88-eaef5b385c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:21.563963 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee7b80-8d2d-44bc-8c88-eaef5b385c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:21.564247 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee7b80-8d2d-44bc-8c88-eaef5b385c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:21.565065 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee7b80-8d2d-44bc-8c88-eaef5b385c74 admin admin] PATH_INFO: `/v3/projects/2d0ec3beef554b9a8376959a8e6c30a1/users/177fe8364b6f4a2f9116fa4763e3a550/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:21.586305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee7b80-8d2d-44bc-8c88-eaef5b385c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0ec3beef554b9a8376959a8e6c30a1, user_id=177fe8364b6f4a2f9116fa4763e3a550, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:21.588976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee7b80-8d2d-44bc-8c88-eaef5b385c74 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:21.602023 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1143/2286] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:07:21 2021] PUT /identity/v3/projects/2d0ec3beef554b9a8376959a8e6c30a1/users/177fe8364b6f4a2f9116fa4763e3a550/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:07:21.612548 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224129a-27ae-458e-b662-f007819f2a7f None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:21.612827 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224129a-27ae-458e-b662-f007819f2a7f None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:21.613294 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224129a-27ae-458e-b662-f007819f2a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:21.641539 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-5224129a-27ae-458e-b662-f007819f2a7f None None] MFA Rules not processed for user `177fe8364b6f4a2f9116fa4763e3a550`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:21.643295 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-5224129a-27ae-458e-b662-f007819f2a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:21.711823 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1144/2287] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:21 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:21.721511 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee7b80-8d2d-44bc-8c88-eaef5b385c74 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:21.723196 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-92ee7b80-8d2d-44bc-8c88-eaef5b385c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:21.785429 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee7b80-8d2d-44bc-8c88-eaef5b385c74 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:21.789219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603eb77-90fd-47ac-838f-3c2ddcadcb20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:21.789859 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603eb77-90fd-47ac-838f-3c2ddcadcb20 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:21.790146 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603eb77-90fd-47ac-838f-3c2ddcadcb20 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:21.790424 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603eb77-90fd-47ac-838f-3c2ddcadcb20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:21.798478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603eb77-90fd-47ac-838f-3c2ddcadcb20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:21.800730 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603eb77-90fd-47ac-838f-3c2ddcadcb20 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:21.809321 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1144/2288] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:21 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:07:24.391839 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30321ff-89e8-4986-bdb9-440b98309d8a None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:24.392364 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30321ff-89e8-4986-bdb9-440b98309d8a None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:24.392364 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30321ff-89e8-4986-bdb9-440b98309d8a None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:24.395244 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1145/2289] 10.222.0.39 () {54 vars in 921 bytes} [Tue Aug 31 03:07:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:07:24.400936 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1116e3-f5ed-4a02-a540-439c9fad6f42 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:24.401395 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1116e3-f5ed-4a02-a540-439c9fad6f42 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:24.401600 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1116e3-f5ed-4a02-a540-439c9fad6f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:24.461478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-cf1116e3-f5ed-4a02-a540-439c9fad6f42 None None] MFA Rules not processed for user `a6bb852fc4394f88800ec9616cb65416`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:24.463033 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-cf1116e3-f5ed-4a02-a540-439c9fad6f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:24.571558 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1145/2290] 10.222.0.39 () {58 vars in 1019 bytes} [Tue Aug 31 03:07:24 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:24.585144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30321ff-89e8-4986-bdb9-440b98309d8a None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:24.586916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-d30321ff-89e8-4986-bdb9-440b98309d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:24.648273 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30321ff-89e8-4986-bdb9-440b98309d8a None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:24.654587 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e501a2c-dbfd-42ca-a327-3da3c1af16e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d763da11c58473c9c2cf981b02835f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:24.655515 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e501a2c-dbfd-42ca-a327-3da3c1af16e2 service glance] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:24.655953 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e501a2c-dbfd-42ca-a327-3da3c1af16e2 service glance] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:24.656225 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e501a2c-dbfd-42ca-a327-3da3c1af16e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:24.667516 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e501a2c-dbfd-42ca-a327-3da3c1af16e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:24.669485 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e501a2c-dbfd-42ca-a327-3da3c1af16e2 service glance] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:24.684601 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1146/2291] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:24 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:07:24.770564 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2c1d8-3afc-4fb3-92c6-6834515ec325 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:24.770866 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2c1d8-3afc-4fb3-92c6-6834515ec325 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:24.771154 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2c1d8-3afc-4fb3-92c6-6834515ec325 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:24.773320 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1146/2292] 10.222.0.39 () {54 vars in 921 bytes} [Tue Aug 31 03:07:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:07:24.790027 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae31602-fdcd-4c94-857a-741b1c083e6b None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:24.790414 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae31602-fdcd-4c94-857a-741b1c083e6b None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:24.790784 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae31602-fdcd-4c94-857a-741b1c083e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:24.816623 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-cae31602-fdcd-4c94-857a-741b1c083e6b None None] MFA Rules not processed for user `18b73b8e7244410b8f701b2ab43c5979`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:24.817352 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-cae31602-fdcd-4c94-857a-741b1c083e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:24.900808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1147/2293] 10.222.0.39 () {58 vars in 1019 bytes} [Tue Aug 31 03:07:24 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:07:24.909834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2c1d8-3afc-4fb3-92c6-6834515ec325 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:24.911676 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-32b2c1d8-3afc-4fb3-92c6-6834515ec325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:24.924542 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2c1d8-3afc-4fb3-92c6-6834515ec325 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:24.928082 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baface8-5c6a-408b-bc32-d88bc80fd957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:24.928713 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baface8-5c6a-408b-bc32-d88bc80fd957 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:24.928996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baface8-5c6a-408b-bc32-d88bc80fd957 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:24.929275 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baface8-5c6a-408b-bc32-d88bc80fd957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:24.936120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baface8-5c6a-408b-bc32-d88bc80fd957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:24.937542 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baface8-5c6a-408b-bc32-d88bc80fd957 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:24.945259 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1147/2294] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:24 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:07:28.304565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae31602-fdcd-4c94-857a-741b1c083e6b None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:28.306079 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-cae31602-fdcd-4c94-857a-741b1c083e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:28.377361 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae31602-fdcd-4c94-857a-741b1c083e6b None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:28.382254 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc31bd-8f39-4adc-81d9-2abc040b492f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:28.383116 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc31bd-8f39-4adc-81d9-2abc040b492f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:28.383425 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc31bd-8f39-4adc-81d9-2abc040b492f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:28.383701 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc31bd-8f39-4adc-81d9-2abc040b492f admin admin] PATH_INFO: `/v3/users/5e88bb13ac2e4a06a7aa2f8bfcecfe14` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:28.384895 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc31bd-8f39-4adc-81d9-2abc040b492f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e88bb13ac2e4a06a7aa2f8bfcecfe14)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:28.386807 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc31bd-8f39-4adc-81d9-2abc040b492f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:28.429922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-27bc31bd-8f39-4adc-81d9-2abc040b492f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e88bb13ac2e4a06a7aa2f8bfcecfe14'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:28.441950 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-27bc31bd-8f39-4adc-81d9-2abc040b492f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e88bb13ac2e4a06a7aa2f8bfcecfe14'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:28.442612 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-27bc31bd-8f39-4adc-81d9-2abc040b492f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e88bb13ac2e4a06a7aa2f8bfcecfe14'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:28.449126 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-27bc31bd-8f39-4adc-81d9-2abc040b492f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e88bb13ac2e4a06a7aa2f8bfcecfe14'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:28.456780 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-27bc31bd-8f39-4adc-81d9-2abc040b492f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e88bb13ac2e4a06a7aa2f8bfcecfe14'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:28.462510 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1148/2295] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:07:28 2021] DELETE /identity/v3/users/5e88bb13ac2e4a06a7aa2f8bfcecfe14 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:28.467216 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e2eef-48d4-4bbd-8dc4-5701849d7b37 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:28.467711 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e2eef-48d4-4bbd-8dc4-5701849d7b37 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:28.467829 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e2eef-48d4-4bbd-8dc4-5701849d7b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:28.484998 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-187e2eef-48d4-4bbd-8dc4-5701849d7b37 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:28.486167 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-187e2eef-48d4-4bbd-8dc4-5701849d7b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:28.549823 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1148/2296] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:28.559934 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc31bd-8f39-4adc-81d9-2abc040b492f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:28.561354 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-27bc31bd-8f39-4adc-81d9-2abc040b492f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:28.622050 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc31bd-8f39-4adc-81d9-2abc040b492f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:28.626037 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c727fd-158f-4ef5-8216-a323e6aa1dbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:28.626688 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c727fd-158f-4ef5-8216-a323e6aa1dbb service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:28.628195 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c727fd-158f-4ef5-8216-a323e6aa1dbb service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:28.628486 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c727fd-158f-4ef5-8216-a323e6aa1dbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:28.638920 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c727fd-158f-4ef5-8216-a323e6aa1dbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:28.640468 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c727fd-158f-4ef5-8216-a323e6aa1dbb service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:28.650110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1149/2297] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:07:28.924275 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e2eef-48d4-4bbd-8dc4-5701849d7b37 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:28.927381 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-187e2eef-48d4-4bbd-8dc4-5701849d7b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:28.945258 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e2eef-48d4-4bbd-8dc4-5701849d7b37 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:28.951389 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8962bf-83d0-49e8-bca0-4d4d707acf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:28.952272 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8962bf-83d0-49e8-bca0-4d4d707acf60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:28.952565 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8962bf-83d0-49e8-bca0-4d4d707acf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:28.952817 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8962bf-83d0-49e8-bca0-4d4d707acf60 admin admin] PATH_INFO: `/v3/projects/f8db1c80ab0c48b98b0d8d17d0612484` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:28.954034 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8962bf-83d0-49e8-bca0-4d4d707acf60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8db1c80ab0c48b98b0d8d17d0612484)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:28.956413 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8962bf-83d0-49e8-bca0-4d4d707acf60 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:29.001215 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-6c8962bf-83d0-49e8-bca0-4d4d707acf60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8db1c80ab0c48b98b0d8d17d0612484', 'request_id': 'req-6c8962bf-83d0-49e8-bca0-4d4d707acf60'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:29.012157 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-6c8962bf-83d0-49e8-bca0-4d4d707acf60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8db1c80ab0c48b98b0d8d17d0612484', 'request_id': 'req-6c8962bf-83d0-49e8-bca0-4d4d707acf60'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:29.018592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-6c8962bf-83d0-49e8-bca0-4d4d707acf60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8db1c80ab0c48b98b0d8d17d0612484', 'request_id': 'req-6c8962bf-83d0-49e8-bca0-4d4d707acf60'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:29.031077 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-6c8962bf-83d0-49e8-bca0-4d4d707acf60 admin admin] The token cache is being invalidate because project f8db1c80ab0c48b98b0d8d17d0612484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:07:29.031400 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-6c8962bf-83d0-49e8-bca0-4d4d707acf60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:29.032037 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-6c8962bf-83d0-49e8-bca0-4d4d707acf60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:29.033941 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1149/2298] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:07:28 2021] DELETE /identity/v3/projects/f8db1c80ab0c48b98b0d8d17d0612484 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:07:29.038450 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c727fd-158f-4ef5-8216-a323e6aa1dbb service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:29.047853 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c727fd-158f-4ef5-8216-a323e6aa1dbb service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:29.103982 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996034a-3293-44e3-a41b-fc6ba59229b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:29.104890 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996034a-3293-44e3-a41b-fc6ba59229b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:29.105169 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996034a-3293-44e3-a41b-fc6ba59229b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:29.105441 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996034a-3293-44e3-a41b-fc6ba59229b7 admin admin] PATH_INFO: `/v3/users/e54e174883f04ab4a33706dead2063b9` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:29.106641 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996034a-3293-44e3-a41b-fc6ba59229b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e54e174883f04ab4a33706dead2063b9)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:29.108583 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996034a-3293-44e3-a41b-fc6ba59229b7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:29.156822 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d996034a-3293-44e3-a41b-fc6ba59229b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e54e174883f04ab4a33706dead2063b9'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:29.168314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d996034a-3293-44e3-a41b-fc6ba59229b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e54e174883f04ab4a33706dead2063b9'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:29.169043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d996034a-3293-44e3-a41b-fc6ba59229b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e54e174883f04ab4a33706dead2063b9'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:29.175744 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d996034a-3293-44e3-a41b-fc6ba59229b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e54e174883f04ab4a33706dead2063b9'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:29.182852 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d996034a-3293-44e3-a41b-fc6ba59229b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e54e174883f04ab4a33706dead2063b9'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:29.188911 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1150/2299] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:07:29 2021] DELETE /identity/v3/users/e54e174883f04ab4a33706dead2063b9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:07:29.464560 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8962bf-83d0-49e8-bca0-4d4d707acf60 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:29.466062 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-6c8962bf-83d0-49e8-bca0-4d4d707acf60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:29.479746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8962bf-83d0-49e8-bca0-4d4d707acf60 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:29.539560 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706e255-3fd6-42b2-88c7-79fadc960847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:29.540428 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706e255-3fd6-42b2-88c7-79fadc960847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:29.540737 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706e255-3fd6-42b2-88c7-79fadc960847 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:29.541011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706e255-3fd6-42b2-88c7-79fadc960847 admin admin] PATH_INFO: `/v3/projects/e139a0ab06ac439eba546d7e6f46c507` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:29.542230 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706e255-3fd6-42b2-88c7-79fadc960847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e139a0ab06ac439eba546d7e6f46c507)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:29.544112 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706e255-3fd6-42b2-88c7-79fadc960847 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:29.588102 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1706e255-3fd6-42b2-88c7-79fadc960847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e139a0ab06ac439eba546d7e6f46c507', 'request_id': 'req-1706e255-3fd6-42b2-88c7-79fadc960847'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:29.593849 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1706e255-3fd6-42b2-88c7-79fadc960847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e139a0ab06ac439eba546d7e6f46c507', 'request_id': 'req-1706e255-3fd6-42b2-88c7-79fadc960847'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:29.599538 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1706e255-3fd6-42b2-88c7-79fadc960847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e139a0ab06ac439eba546d7e6f46c507', 'request_id': 'req-1706e255-3fd6-42b2-88c7-79fadc960847'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:29.611682 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1706e255-3fd6-42b2-88c7-79fadc960847 admin admin] The token cache is being invalidate because project e139a0ab06ac439eba546d7e6f46c507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:07:29.612014 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1706e255-3fd6-42b2-88c7-79fadc960847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:29.612697 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1706e255-3fd6-42b2-88c7-79fadc960847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:29.614179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1150/2300] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:07:29 2021] DELETE /identity/v3/projects/e139a0ab06ac439eba546d7e6f46c507 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:29.619783 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811a283-caf5-46d7-8185-dc69e0803c9d None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:29.620326 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811a283-caf5-46d7-8185-dc69e0803c9d None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:29.620424 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811a283-caf5-46d7-8185-dc69e0803c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:29.643421 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-4811a283-caf5-46d7-8185-dc69e0803c9d None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:29.643421 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-4811a283-caf5-46d7-8185-dc69e0803c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:29.701786 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1151/2301] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:29.709728 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb465f-af20-4d52-b13c-78a066756cb4 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:29.710020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb465f-af20-4d52-b13c-78a066756cb4 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:29.710291 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb465f-af20-4d52-b13c-78a066756cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:29.729270 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-acbb465f-af20-4d52-b13c-78a066756cb4 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:29.730475 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-acbb465f-af20-4d52-b13c-78a066756cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:29.738914 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1151/2302] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:29.743005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811a283-caf5-46d7-8185-dc69e0803c9d None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:29.752984 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811a283-caf5-46d7-8185-dc69e0803c9d None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:29.757998 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5a2a9-3743-4034-8ec6-18228e6aa160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:29.758651 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5a2a9-3743-4034-8ec6-18228e6aa160 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:29.758960 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5a2a9-3743-4034-8ec6-18228e6aa160 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:29.759232 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5a2a9-3743-4034-8ec6-18228e6aa160 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:29.759999 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5a2a9-3743-4034-8ec6-18228e6aa160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:07:29.760304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5a2a9-3743-4034-8ec6-18228e6aa160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:29.761889 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5a2a9-3743-4034-8ec6-18228e6aa160 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:29.773043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1152/2303] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:07:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:07:29.777040 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb465f-af20-4d52-b13c-78a066756cb4 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:29.786331 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb465f-af20-4d52-b13c-78a066756cb4 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:29.790926 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500a9ad-8df9-4f7d-81d7-6dd025e60f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:29.791597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500a9ad-8df9-4f7d-81d7-6dd025e60f7e admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:29.791883 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500a9ad-8df9-4f7d-81d7-6dd025e60f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:29.792160 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500a9ad-8df9-4f7d-81d7-6dd025e60f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:29.792900 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500a9ad-8df9-4f7d-81d7-6dd025e60f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:29.794721 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500a9ad-8df9-4f7d-81d7-6dd025e60f7e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:29.821244 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1152/2304] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:07:29 2021] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:07:29.824637 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5a2a9-3743-4034-8ec6-18228e6aa160 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:29.834507 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5a2a9-3743-4034-8ec6-18228e6aa160 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:29.889093 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef0a9f-212b-4d76-a5a2-59cb8ea96dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:29.889753 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef0a9f-212b-4d76-a5a2-59cb8ea96dce admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:29.890034 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef0a9f-212b-4d76-a5a2-59cb8ea96dce admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:29.890307 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef0a9f-212b-4d76-a5a2-59cb8ea96dce admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:29.890985 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef0a9f-212b-4d76-a5a2-59cb8ea96dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:29.892961 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef0a9f-212b-4d76-a5a2-59cb8ea96dce admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:29.912202 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1153/2305] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:07:29 2021] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:29.916440 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500a9ad-8df9-4f7d-81d7-6dd025e60f7e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:29.927086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500a9ad-8df9-4f7d-81d7-6dd025e60f7e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:29.931901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2483e-41f4-448d-b16d-1f72e6833786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:29.932551 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2483e-41f4-448d-b16d-1f72e6833786 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:29.932837 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2483e-41f4-448d-b16d-1f72e6833786 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:29.933112 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2483e-41f4-448d-b16d-1f72e6833786 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:29.933825 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2483e-41f4-448d-b16d-1f72e6833786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:29.935464 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2483e-41f4-448d-b16d-1f72e6833786 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:29.945581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1153/2306] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:29.949338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef0a9f-212b-4d76-a5a2-59cb8ea96dce admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:29.959186 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef0a9f-212b-4d76-a5a2-59cb8ea96dce admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:29.963983 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa867df-f319-4ded-bfcc-cf62e75373f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:29.964640 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa867df-f319-4ded-bfcc-cf62e75373f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:29.964921 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa867df-f319-4ded-bfcc-cf62e75373f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:29.965195 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa867df-f319-4ded-bfcc-cf62e75373f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:29.965913 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa867df-f319-4ded-bfcc-cf62e75373f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:29.967519 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa867df-f319-4ded-bfcc-cf62e75373f5 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:29.978099 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1154/2307] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:29 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:29.982262 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2483e-41f4-448d-b16d-1f72e6833786 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:29.992964 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2483e-41f4-448d-b16d-1f72e6833786 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:29.997594 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99454572-e5d6-4d03-85d3-3208f3e1c0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:29.998461 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99454572-e5d6-4d03-85d3-3208f3e1c0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:29.998756 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99454572-e5d6-4d03-85d3-3208f3e1c0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:29.999036 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99454572-e5d6-4d03-85d3-3208f3e1c0c3 admin admin] PATH_INFO: `/v3/projects/635e1dbc2e0147b89542d75161a2bbf0/users/0def5e89888a4efa8f7474143d366bce/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:30.013542 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99454572-e5d6-4d03-85d3-3208f3e1c0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=635e1dbc2e0147b89542d75161a2bbf0, user_id=0def5e89888a4efa8f7474143d366bce, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:30.016232 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99454572-e5d6-4d03-85d3-3208f3e1c0c3 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:30.028598 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1154/2308] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:07:29 2021] PUT /identity/v3/projects/635e1dbc2e0147b89542d75161a2bbf0/users/0def5e89888a4efa8f7474143d366bce/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:07:30.040458 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7fd40-ea18-46cd-be8f-ab100357ad0c None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:30.040749 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7fd40-ea18-46cd-be8f-ab100357ad0c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:30.041028 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7fd40-ea18-46cd-be8f-ab100357ad0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:30.067064 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-35d7fd40-ea18-46cd-be8f-ab100357ad0c None None] MFA Rules not processed for user `0def5e89888a4efa8f7474143d366bce`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:30.068226 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-35d7fd40-ea18-46cd-be8f-ab100357ad0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:30.129088 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1155/2309] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:30 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:30.133800 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99454572-e5d6-4d03-85d3-3208f3e1c0c3 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:30.192729 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99454572-e5d6-4d03-85d3-3208f3e1c0c3 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:30.197310 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0e273-49c7-4672-bdfb-399c08fcc464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:30.197963 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0e273-49c7-4672-bdfb-399c08fcc464 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:30.198241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0e273-49c7-4672-bdfb-399c08fcc464 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:30.198534 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0e273-49c7-4672-bdfb-399c08fcc464 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:30.199209 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0e273-49c7-4672-bdfb-399c08fcc464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:30.201120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0e273-49c7-4672-bdfb-399c08fcc464 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:30.226830 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1155/2310] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:07:30 2021] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:30.230843 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7fd40-ea18-46cd-be8f-ab100357ad0c None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:30.242381 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7fd40-ea18-46cd-be8f-ab100357ad0c None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:30.297326 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d0848-b30f-420e-81fe-f7844ea373c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:30.297997 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d0848-b30f-420e-81fe-f7844ea373c1 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:30.298281 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d0848-b30f-420e-81fe-f7844ea373c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:30.298588 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d0848-b30f-420e-81fe-f7844ea373c1 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:30.299565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d0848-b30f-420e-81fe-f7844ea373c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:30.301479 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d0848-b30f-420e-81fe-f7844ea373c1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:30.322507 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1156/2311] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:07:30 2021] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:30.326471 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0e273-49c7-4672-bdfb-399c08fcc464 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:30.337514 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0e273-49c7-4672-bdfb-399c08fcc464 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:30.342297 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec76d7-f4b2-4a1d-8324-70c311854492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:30.342952 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec76d7-f4b2-4a1d-8324-70c311854492 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:30.343234 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec76d7-f4b2-4a1d-8324-70c311854492 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:30.343544 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec76d7-f4b2-4a1d-8324-70c311854492 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:30.344261 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec76d7-f4b2-4a1d-8324-70c311854492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:30.346505 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec76d7-f4b2-4a1d-8324-70c311854492 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:30.356740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1156/2312] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:30 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:30.360749 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d0848-b30f-420e-81fe-f7844ea373c1 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:30.370447 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d0848-b30f-420e-81fe-f7844ea373c1 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:30.375002 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac5231-9eca-4815-a99e-36ee4a3156a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:30.375682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac5231-9eca-4815-a99e-36ee4a3156a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:30.375968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac5231-9eca-4815-a99e-36ee4a3156a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:30.376245 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac5231-9eca-4815-a99e-36ee4a3156a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:30.377089 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac5231-9eca-4815-a99e-36ee4a3156a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:30.378655 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac5231-9eca-4815-a99e-36ee4a3156a4 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:30.389437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1157/2313] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:30 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:30.393913 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec76d7-f4b2-4a1d-8324-70c311854492 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:30.403660 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec76d7-f4b2-4a1d-8324-70c311854492 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:30.408881 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ba4a7-d8fe-4ecd-8395-91bafb6a3991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:30.409740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ba4a7-d8fe-4ecd-8395-91bafb6a3991 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:30.410019 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ba4a7-d8fe-4ecd-8395-91bafb6a3991 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:30.410291 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ba4a7-d8fe-4ecd-8395-91bafb6a3991 admin admin] PATH_INFO: `/v3/projects/a9b8629242ef4b9abcd1d2f4df7eae24/users/a74e772c2a91496abad8506061e151cb/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:30.425121 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ba4a7-d8fe-4ecd-8395-91bafb6a3991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b8629242ef4b9abcd1d2f4df7eae24, user_id=a74e772c2a91496abad8506061e151cb, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:30.427880 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ba4a7-d8fe-4ecd-8395-91bafb6a3991 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:30.440706 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1157/2314] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:07:30 2021] PUT /identity/v3/projects/a9b8629242ef4b9abcd1d2f4df7eae24/users/a74e772c2a91496abad8506061e151cb/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:30.450674 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecfc3b-6202-4ed5-a127-2b1b2fbad580 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:30.450963 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecfc3b-6202-4ed5-a127-2b1b2fbad580 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:30.451240 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecfc3b-6202-4ed5-a127-2b1b2fbad580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:30.477945 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-a4ecfc3b-6202-4ed5-a127-2b1b2fbad580 None None] MFA Rules not processed for user `a74e772c2a91496abad8506061e151cb`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:30.479148 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a4ecfc3b-6202-4ed5-a127-2b1b2fbad580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:30.542511 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1158/2315] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:30 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:30.547064 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ba4a7-d8fe-4ecd-8395-91bafb6a3991 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:30.606472 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ba4a7-d8fe-4ecd-8395-91bafb6a3991 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:30.612148 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0937-f8ba-44d1-b68d-8e01b2e42b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:30.612808 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0937-f8ba-44d1-b68d-8e01b2e42b09 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:30.613212 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0937-f8ba-44d1-b68d-8e01b2e42b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:30.613498 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0937-f8ba-44d1-b68d-8e01b2e42b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:30.614285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c0937-f8ba-44d1-b68d-8e01b2e42b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:30.616283 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c0937-f8ba-44d1-b68d-8e01b2e42b09 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:30.652139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1158/2316] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:07:30 2021] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:30.653575 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecfc3b-6202-4ed5-a127-2b1b2fbad580 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:30.664925 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecfc3b-6202-4ed5-a127-2b1b2fbad580 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:30.724418 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab49cee-7e76-4451-b73e-c600732cf982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:30.725113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab49cee-7e76-4451-b73e-c600732cf982 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:30.725421 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab49cee-7e76-4451-b73e-c600732cf982 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:30.725661 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab49cee-7e76-4451-b73e-c600732cf982 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:30.726598 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab49cee-7e76-4451-b73e-c600732cf982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:30.728557 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab49cee-7e76-4451-b73e-c600732cf982 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:30.770073 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1159/2317] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:07:30 2021] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:30.770529 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0937-f8ba-44d1-b68d-8e01b2e42b09 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:30.781181 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0937-f8ba-44d1-b68d-8e01b2e42b09 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:30.786769 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a83b8-dec8-4551-a0f0-10ccd22fd097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:30.787569 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a83b8-dec8-4551-a0f0-10ccd22fd097 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:30.788222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a83b8-dec8-4551-a0f0-10ccd22fd097 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:30.788790 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a83b8-dec8-4551-a0f0-10ccd22fd097 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:30.789802 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a83b8-dec8-4551-a0f0-10ccd22fd097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:30.791748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a83b8-dec8-4551-a0f0-10ccd22fd097 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:30.805846 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1159/2318] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:30 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:30.810770 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab49cee-7e76-4451-b73e-c600732cf982 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:30.822226 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab49cee-7e76-4451-b73e-c600732cf982 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:30.828392 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a89a8-bbb2-46f2-801c-b4dad38a9f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:30.829465 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a89a8-bbb2-46f2-801c-b4dad38a9f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:30.829752 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a89a8-bbb2-46f2-801c-b4dad38a9f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:30.831013 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a89a8-bbb2-46f2-801c-b4dad38a9f84 admin admin] PATH_INFO: `/v3/projects/84907c4ad68648d3be9eb928fa50aed3/users/26c97147f8b447d48159264469e289fc/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:30.867002 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a89a8-bbb2-46f2-801c-b4dad38a9f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84907c4ad68648d3be9eb928fa50aed3, user_id=26c97147f8b447d48159264469e289fc, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:30.869800 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a89a8-bbb2-46f2-801c-b4dad38a9f84 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:30.883868 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1160/2319] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:07:30 2021] PUT /identity/v3/projects/84907c4ad68648d3be9eb928fa50aed3/users/26c97147f8b447d48159264469e289fc/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:30.887999 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a83b8-dec8-4551-a0f0-10ccd22fd097 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:30.898285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a83b8-dec8-4551-a0f0-10ccd22fd097 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:30.953495 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e02281-7534-4214-9eb1-66d7469dff68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:30.954162 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e02281-7534-4214-9eb1-66d7469dff68 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:30.954474 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e02281-7534-4214-9eb1-66d7469dff68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:30.954720 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e02281-7534-4214-9eb1-66d7469dff68 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:30.956177 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e02281-7534-4214-9eb1-66d7469dff68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:30.957767 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e02281-7534-4214-9eb1-66d7469dff68 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:30.971393 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1160/2320] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:30 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:07:30.972513 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a89a8-bbb2-46f2-801c-b4dad38a9f84 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:30.983104 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a89a8-bbb2-46f2-801c-b4dad38a9f84 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:30.987890 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd61eea-f8f9-4b7d-8a03-affa3b55e3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:30.988778 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd61eea-f8f9-4b7d-8a03-affa3b55e3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:30.989059 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd61eea-f8f9-4b7d-8a03-affa3b55e3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:30.989333 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd61eea-f8f9-4b7d-8a03-affa3b55e3bc admin admin] PATH_INFO: `/v3/projects/84907c4ad68648d3be9eb928fa50aed3/users/26c97147f8b447d48159264469e289fc/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:30.991679 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd61eea-f8f9-4b7d-8a03-affa3b55e3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=84907c4ad68648d3be9eb928fa50aed3, user_id=26c97147f8b447d48159264469e289fc, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:30.994432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd61eea-f8f9-4b7d-8a03-affa3b55e3bc admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:31.008538 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1161/2321] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:07:30 2021] PUT /identity/v3/projects/84907c4ad68648d3be9eb928fa50aed3/users/26c97147f8b447d48159264469e289fc/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:31.019308 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a658d50-6f3b-484c-835a-0a23a1f46f8b None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:31.019872 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a658d50-6f3b-484c-835a-0a23a1f46f8b None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:31.020143 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a658d50-6f3b-484c-835a-0a23a1f46f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:31.046463 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-9a658d50-6f3b-484c-835a-0a23a1f46f8b None None] MFA Rules not processed for user `26c97147f8b447d48159264469e289fc`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:31.047726 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-9a658d50-6f3b-484c-835a-0a23a1f46f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:31.113529 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1161/2322] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:31 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:31.125840 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd61eea-f8f9-4b7d-8a03-affa3b55e3bc admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:31.127648 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-1cd61eea-f8f9-4b7d-8a03-affa3b55e3bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:31.208612 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd61eea-f8f9-4b7d-8a03-affa3b55e3bc admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:31.212761 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a76afc-4eee-4f7f-a339-2517cc7eb993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:31.213545 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a76afc-4eee-4f7f-a339-2517cc7eb993 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:31.213831 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a76afc-4eee-4f7f-a339-2517cc7eb993 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:31.214116 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a76afc-4eee-4f7f-a339-2517cc7eb993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:31.224926 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a76afc-4eee-4f7f-a339-2517cc7eb993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:31.226400 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a76afc-4eee-4f7f-a339-2517cc7eb993 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:31.236911 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1162/2323] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:31 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:07:31.271725 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f921a7e-78d6-4bd6-b24b-719e5d8a5d41 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:31.272026 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f921a7e-78d6-4bd6-b24b-719e5d8a5d41 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:31.272300 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f921a7e-78d6-4bd6-b24b-719e5d8a5d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:31.291090 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-6f921a7e-78d6-4bd6-b24b-719e5d8a5d41 None None] MFA Rules not processed for user `b1918e2aa8f24655875480ef52df324d`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:31.292424 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-6f921a7e-78d6-4bd6-b24b-719e5d8a5d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:31.349828 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1162/2324] 10.222.0.39 () {58 vars in 1010 bytes} [Tue Aug 31 03:07:31 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:31.364706 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a76afc-4eee-4f7f-a339-2517cc7eb993 service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:31.366299 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-45a76afc-4eee-4f7f-a339-2517cc7eb993 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:31.444828 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a76afc-4eee-4f7f-a339-2517cc7eb993 service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:31.450066 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6747750-6fee-47de-bcc8-0f88acdfe7ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ed84d2e3ce4c85b552732f3294aac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:31.450718 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6747750-6fee-47de-bcc8-0f88acdfe7ad service swift] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:31.451243 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6747750-6fee-47de-bcc8-0f88acdfe7ad service swift] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:31.451243 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6747750-6fee-47de-bcc8-0f88acdfe7ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:31.459877 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6747750-6fee-47de-bcc8-0f88acdfe7ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:31.461464 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6747750-6fee-47de-bcc8-0f88acdfe7ad service swift] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:31.469865 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1163/2325] 10.222.0.39 () {60 vars in 1385 bytes} [Tue Aug 31 03:07:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 03:07:31.904071 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f921a7e-78d6-4bd6-b24b-719e5d8a5d41 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:31.915666 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f921a7e-78d6-4bd6-b24b-719e5d8a5d41 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:31.920042 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10191e5-45d5-4927-a070-39bdb2341c5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:31.920890 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10191e5-45d5-4927-a070-39bdb2341c5b service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:31.921330 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10191e5-45d5-4927-a070-39bdb2341c5b service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:31.921762 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10191e5-45d5-4927-a070-39bdb2341c5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:32.032515 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10191e5-45d5-4927-a070-39bdb2341c5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:32.043127 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10191e5-45d5-4927-a070-39bdb2341c5b service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:32.069590 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1163/2326] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:31 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:07:45.073204 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937b892-57c1-4c8f-ac07-a4a0af371095 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:45.073777 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937b892-57c1-4c8f-ac07-a4a0af371095 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:45.073777 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937b892-57c1-4c8f-ac07-a4a0af371095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:45.091531 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-e937b892-57c1-4c8f-ac07-a4a0af371095 None None] MFA Rules not processed for user `0205de7c01fb4cedb6f011e067f3f6e1`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:45.092756 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-e937b892-57c1-4c8f-ac07-a4a0af371095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:45.154453 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1164/2327] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:45 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:45.711187 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10191e5-45d5-4927-a070-39bdb2341c5b service cinder] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:45.712797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a10191e5-45d5-4927-a070-39bdb2341c5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:45.730142 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10191e5-45d5-4927-a070-39bdb2341c5b service cinder] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:45.736717 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b660fc-2e42-4a6c-a052-8d6140d68409 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:45.737724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b660fc-2e42-4a6c-a052-8d6140d68409 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:45.738207 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b660fc-2e42-4a6c-a052-8d6140d68409 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:45.738674 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b660fc-2e42-4a6c-a052-8d6140d68409 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:45.817305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b660fc-2e42-4a6c-a052-8d6140d68409 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:45.818812 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b660fc-2e42-4a6c-a052-8d6140d68409 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:45.828525 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1164/2328] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:45 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:07:46.417055 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937b892-57c1-4c8f-ac07-a4a0af371095 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:46.418542 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-e937b892-57c1-4c8f-ac07-a4a0af371095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:46.492463 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937b892-57c1-4c8f-ac07-a4a0af371095 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:46.499230 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d187d6d-04e8-452c-86b3-8c36c319c327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:46.500268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d187d6d-04e8-452c-86b3-8c36c319c327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:46.500679 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d187d6d-04e8-452c-86b3-8c36c319c327 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:46.501045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d187d6d-04e8-452c-86b3-8c36c319c327 admin admin] PATH_INFO: `/v3/users/177fe8364b6f4a2f9116fa4763e3a550` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:46.503696 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d187d6d-04e8-452c-86b3-8c36c319c327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=177fe8364b6f4a2f9116fa4763e3a550)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:46.506123 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d187d6d-04e8-452c-86b3-8c36c319c327 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:46.571525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5d187d6d-04e8-452c-86b3-8c36c319c327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '177fe8364b6f4a2f9116fa4763e3a550'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:46.584108 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5d187d6d-04e8-452c-86b3-8c36c319c327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '177fe8364b6f4a2f9116fa4763e3a550'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:46.585064 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5d187d6d-04e8-452c-86b3-8c36c319c327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '177fe8364b6f4a2f9116fa4763e3a550'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:46.592267 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5d187d6d-04e8-452c-86b3-8c36c319c327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '177fe8364b6f4a2f9116fa4763e3a550'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:46.601530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5d187d6d-04e8-452c-86b3-8c36c319c327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '177fe8364b6f4a2f9116fa4763e3a550'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:46.612953 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1165/2329] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:07:46 2021] DELETE /identity/v3/users/177fe8364b6f4a2f9116fa4763e3a550 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:46.615083 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad09529-3087-44ba-8384-d4ed559c143c None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:46.615408 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad09529-3087-44ba-8384-d4ed559c143c None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:46.615681 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad09529-3087-44ba-8384-d4ed559c143c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:46.647819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-7ad09529-3087-44ba-8384-d4ed559c143c None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:46.649466 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-7ad09529-3087-44ba-8384-d4ed559c143c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:46.762733 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1165/2330] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:46.789400 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d187d6d-04e8-452c-86b3-8c36c319c327 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:46.790940 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-5d187d6d-04e8-452c-86b3-8c36c319c327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:46.883534 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d187d6d-04e8-452c-86b3-8c36c319c327 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:46.887121 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423fb28-25a2-4691-b41e-250c2d4f7f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:46.887913 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423fb28-25a2-4691-b41e-250c2d4f7f46 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:46.888073 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423fb28-25a2-4691-b41e-250c2d4f7f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:46.888350 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423fb28-25a2-4691-b41e-250c2d4f7f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:46.898182 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423fb28-25a2-4691-b41e-250c2d4f7f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:46.899668 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423fb28-25a2-4691-b41e-250c2d4f7f46 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:46.909250 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1166/2331] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:07:47.424039 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad09529-3087-44ba-8384-d4ed559c143c None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:47.425513 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-7ad09529-3087-44ba-8384-d4ed559c143c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:47.436972 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad09529-3087-44ba-8384-d4ed559c143c None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:47.442116 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a2fd2-ab1d-4a3a-9dc7-16ead3b4d91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:47.442990 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a2fd2-ab1d-4a3a-9dc7-16ead3b4d91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:47.443267 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a2fd2-ab1d-4a3a-9dc7-16ead3b4d91b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:47.443568 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a2fd2-ab1d-4a3a-9dc7-16ead3b4d91b admin admin] PATH_INFO: `/v3/projects/2d0ec3beef554b9a8376959a8e6c30a1` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:47.444748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a2fd2-ab1d-4a3a-9dc7-16ead3b4d91b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d0ec3beef554b9a8376959a8e6c30a1)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:47.446653 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a2fd2-ab1d-4a3a-9dc7-16ead3b4d91b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:47.505996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-046a2fd2-ab1d-4a3a-9dc7-16ead3b4d91b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d0ec3beef554b9a8376959a8e6c30a1', 'request_id': 'req-046a2fd2-ab1d-4a3a-9dc7-16ead3b4d91b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:47.513334 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-046a2fd2-ab1d-4a3a-9dc7-16ead3b4d91b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d0ec3beef554b9a8376959a8e6c30a1', 'request_id': 'req-046a2fd2-ab1d-4a3a-9dc7-16ead3b4d91b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:47.518721 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-046a2fd2-ab1d-4a3a-9dc7-16ead3b4d91b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d0ec3beef554b9a8376959a8e6c30a1', 'request_id': 'req-046a2fd2-ab1d-4a3a-9dc7-16ead3b4d91b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:47.530882 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-046a2fd2-ab1d-4a3a-9dc7-16ead3b4d91b admin admin] The token cache is being invalidate because project 2d0ec3beef554b9a8376959a8e6c30a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:07:47.531194 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-046a2fd2-ab1d-4a3a-9dc7-16ead3b4d91b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:47.532008 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-046a2fd2-ab1d-4a3a-9dc7-16ead3b4d91b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:47.533911 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1166/2332] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:07:47 2021] DELETE /identity/v3/projects/2d0ec3beef554b9a8376959a8e6c30a1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:47.542288 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d8026-b3e8-47ef-ad5c-1d6f6ee6136e None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:47.542779 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d8026-b3e8-47ef-ad5c-1d6f6ee6136e None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:47.542892 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d8026-b3e8-47ef-ad5c-1d6f6ee6136e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:47.562013 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-578d8026-b3e8-47ef-ad5c-1d6f6ee6136e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:47.563209 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-578d8026-b3e8-47ef-ad5c-1d6f6ee6136e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:47.639408 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1167/2333] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:47.644515 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52c09a-999e-4b31-aa7b-2db65c4feb90 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:47.644879 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52c09a-999e-4b31-aa7b-2db65c4feb90 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:47.645226 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52c09a-999e-4b31-aa7b-2db65c4feb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:47.665130 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-ee52c09a-999e-4b31-aa7b-2db65c4feb90 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:47.666482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-ee52c09a-999e-4b31-aa7b-2db65c4feb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:47.681683 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1167/2334] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:07:47.683301 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d8026-b3e8-47ef-ad5c-1d6f6ee6136e None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:47.695548 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d8026-b3e8-47ef-ad5c-1d6f6ee6136e None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:47.700228 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea063818-aecc-420b-b734-ee27cc414fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:47.700883 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea063818-aecc-420b-b734-ee27cc414fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:47.701345 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea063818-aecc-420b-b734-ee27cc414fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:47.701787 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea063818-aecc-420b-b734-ee27cc414fa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:47.702656 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea063818-aecc-420b-b734-ee27cc414fa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:07:47.703087 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea063818-aecc-420b-b734-ee27cc414fa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:47.705358 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea063818-aecc-420b-b734-ee27cc414fa4 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:47.718504 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1168/2335] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:07:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:07:47.724025 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52c09a-999e-4b31-aa7b-2db65c4feb90 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:47.733985 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52c09a-999e-4b31-aa7b-2db65c4feb90 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:47.739692 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc2c17-2ff4-4522-ba2e-e4982b59a9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:47.740344 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc2c17-2ff4-4522-ba2e-e4982b59a9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:47.740630 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc2c17-2ff4-4522-ba2e-e4982b59a9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:47.740899 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc2c17-2ff4-4522-ba2e-e4982b59a9b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:47.741712 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc2c17-2ff4-4522-ba2e-e4982b59a9b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:47.743745 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc2c17-2ff4-4522-ba2e-e4982b59a9b0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:47.773906 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1168/2336] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:07:47 2021] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:47.778062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea063818-aecc-420b-b734-ee27cc414fa4 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:47.790771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea063818-aecc-420b-b734-ee27cc414fa4 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:47.862371 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2305d-15b1-4f00-8b74-6f1a6724b7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:47.863517 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2305d-15b1-4f00-8b74-6f1a6724b7fb admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:47.863898 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2305d-15b1-4f00-8b74-6f1a6724b7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:47.864402 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2305d-15b1-4f00-8b74-6f1a6724b7fb admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:47.865382 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2305d-15b1-4f00-8b74-6f1a6724b7fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:47.869054 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2305d-15b1-4f00-8b74-6f1a6724b7fb admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:47.898259 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1169/2337] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:07:47 2021] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:07:47.902232 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc2c17-2ff4-4522-ba2e-e4982b59a9b0 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:47.914076 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc2c17-2ff4-4522-ba2e-e4982b59a9b0 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:47.919673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14a8fd-9252-4661-b711-5b15a6306162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:47.920570 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14a8fd-9252-4661-b711-5b15a6306162 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:47.920851 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14a8fd-9252-4661-b711-5b15a6306162 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:47.921129 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14a8fd-9252-4661-b711-5b15a6306162 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:47.921862 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14a8fd-9252-4661-b711-5b15a6306162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:47.924377 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14a8fd-9252-4661-b711-5b15a6306162 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:47.938255 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1169/2338] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:47 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:47.942116 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2305d-15b1-4f00-8b74-6f1a6724b7fb admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:47.952334 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2305d-15b1-4f00-8b74-6f1a6724b7fb admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:47.958529 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a65c2-623c-498a-9584-04371d8556a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:47.959291 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a65c2-623c-498a-9584-04371d8556a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:47.959625 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a65c2-623c-498a-9584-04371d8556a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:47.959898 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a65c2-623c-498a-9584-04371d8556a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:47.960631 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a65c2-623c-498a-9584-04371d8556a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:47.962418 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a65c2-623c-498a-9584-04371d8556a6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:47.978140 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1170/2339] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:47 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:47.982270 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14a8fd-9252-4661-b711-5b15a6306162 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:48.010444 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14a8fd-9252-4661-b711-5b15a6306162 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:48.023006 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a65c2-623c-498a-9584-04371d8556a6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:48.025336 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ef9a65c2-623c-498a-9584-04371d8556a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:48.026597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8be57c-683d-45a4-b1ae-25c04ebde550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:48.028503 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8be57c-683d-45a4-b1ae-25c04ebde550 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:48.029490 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8be57c-683d-45a4-b1ae-25c04ebde550 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:48.029850 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8be57c-683d-45a4-b1ae-25c04ebde550 admin admin] PATH_INFO: `/v3/projects/14b6381710ab43a399d108dbe1d67a1c/users/b49460aabd874a378370c3ddc9cfa704/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:48.042482 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a65c2-623c-498a-9584-04371d8556a6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:48.048048 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7f9ed-6f3c-4917-87df-415d0939cc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:48.049984 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7f9ed-6f3c-4917-87df-415d0939cc9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:48.050335 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7f9ed-6f3c-4917-87df-415d0939cc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:48.051044 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7f9ed-6f3c-4917-87df-415d0939cc9b admin admin] PATH_INFO: `/v3/users/0def5e89888a4efa8f7474143d366bce` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:48.051203 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8be57c-683d-45a4-b1ae-25c04ebde550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b6381710ab43a399d108dbe1d67a1c, user_id=b49460aabd874a378370c3ddc9cfa704, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:48.052732 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7f9ed-6f3c-4917-87df-415d0939cc9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0def5e89888a4efa8f7474143d366bce)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:48.054592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8be57c-683d-45a4-b1ae-25c04ebde550 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:48.054928 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7f9ed-6f3c-4917-87df-415d0939cc9b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:48.078166 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1170/2340] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:07:47 2021] PUT /identity/v3/projects/14b6381710ab43a399d108dbe1d67a1c/users/b49460aabd874a378370c3ddc9cfa704/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:48.083904 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d21039-1b27-4a43-ab36-f85626c5ec40 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:48.084400 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d21039-1b27-4a43-ab36-f85626c5ec40 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:48.084874 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d21039-1b27-4a43-ab36-f85626c5ec40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:48.110536 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-90d21039-1b27-4a43-ab36-f85626c5ec40 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:48.112279 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-90d21039-1b27-4a43-ab36-f85626c5ec40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:48.132573 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1fa7f9ed-6f3c-4917-87df-415d0939cc9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0def5e89888a4efa8f7474143d366bce'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:48.147228 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1fa7f9ed-6f3c-4917-87df-415d0939cc9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0def5e89888a4efa8f7474143d366bce'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:48.151579 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1fa7f9ed-6f3c-4917-87df-415d0939cc9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0def5e89888a4efa8f7474143d366bce'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:48.170096 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1fa7f9ed-6f3c-4917-87df-415d0939cc9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0def5e89888a4efa8f7474143d366bce'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:48.181031 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1fa7f9ed-6f3c-4917-87df-415d0939cc9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0def5e89888a4efa8f7474143d366bce'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:48.185226 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1171/2341] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:07:48.190771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1171/2342] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:07:48 2021] DELETE /identity/v3/users/0def5e89888a4efa8f7474143d366bce => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:07:48.192390 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f8540-3a20-4dbf-a496-49b1d6535603 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:48.192692 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f8540-3a20-4dbf-a496-49b1d6535603 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:48.192985 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f8540-3a20-4dbf-a496-49b1d6535603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:48.196618 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7f9ed-6f3c-4917-87df-415d0939cc9b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:48.198086 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-1fa7f9ed-6f3c-4917-87df-415d0939cc9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:48.211594 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-de6f8540-3a20-4dbf-a496-49b1d6535603 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:48.212839 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-de6f8540-3a20-4dbf-a496-49b1d6535603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:48.262007 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7f9ed-6f3c-4917-87df-415d0939cc9b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:48.266011 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf2464-ad0a-428d-a761-b1c9a8369d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:48.266647 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf2464-ad0a-428d-a761-b1c9a8369d91 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:48.266924 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf2464-ad0a-428d-a761-b1c9a8369d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:48.267758 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf2464-ad0a-428d-a761-b1c9a8369d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:48.276285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1172/2343] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:07:48.288469 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f8540-3a20-4dbf-a496-49b1d6535603 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:48.298646 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f8540-3a20-4dbf-a496-49b1d6535603 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:48.303500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d601f55-d331-485a-aae8-50fd5e5001ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:48.304147 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d601f55-d331-485a-aae8-50fd5e5001ae service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:48.304429 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d601f55-d331-485a-aae8-50fd5e5001ae service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:48.304724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d601f55-d331-485a-aae8-50fd5e5001ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:48.314665 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d601f55-d331-485a-aae8-50fd5e5001ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:48.316838 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d601f55-d331-485a-aae8-50fd5e5001ae service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:48.326737 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1173/2344] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:07:48.333779 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf2464-ad0a-428d-a761-b1c9a8369d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:48.335263 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf2464-ad0a-428d-a761-b1c9a8369d91 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:48.344872 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1172/2345] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:07:50.005004 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d601f55-d331-485a-aae8-50fd5e5001ae service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:50.008118 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-2d601f55-d331-485a-aae8-50fd5e5001ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:50.029230 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d601f55-d331-485a-aae8-50fd5e5001ae service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:50.044135 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687112b-7fa7-420f-811d-5a44056c2fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:50.045730 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687112b-7fa7-420f-811d-5a44056c2fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:50.046313 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687112b-7fa7-420f-811d-5a44056c2fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:50.047625 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687112b-7fa7-420f-811d-5a44056c2fb4 admin admin] PATH_INFO: `/v3/projects/635e1dbc2e0147b89542d75161a2bbf0` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:50.050945 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687112b-7fa7-420f-811d-5a44056c2fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=635e1dbc2e0147b89542d75161a2bbf0)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:50.056705 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687112b-7fa7-420f-811d-5a44056c2fb4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:50.138604 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-6687112b-7fa7-420f-811d-5a44056c2fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '635e1dbc2e0147b89542d75161a2bbf0', 'request_id': 'req-6687112b-7fa7-420f-811d-5a44056c2fb4'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:50.146428 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-6687112b-7fa7-420f-811d-5a44056c2fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '635e1dbc2e0147b89542d75161a2bbf0', 'request_id': 'req-6687112b-7fa7-420f-811d-5a44056c2fb4'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:50.160371 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-6687112b-7fa7-420f-811d-5a44056c2fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '635e1dbc2e0147b89542d75161a2bbf0', 'request_id': 'req-6687112b-7fa7-420f-811d-5a44056c2fb4'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:50.178968 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-6687112b-7fa7-420f-811d-5a44056c2fb4 admin admin] The token cache is being invalidate because project 635e1dbc2e0147b89542d75161a2bbf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:07:50.179691 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-6687112b-7fa7-420f-811d-5a44056c2fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:50.180644 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-6687112b-7fa7-420f-811d-5a44056c2fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:50.186520 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1174/2346] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:07:50 2021] DELETE /identity/v3/projects/635e1dbc2e0147b89542d75161a2bbf0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:50.187555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf2464-ad0a-428d-a761-b1c9a8369d91 service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:50.198652 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf2464-ad0a-428d-a761-b1c9a8369d91 service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:50.326285 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728541f-9ba2-4bca-92ca-0de55d223cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:50.327532 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728541f-9ba2-4bca-92ca-0de55d223cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:50.327967 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728541f-9ba2-4bca-92ca-0de55d223cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:50.328392 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728541f-9ba2-4bca-92ca-0de55d223cb1 admin admin] PATH_INFO: `/v3/users/a74e772c2a91496abad8506061e151cb` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:50.332211 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728541f-9ba2-4bca-92ca-0de55d223cb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a74e772c2a91496abad8506061e151cb)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:50.336048 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728541f-9ba2-4bca-92ca-0de55d223cb1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:50.413905 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-8728541f-9ba2-4bca-92ca-0de55d223cb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a74e772c2a91496abad8506061e151cb'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:50.426824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-8728541f-9ba2-4bca-92ca-0de55d223cb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a74e772c2a91496abad8506061e151cb'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:50.427746 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-8728541f-9ba2-4bca-92ca-0de55d223cb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a74e772c2a91496abad8506061e151cb'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:50.436942 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-8728541f-9ba2-4bca-92ca-0de55d223cb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a74e772c2a91496abad8506061e151cb'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:50.447861 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-8728541f-9ba2-4bca-92ca-0de55d223cb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a74e772c2a91496abad8506061e151cb'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:50.459911 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1173/2347] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:07:50 2021] DELETE /identity/v3/users/a74e772c2a91496abad8506061e151cb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:07:51.202453 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687112b-7fa7-420f-811d-5a44056c2fb4 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:51.204256 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-6687112b-7fa7-420f-811d-5a44056c2fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:51.225040 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687112b-7fa7-420f-811d-5a44056c2fb4 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:51.323375 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08efce6-ac4e-4b8e-bf3c-1047c8559d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:51.327619 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08efce6-ac4e-4b8e-bf3c-1047c8559d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:51.327923 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08efce6-ac4e-4b8e-bf3c-1047c8559d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:51.328212 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08efce6-ac4e-4b8e-bf3c-1047c8559d6a admin admin] PATH_INFO: `/v3/projects/a9b8629242ef4b9abcd1d2f4df7eae24` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:51.330479 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08efce6-ac4e-4b8e-bf3c-1047c8559d6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9b8629242ef4b9abcd1d2f4df7eae24)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:51.332806 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08efce6-ac4e-4b8e-bf3c-1047c8559d6a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:51.410545 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c08efce6-ac4e-4b8e-bf3c-1047c8559d6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9b8629242ef4b9abcd1d2f4df7eae24', 'request_id': 'req-c08efce6-ac4e-4b8e-bf3c-1047c8559d6a'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:51.420134 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c08efce6-ac4e-4b8e-bf3c-1047c8559d6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9b8629242ef4b9abcd1d2f4df7eae24', 'request_id': 'req-c08efce6-ac4e-4b8e-bf3c-1047c8559d6a'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:51.427645 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c08efce6-ac4e-4b8e-bf3c-1047c8559d6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9b8629242ef4b9abcd1d2f4df7eae24', 'request_id': 'req-c08efce6-ac4e-4b8e-bf3c-1047c8559d6a'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:51.444268 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c08efce6-ac4e-4b8e-bf3c-1047c8559d6a admin admin] The token cache is being invalidate because project a9b8629242ef4b9abcd1d2f4df7eae24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:07:51.444572 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c08efce6-ac4e-4b8e-bf3c-1047c8559d6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:51.445530 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c08efce6-ac4e-4b8e-bf3c-1047c8559d6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:51.447662 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1175/2348] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:07:51 2021] DELETE /identity/v3/projects/a9b8629242ef4b9abcd1d2f4df7eae24 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:51.451222 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728541f-9ba2-4bca-92ca-0de55d223cb1 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:51.453314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-8728541f-9ba2-4bca-92ca-0de55d223cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:51.466643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728541f-9ba2-4bca-92ca-0de55d223cb1 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:51.542210 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5c60b-46bf-4f43-8634-e34813422f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:51.543135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5c60b-46bf-4f43-8634-e34813422f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:51.543507 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5c60b-46bf-4f43-8634-e34813422f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:51.544118 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5c60b-46bf-4f43-8634-e34813422f02 admin admin] PATH_INFO: `/v3/users/26c97147f8b447d48159264469e289fc` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:51.545975 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5c60b-46bf-4f43-8634-e34813422f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26c97147f8b447d48159264469e289fc)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:51.549540 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5c60b-46bf-4f43-8634-e34813422f02 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:51.626888 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-24e5c60b-46bf-4f43-8634-e34813422f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26c97147f8b447d48159264469e289fc'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:51.652355 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-24e5c60b-46bf-4f43-8634-e34813422f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26c97147f8b447d48159264469e289fc'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:51.653511 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-24e5c60b-46bf-4f43-8634-e34813422f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26c97147f8b447d48159264469e289fc'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:51.665010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-24e5c60b-46bf-4f43-8634-e34813422f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26c97147f8b447d48159264469e289fc'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:51.681732 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-24e5c60b-46bf-4f43-8634-e34813422f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26c97147f8b447d48159264469e289fc'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:51.700424 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1174/2349] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:07:51 2021] DELETE /identity/v3/users/26c97147f8b447d48159264469e289fc => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:07:52.489840 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08efce6-ac4e-4b8e-bf3c-1047c8559d6a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:52.492223 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c08efce6-ac4e-4b8e-bf3c-1047c8559d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:52.510944 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08efce6-ac4e-4b8e-bf3c-1047c8559d6a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:52.523705 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5c60b-46bf-4f43-8634-e34813422f02 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:52.525368 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-24e5c60b-46bf-4f43-8634-e34813422f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:52.583834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dabd20-69e2-4690-96c0-f9384d2b8992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:52.585476 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dabd20-69e2-4690-96c0-f9384d2b8992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:52.586002 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dabd20-69e2-4690-96c0-f9384d2b8992 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:52.586491 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dabd20-69e2-4690-96c0-f9384d2b8992 admin admin] PATH_INFO: `/v3/projects/84907c4ad68648d3be9eb928fa50aed3` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:52.588697 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dabd20-69e2-4690-96c0-f9384d2b8992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84907c4ad68648d3be9eb928fa50aed3)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:52.591177 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dabd20-69e2-4690-96c0-f9384d2b8992 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:52.667886 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5c60b-46bf-4f43-8634-e34813422f02 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:52.681202 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-d1dabd20-69e2-4690-96c0-f9384d2b8992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84907c4ad68648d3be9eb928fa50aed3', 'request_id': 'req-d1dabd20-69e2-4690-96c0-f9384d2b8992'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:52.698327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-d1dabd20-69e2-4690-96c0-f9384d2b8992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84907c4ad68648d3be9eb928fa50aed3', 'request_id': 'req-d1dabd20-69e2-4690-96c0-f9384d2b8992'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:52.712917 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-d1dabd20-69e2-4690-96c0-f9384d2b8992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84907c4ad68648d3be9eb928fa50aed3', 'request_id': 'req-d1dabd20-69e2-4690-96c0-f9384d2b8992'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:52.737588 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-d1dabd20-69e2-4690-96c0-f9384d2b8992 admin admin] The token cache is being invalidate because project 84907c4ad68648d3be9eb928fa50aed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:07:52.738023 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-d1dabd20-69e2-4690-96c0-f9384d2b8992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:52.740025 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-d1dabd20-69e2-4690-96c0-f9384d2b8992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:52.749370 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1176/2350] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:07:52 2021] DELETE /identity/v3/projects/84907c4ad68648d3be9eb928fa50aed3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:52.756833 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1cc60-dc7b-4e18-aa8a-a99c36849730 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:52.757134 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1cc60-dc7b-4e18-aa8a-a99c36849730 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:52.757388 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1cc60-dc7b-4e18-aa8a-a99c36849730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:52.784420 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4622ec-08a3-47c3-a043-8f442cdb9f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:52.785455 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4622ec-08a3-47c3-a043-8f442cdb9f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:52.785873 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4622ec-08a3-47c3-a043-8f442cdb9f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:52.786600 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4622ec-08a3-47c3-a043-8f442cdb9f7e admin admin] PATH_INFO: `/v3/users/029cbdf4fa7340549518b28e20c9328d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:52.788458 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4622ec-08a3-47c3-a043-8f442cdb9f7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=029cbdf4fa7340549518b28e20c9328d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:52.791521 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4622ec-08a3-47c3-a043-8f442cdb9f7e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:52.792822 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-7af1cc60-dc7b-4e18-aa8a-a99c36849730 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:52.805129 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-7af1cc60-dc7b-4e18-aa8a-a99c36849730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:52.816840 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1177/2351] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:52.828566 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1cba6-1cba-4e7b-be2e-1d7b58d53f79 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:52.829066 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1cba6-1cba-4e7b-be2e-1d7b58d53f79 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:52.830079 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1cba6-1cba-4e7b-be2e-1d7b58d53f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:52.868940 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-e3a1cba6-1cba-4e7b-be2e-1d7b58d53f79 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:52.870409 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-e3a1cba6-1cba-4e7b-be2e-1d7b58d53f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:52.880294 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1178/2352] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:52.884590 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1cba6-1cba-4e7b-be2e-1d7b58d53f79 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:52.887268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ee4622ec-08a3-47c3-a043-8f442cdb9f7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029cbdf4fa7340549518b28e20c9328d'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:52.902423 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1cba6-1cba-4e7b-be2e-1d7b58d53f79 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:52.902656 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ee4622ec-08a3-47c3-a043-8f442cdb9f7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029cbdf4fa7340549518b28e20c9328d'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:52.903239 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ee4622ec-08a3-47c3-a043-8f442cdb9f7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029cbdf4fa7340549518b28e20c9328d'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:52.912573 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee6203-0fdb-4439-a038-ff7296336414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:52.913461 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee6203-0fdb-4439-a038-ff7296336414 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:52.913968 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee6203-0fdb-4439-a038-ff7296336414 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:52.914600 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ee4622ec-08a3-47c3-a043-8f442cdb9f7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029cbdf4fa7340549518b28e20c9328d'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:52.916239 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee6203-0fdb-4439-a038-ff7296336414 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:52.917657 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee6203-0fdb-4439-a038-ff7296336414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:07:52.918376 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee6203-0fdb-4439-a038-ff7296336414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:52.921285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee6203-0fdb-4439-a038-ff7296336414 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:52.924441 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ee4622ec-08a3-47c3-a043-8f442cdb9f7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029cbdf4fa7340549518b28e20c9328d'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:52.932284 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1175/2353] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:07:52 2021] DELETE /identity/v3/users/029cbdf4fa7340549518b28e20c9328d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:07:52.952707 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1179/2354] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:07:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:07:52.956715 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4622ec-08a3-47c3-a043-8f442cdb9f7e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:52.958282 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ee4622ec-08a3-47c3-a043-8f442cdb9f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:53.053942 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4622ec-08a3-47c3-a043-8f442cdb9f7e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:53.069910 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3088f22-4e55-448d-94ee-bc7a337dc69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:53.070606 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3088f22-4e55-448d-94ee-bc7a337dc69e admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:53.070906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3088f22-4e55-448d-94ee-bc7a337dc69e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:53.071160 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3088f22-4e55-448d-94ee-bc7a337dc69e admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:53.071902 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3088f22-4e55-448d-94ee-bc7a337dc69e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:53.075240 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3088f22-4e55-448d-94ee-bc7a337dc69e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:53.135413 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1176/2355] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:07:52 2021] POST /identity/v3/projects => generated 393 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:53.140055 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee6203-0fdb-4439-a038-ff7296336414 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:53.155980 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee6203-0fdb-4439-a038-ff7296336414 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:53.182282 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3088f22-4e55-448d-94ee-bc7a337dc69e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:53.184347 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a3088f22-4e55-448d-94ee-bc7a337dc69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:53.227450 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262c253-729c-46c1-a43e-440259d8daff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:53.228550 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c253-729c-46c1-a43e-440259d8daff admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:53.228983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c253-729c-46c1-a43e-440259d8daff admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:53.229451 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c253-729c-46c1-a43e-440259d8daff admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:53.230570 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262c253-729c-46c1-a43e-440259d8daff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:53.233204 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262c253-729c-46c1-a43e-440259d8daff admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:53.270996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1180/2356] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:07:53 2021] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:53.272068 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262c253-729c-46c1-a43e-440259d8daff admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:53.283315 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262c253-729c-46c1-a43e-440259d8daff admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:53.289365 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2d279-8494-41c6-8dd9-340f0bc5726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:53.290200 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2d279-8494-41c6-8dd9-340f0bc5726c admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:53.290500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2d279-8494-41c6-8dd9-340f0bc5726c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:53.290884 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2d279-8494-41c6-8dd9-340f0bc5726c admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:53.291782 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2d279-8494-41c6-8dd9-340f0bc5726c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:53.293486 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2d279-8494-41c6-8dd9-340f0bc5726c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:53.304530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3088f22-4e55-448d-94ee-bc7a337dc69e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:53.306456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1181/2357] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:53 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:53.317267 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26b58e-48d6-4be1-98fd-b4cde623bf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:53.317416 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2d279-8494-41c6-8dd9-340f0bc5726c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:53.318451 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26b58e-48d6-4be1-98fd-b4cde623bf85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:53.318881 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26b58e-48d6-4be1-98fd-b4cde623bf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:53.319442 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26b58e-48d6-4be1-98fd-b4cde623bf85 admin admin] PATH_INFO: `/v3/projects/a2341cbfd5bf46039747c27a0d5fb8f9` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:53.320831 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26b58e-48d6-4be1-98fd-b4cde623bf85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2341cbfd5bf46039747c27a0d5fb8f9)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:53.322929 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26b58e-48d6-4be1-98fd-b4cde623bf85 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:53.329248 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2d279-8494-41c6-8dd9-340f0bc5726c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:53.335442 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215dc5e-cc92-4e9d-9508-109bb0d04b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:53.335924 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215dc5e-cc92-4e9d-9508-109bb0d04b6f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:53.336313 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215dc5e-cc92-4e9d-9508-109bb0d04b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:53.336748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215dc5e-cc92-4e9d-9508-109bb0d04b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:53.337693 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215dc5e-cc92-4e9d-9508-109bb0d04b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:53.339482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215dc5e-cc92-4e9d-9508-109bb0d04b6f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:53.356697 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1182/2358] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:53 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:53.361262 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215dc5e-cc92-4e9d-9508-109bb0d04b6f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:53.372519 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215dc5e-cc92-4e9d-9508-109bb0d04b6f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:53.379209 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c519120-5c80-4a1b-81a3-6d836435c761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:53.380327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c519120-5c80-4a1b-81a3-6d836435c761 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:53.380870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c519120-5c80-4a1b-81a3-6d836435c761 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:53.381140 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c519120-5c80-4a1b-81a3-6d836435c761 admin admin] PATH_INFO: `/v3/projects/48b0123f0673448887c6850abbc5ba11/users/c754df134a854284b1613bf32c244623/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:53.392485 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5e26b58e-48d6-4be1-98fd-b4cde623bf85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2341cbfd5bf46039747c27a0d5fb8f9', 'request_id': 'req-5e26b58e-48d6-4be1-98fd-b4cde623bf85'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:53.400199 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c519120-5c80-4a1b-81a3-6d836435c761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b0123f0673448887c6850abbc5ba11, user_id=c754df134a854284b1613bf32c244623, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:53.403263 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5e26b58e-48d6-4be1-98fd-b4cde623bf85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2341cbfd5bf46039747c27a0d5fb8f9', 'request_id': 'req-5e26b58e-48d6-4be1-98fd-b4cde623bf85'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:53.403592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c519120-5c80-4a1b-81a3-6d836435c761 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:53.412351 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5e26b58e-48d6-4be1-98fd-b4cde623bf85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2341cbfd5bf46039747c27a0d5fb8f9', 'request_id': 'req-5e26b58e-48d6-4be1-98fd-b4cde623bf85'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:53.422223 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1183/2359] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:07:53 2021] PUT /identity/v3/projects/48b0123f0673448887c6850abbc5ba11/users/c754df134a854284b1613bf32c244623/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:07:53.425372 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5e26b58e-48d6-4be1-98fd-b4cde623bf85 admin admin] The token cache is being invalidate because project a2341cbfd5bf46039747c27a0d5fb8f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:07:53.425668 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5e26b58e-48d6-4be1-98fd-b4cde623bf85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:53.426609 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5e26b58e-48d6-4be1-98fd-b4cde623bf85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:53.428995 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1177/2360] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:07:53 2021] DELETE /identity/v3/projects/a2341cbfd5bf46039747c27a0d5fb8f9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:53.433576 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1aadc8-ff69-4090-af1a-9b2a19397a58 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:53.433869 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1aadc8-ff69-4090-af1a-9b2a19397a58 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:53.434394 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1aadc8-ff69-4090-af1a-9b2a19397a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:53.434626 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac4905-07e2-4761-b367-f912ee768f0a None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:53.434923 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac4905-07e2-4761-b367-f912ee768f0a None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:53.435199 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac4905-07e2-4761-b367-f912ee768f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:53.462412 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-c8ac4905-07e2-4761-b367-f912ee768f0a None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:53.463840 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c8ac4905-07e2-4761-b367-f912ee768f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:53.473575 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-ce1aadc8-ff69-4090-af1a-9b2a19397a58 None None] MFA Rules not processed for user `c754df134a854284b1613bf32c244623`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:53.475720 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-ce1aadc8-ff69-4090-af1a-9b2a19397a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:53.543459 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1178/2361] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:53.568233 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286f6e9-55f0-43a2-9e6f-c6bf3ffcf84b None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:53.568585 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286f6e9-55f0-43a2-9e6f-c6bf3ffcf84b None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:53.568780 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286f6e9-55f0-43a2-9e6f-c6bf3ffcf84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:53.591080 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-e286f6e9-55f0-43a2-9e6f-c6bf3ffcf84b None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:53.592530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-e286f6e9-55f0-43a2-9e6f-c6bf3ffcf84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:53.602466 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1179/2362] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:53.607962 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286f6e9-55f0-43a2-9e6f-c6bf3ffcf84b None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:53.616451 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1184/2363] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:53 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:53.621148 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1aadc8-ff69-4090-af1a-9b2a19397a58 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:53.623106 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-ce1aadc8-ff69-4090-af1a-9b2a19397a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:53.624653 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286f6e9-55f0-43a2-9e6f-c6bf3ffcf84b None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:53.632136 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00bc682-bbdd-46e6-83f2-40ed788b8e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:53.633372 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bc682-bbdd-46e6-83f2-40ed788b8e9f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:53.633372 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bc682-bbdd-46e6-83f2-40ed788b8e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:53.633695 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bc682-bbdd-46e6-83f2-40ed788b8e9f admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:53.634950 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00bc682-bbdd-46e6-83f2-40ed788b8e9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:07:53.635266 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00bc682-bbdd-46e6-83f2-40ed788b8e9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:53.636917 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00bc682-bbdd-46e6-83f2-40ed788b8e9f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:53.647313 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1aadc8-ff69-4090-af1a-9b2a19397a58 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:53.654808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1180/2364] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:07:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:07:53.655775 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00bc682-bbdd-46e6-83f2-40ed788b8e9f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:53.663996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d1fb8-6c57-44f5-8d1f-43f9fc7579f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:53.665193 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d1fb8-6c57-44f5-8d1f-43f9fc7579f0 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:53.666140 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d1fb8-6c57-44f5-8d1f-43f9fc7579f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:53.666802 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d1fb8-6c57-44f5-8d1f-43f9fc7579f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:53.667782 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d1fb8-6c57-44f5-8d1f-43f9fc7579f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:53.671071 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d1fb8-6c57-44f5-8d1f-43f9fc7579f0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:53.698426 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00bc682-bbdd-46e6-83f2-40ed788b8e9f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:53.712456 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee3277-f42e-4691-870b-8d45f5b7b310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:53.713135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee3277-f42e-4691-870b-8d45f5b7b310 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:53.714546 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee3277-f42e-4691-870b-8d45f5b7b310 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:53.714546 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee3277-f42e-4691-870b-8d45f5b7b310 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:53.714546 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee3277-f42e-4691-870b-8d45f5b7b310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:53.723029 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee3277-f42e-4691-870b-8d45f5b7b310 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:53.723562 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1185/2365] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:07:53 2021] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:53.727533 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d1fb8-6c57-44f5-8d1f-43f9fc7579f0 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:53.769018 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1181/2366] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:07:53 2021] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:53.774526 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee3277-f42e-4691-870b-8d45f5b7b310 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:53.909584 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d1fb8-6c57-44f5-8d1f-43f9fc7579f0 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:53.925144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee3277-f42e-4691-870b-8d45f5b7b310 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:53.930018 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c462db-20bb-4d66-a22f-81e8c31e1691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:53.931009 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c462db-20bb-4d66-a22f-81e8c31e1691 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:53.931540 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c462db-20bb-4d66-a22f-81e8c31e1691 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:53.932012 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c462db-20bb-4d66-a22f-81e8c31e1691 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:53.932904 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c462db-20bb-4d66-a22f-81e8c31e1691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:53.935059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c462db-20bb-4d66-a22f-81e8c31e1691 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:53.936878 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff277b8-4ff8-40cf-86a2-e92d94fe9b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:53.937573 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff277b8-4ff8-40cf-86a2-e92d94fe9b8a admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:53.937837 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff277b8-4ff8-40cf-86a2-e92d94fe9b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:53.938113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff277b8-4ff8-40cf-86a2-e92d94fe9b8a admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:53.939177 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff277b8-4ff8-40cf-86a2-e92d94fe9b8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:53.941182 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff277b8-4ff8-40cf-86a2-e92d94fe9b8a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:53.987121 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1182/2367] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:07:53 2021] POST /identity/v3/users => generated 282 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:53.988087 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff277b8-4ff8-40cf-86a2-e92d94fe9b8a admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:53.998758 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff277b8-4ff8-40cf-86a2-e92d94fe9b8a admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:54.000164 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1186/2368] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:07:53 2021] POST /identity/v3/users => generated 303 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:54.001119 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c462db-20bb-4d66-a22f-81e8c31e1691 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:54.004800 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45e2f5-bab3-4535-b136-b85477bf05aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:54.005966 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45e2f5-bab3-4535-b136-b85477bf05aa admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:54.006405 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45e2f5-bab3-4535-b136-b85477bf05aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:54.006843 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45e2f5-bab3-4535-b136-b85477bf05aa admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:54.008158 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45e2f5-bab3-4535-b136-b85477bf05aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:54.010836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45e2f5-bab3-4535-b136-b85477bf05aa admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:54.029344 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c462db-20bb-4d66-a22f-81e8c31e1691 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:54.042845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab54988-d95a-4f44-88f3-39faad7815df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:54.042845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab54988-d95a-4f44-88f3-39faad7815df admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:54.042845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab54988-d95a-4f44-88f3-39faad7815df admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:54.043203 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab54988-d95a-4f44-88f3-39faad7815df admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:54.044626 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1183/2369] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:53 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:54.047603 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab54988-d95a-4f44-88f3-39faad7815df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:54.049242 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45e2f5-bab3-4535-b136-b85477bf05aa admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:54.050094 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab54988-d95a-4f44-88f3-39faad7815df admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:54.062929 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45e2f5-bab3-4535-b136-b85477bf05aa admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:54.068948 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e4510-b68c-481c-a4ce-be5198c46b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:54.070110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e4510-b68c-481c-a4ce-be5198c46b12 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:54.070612 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e4510-b68c-481c-a4ce-be5198c46b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:54.071250 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e4510-b68c-481c-a4ce-be5198c46b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:54.073127 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e4510-b68c-481c-a4ce-be5198c46b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:54.075264 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e4510-b68c-481c-a4ce-be5198c46b12 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:54.078306 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1187/2370] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:54 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:54.079243 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab54988-d95a-4f44-88f3-39faad7815df admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:54.096299 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1184/2371] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:54 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:07:54.101271 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e4510-b68c-481c-a4ce-be5198c46b12 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:54.103807 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab54988-d95a-4f44-88f3-39faad7815df admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:54.126057 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e4510-b68c-481c-a4ce-be5198c46b12 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:54.131938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcbcc6-4894-49f2-89e3-6d57d28faba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:54.132218 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e02222-83a9-4944-a78f-6ef4f3dae853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:54.133083 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcbcc6-4894-49f2-89e3-6d57d28faba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:54.133215 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e02222-83a9-4944-a78f-6ef4f3dae853 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:54.133370 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcbcc6-4894-49f2-89e3-6d57d28faba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:54.133617 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e02222-83a9-4944-a78f-6ef4f3dae853 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:54.133739 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcbcc6-4894-49f2-89e3-6d57d28faba4 admin admin] PATH_INFO: `/v3/projects/c57ffcca48f14bbcb002a941fbd4cfea/users/2ece89a3c25d4d2893bcb86534029926/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:54.133885 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e02222-83a9-4944-a78f-6ef4f3dae853 admin admin] PATH_INFO: `/v3/projects/f6738279b4eb4d79aa3cd37575b742d3/users/afe44c5be0064f348472d200445c6826/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:54.155832 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e02222-83a9-4944-a78f-6ef4f3dae853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6738279b4eb4d79aa3cd37575b742d3, user_id=afe44c5be0064f348472d200445c6826, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:54.159434 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e02222-83a9-4944-a78f-6ef4f3dae853 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:54.164930 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcbcc6-4894-49f2-89e3-6d57d28faba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57ffcca48f14bbcb002a941fbd4cfea, user_id=2ece89a3c25d4d2893bcb86534029926, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:54.168200 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcbcc6-4894-49f2-89e3-6d57d28faba4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:54.178463 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1185/2372] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:07:54 2021] PUT /identity/v3/projects/f6738279b4eb4d79aa3cd37575b742d3/users/afe44c5be0064f348472d200445c6826/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:54.185667 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1188/2373] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:07:54 2021] PUT /identity/v3/projects/c57ffcca48f14bbcb002a941fbd4cfea/users/2ece89a3c25d4d2893bcb86534029926/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:54.190002 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0d1cb-d34d-433d-a37b-28b02365d6fd None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:54.190636 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0d1cb-d34d-433d-a37b-28b02365d6fd None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:54.190994 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcbcc6-4894-49f2-89e3-6d57d28faba4 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:54.191431 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0d1cb-d34d-433d-a37b-28b02365d6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:54.246161 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-52b0d1cb-d34d-433d-a37b-28b02365d6fd None None] MFA Rules not processed for user `afe44c5be0064f348472d200445c6826`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:54.249254 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-52b0d1cb-d34d-433d-a37b-28b02365d6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:54.288957 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcbcc6-4894-49f2-89e3-6d57d28faba4 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:54.297504 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954f61f-bb76-4c13-a0b1-d108f3f69f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:54.298870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954f61f-bb76-4c13-a0b1-d108f3f69f12 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:54.299298 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954f61f-bb76-4c13-a0b1-d108f3f69f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:54.300191 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954f61f-bb76-4c13-a0b1-d108f3f69f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:54.302395 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954f61f-bb76-4c13-a0b1-d108f3f69f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:54.304280 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954f61f-bb76-4c13-a0b1-d108f3f69f12 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:54.323722 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1189/2374] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:54 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:07:54.327999 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954f61f-bb76-4c13-a0b1-d108f3f69f12 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:54.344275 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954f61f-bb76-4c13-a0b1-d108f3f69f12 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:54.351704 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96388324-b92d-4c93-8b02-83addb30ba77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:54.353518 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96388324-b92d-4c93-8b02-83addb30ba77 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:54.354390 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96388324-b92d-4c93-8b02-83addb30ba77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:54.354921 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96388324-b92d-4c93-8b02-83addb30ba77 admin admin] PATH_INFO: `/v3/projects/c57ffcca48f14bbcb002a941fbd4cfea/users/2ece89a3c25d4d2893bcb86534029926/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:54.355915 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1186/2375] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:54 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:54.358050 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96388324-b92d-4c93-8b02-83addb30ba77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57ffcca48f14bbcb002a941fbd4cfea, user_id=2ece89a3c25d4d2893bcb86534029926, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:54.359941 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0d1cb-d34d-433d-a37b-28b02365d6fd None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:54.362938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96388324-b92d-4c93-8b02-83addb30ba77 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:54.385306 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0d1cb-d34d-433d-a37b-28b02365d6fd None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:54.391465 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1190/2376] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:07:54 2021] PUT /identity/v3/projects/c57ffcca48f14bbcb002a941fbd4cfea/users/2ece89a3c25d4d2893bcb86534029926/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:54.393529 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541218c9-3b75-4def-9e45-95468783289d None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:54.393824 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541218c9-3b75-4def-9e45-95468783289d None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:54.394111 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541218c9-3b75-4def-9e45-95468783289d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:54.453412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-541218c9-3b75-4def-9e45-95468783289d None None] MFA Rules not processed for user `2ece89a3c25d4d2893bcb86534029926`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:54.454753 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-541218c9-3b75-4def-9e45-95468783289d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:54.473299 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4d988-4de5-437d-bdf0-671ff2553876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:54.474017 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4d988-4de5-437d-bdf0-671ff2553876 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:54.474305 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4d988-4de5-437d-bdf0-671ff2553876 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:54.474578 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4d988-4de5-437d-bdf0-671ff2553876 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:54.475390 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4d988-4de5-437d-bdf0-671ff2553876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:54.477446 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4d988-4de5-437d-bdf0-671ff2553876 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:54.512071 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1187/2377] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:07:54 2021] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:54.513998 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce44631-6ece-4b5b-97db-8f58190b86c5 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:54.514287 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce44631-6ece-4b5b-97db-8f58190b86c5 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:54.514634 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce44631-6ece-4b5b-97db-8f58190b86c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:54.542940 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-dce44631-6ece-4b5b-97db-8f58190b86c5 None None] MFA Rules not processed for user `b49460aabd874a378370c3ddc9cfa704`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:54.544407 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-dce44631-6ece-4b5b-97db-8f58190b86c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:54.561763 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1191/2378] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:54 2021] POST /identity/v3/auth/tokens => generated 3480 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:07:54.563049 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541218c9-3b75-4def-9e45-95468783289d None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:54.577432 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541218c9-3b75-4def-9e45-95468783289d None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:54.612328 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1188/2379] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:54 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:54.613004 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce44631-6ece-4b5b-97db-8f58190b86c5 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:54.614285 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-dce44631-6ece-4b5b-97db-8f58190b86c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:54.638952 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d3955-9a52-45ce-9250-e419675971c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:54.639676 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d3955-9a52-45ce-9250-e419675971c8 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:54.643620 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d3955-9a52-45ce-9250-e419675971c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:54.643940 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d3955-9a52-45ce-9250-e419675971c8 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:54.645121 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d3955-9a52-45ce-9250-e419675971c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:54.647271 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d3955-9a52-45ce-9250-e419675971c8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:54.669786 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1192/2380] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:07:54 2021] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:54.671511 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d3955-9a52-45ce-9250-e419675971c8 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:54.676828 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-9d8d3955-9a52-45ce-9250-e419675971c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:54.684360 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce44631-6ece-4b5b-97db-8f58190b86c5 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:54.689812 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c59a7e-f7ed-49bb-8ab4-79e5efdbfa88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:54.690483 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c59a7e-f7ed-49bb-8ab4-79e5efdbfa88 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:54.690765 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c59a7e-f7ed-49bb-8ab4-79e5efdbfa88 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:54.691043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c59a7e-f7ed-49bb-8ab4-79e5efdbfa88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:54.691511 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d3955-9a52-45ce-9250-e419675971c8 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:54.696487 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced16a46-aea3-4f74-92ba-00c8bb2aff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:54.697420 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced16a46-aea3-4f74-92ba-00c8bb2aff1d admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:54.697856 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced16a46-aea3-4f74-92ba-00c8bb2aff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:54.698280 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced16a46-aea3-4f74-92ba-00c8bb2aff1d admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:54.699119 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced16a46-aea3-4f74-92ba-00c8bb2aff1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:54.701219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced16a46-aea3-4f74-92ba-00c8bb2aff1d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:54.731291 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1193/2381] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:07:54 2021] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:54.732420 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced16a46-aea3-4f74-92ba-00c8bb2aff1d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:54.758597 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c59a7e-f7ed-49bb-8ab4-79e5efdbfa88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:54.760200 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c59a7e-f7ed-49bb-8ab4-79e5efdbfa88 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:54.771017 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1189/2382] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:54 2021] GET /identity/v3/auth/tokens => generated 3480 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:07:54.772068 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c59a7e-f7ed-49bb-8ab4-79e5efdbfa88 service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:54.788085 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c59a7e-f7ed-49bb-8ab4-79e5efdbfa88 service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:54.820890 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced16a46-aea3-4f74-92ba-00c8bb2aff1d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:54.827855 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ac800-43ad-4500-a02b-6784cbcf38f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:54.829069 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ac800-43ad-4500-a02b-6784cbcf38f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:54.830572 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ac800-43ad-4500-a02b-6784cbcf38f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:54.831207 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ac800-43ad-4500-a02b-6784cbcf38f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:54.832253 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ac800-43ad-4500-a02b-6784cbcf38f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:54.834208 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ac800-43ad-4500-a02b-6784cbcf38f4 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:54.848726 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1194/2383] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:54 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:54.867867 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ac800-43ad-4500-a02b-6784cbcf38f4 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:54.879236 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067fd30-cb6f-4405-9f60-197d1f0f8d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:54.879958 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067fd30-cb6f-4405-9f60-197d1f0f8d0b admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:54.880244 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067fd30-cb6f-4405-9f60-197d1f0f8d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:54.880773 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067fd30-cb6f-4405-9f60-197d1f0f8d0b admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:54.881506 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ac800-43ad-4500-a02b-6784cbcf38f4 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:54.881841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067fd30-cb6f-4405-9f60-197d1f0f8d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:54.885055 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067fd30-cb6f-4405-9f60-197d1f0f8d0b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:54.887790 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5730d34-4271-442f-bfbb-72d805f794c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:54.889182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5730d34-4271-442f-bfbb-72d805f794c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:54.889679 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5730d34-4271-442f-bfbb-72d805f794c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:54.890213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5730d34-4271-442f-bfbb-72d805f794c7 admin admin] PATH_INFO: `/v3/projects/65dd6af59fb348eb8c4effd89bada36d/users/7027c7ca2a3446019d9a3bff16511331/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:54.911143 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5730d34-4271-442f-bfbb-72d805f794c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65dd6af59fb348eb8c4effd89bada36d, user_id=7027c7ca2a3446019d9a3bff16511331, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:54.919987 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1190/2384] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:07:54 2021] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:07:54.920934 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067fd30-cb6f-4405-9f60-197d1f0f8d0b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:54.924759 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f067fd30-cb6f-4405-9f60-197d1f0f8d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:54.930315 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5730d34-4271-442f-bfbb-72d805f794c7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:54.960394 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1195/2385] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:07:54 2021] PUT /identity/v3/projects/65dd6af59fb348eb8c4effd89bada36d/users/7027c7ca2a3446019d9a3bff16511331/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:54.961919 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5730d34-4271-442f-bfbb-72d805f794c7 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:55.010513 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067fd30-cb6f-4405-9f60-197d1f0f8d0b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:55.061619 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5730d34-4271-442f-bfbb-72d805f794c7 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:55.070847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5640ed8-d611-4bc7-985f-17e38f4dfe64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:55.071547 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5640ed8-d611-4bc7-985f-17e38f4dfe64 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:55.071865 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5640ed8-d611-4bc7-985f-17e38f4dfe64 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:55.072643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5640ed8-d611-4bc7-985f-17e38f4dfe64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:55.077404 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a6edf-ac0d-4296-83d5-cf6c06196930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:55.078263 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a6edf-ac0d-4296-83d5-cf6c06196930 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:55.078686 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a6edf-ac0d-4296-83d5-cf6c06196930 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:55.080312 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a6edf-ac0d-4296-83d5-cf6c06196930 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:55.081076 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a6edf-ac0d-4296-83d5-cf6c06196930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:55.083564 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a6edf-ac0d-4296-83d5-cf6c06196930 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:55.097811 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1196/2386] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:54 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:55.102936 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a6edf-ac0d-4296-83d5-cf6c06196930 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:55.116403 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a6edf-ac0d-4296-83d5-cf6c06196930 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:55.123076 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2ca81-d15a-48a2-b307-ff8474b283cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:55.124891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2ca81-d15a-48a2-b307-ff8474b283cd admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:55.124891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2ca81-d15a-48a2-b307-ff8474b283cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:55.124891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2ca81-d15a-48a2-b307-ff8474b283cd admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:55.125873 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2ca81-d15a-48a2-b307-ff8474b283cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:55.128715 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2ca81-d15a-48a2-b307-ff8474b283cd admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:55.145678 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1197/2387] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:55 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:55.147059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2ca81-d15a-48a2-b307-ff8474b283cd admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:55.161594 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2ca81-d15a-48a2-b307-ff8474b283cd admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:55.165763 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5640ed8-d611-4bc7-985f-17e38f4dfe64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:55.167212 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5640ed8-d611-4bc7-985f-17e38f4dfe64 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:55.176769 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2d220-1c2c-4519-8149-e44dd16bf715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:55.178545 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2d220-1c2c-4519-8149-e44dd16bf715 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:55.179288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2d220-1c2c-4519-8149-e44dd16bf715 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:55.179951 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2d220-1c2c-4519-8149-e44dd16bf715 admin admin] PATH_INFO: `/v3/projects/5dff8ce800d545b1bef70e9f100eb50a/users/e0f24343057c41a985280477785081bd/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:55.190006 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1191/2388] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:54 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:07:55.190944 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5640ed8-d611-4bc7-985f-17e38f4dfe64 service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:55.201523 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2d220-1c2c-4519-8149-e44dd16bf715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dff8ce800d545b1bef70e9f100eb50a, user_id=e0f24343057c41a985280477785081bd, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:55.204905 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2d220-1c2c-4519-8149-e44dd16bf715 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:55.215491 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5640ed8-d611-4bc7-985f-17e38f4dfe64 service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:55.225799 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1198/2389] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:07:55 2021] PUT /identity/v3/projects/5dff8ce800d545b1bef70e9f100eb50a/users/e0f24343057c41a985280477785081bd/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:55.230532 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2d220-1c2c-4519-8149-e44dd16bf715 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:55.308837 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae858c3b-1087-4bb0-8b0e-960b6e2382cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:55.310518 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae858c3b-1087-4bb0-8b0e-960b6e2382cf admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:55.310518 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae858c3b-1087-4bb0-8b0e-960b6e2382cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:55.310518 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae858c3b-1087-4bb0-8b0e-960b6e2382cf admin admin] PATH_INFO: `/v3/projects/65dd6af59fb348eb8c4effd89bada36d/users/7027c7ca2a3446019d9a3bff16511331/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:55.314411 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae858c3b-1087-4bb0-8b0e-960b6e2382cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=65dd6af59fb348eb8c4effd89bada36d, user_id=7027c7ca2a3446019d9a3bff16511331, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:55.318494 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae858c3b-1087-4bb0-8b0e-960b6e2382cf admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:55.320717 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2d220-1c2c-4519-8149-e44dd16bf715 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:55.329312 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c56a2d-2380-422a-82af-5a5d212aa89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:55.330842 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c56a2d-2380-422a-82af-5a5d212aa89e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:55.331252 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c56a2d-2380-422a-82af-5a5d212aa89e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:55.331637 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c56a2d-2380-422a-82af-5a5d212aa89e admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:55.332450 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c56a2d-2380-422a-82af-5a5d212aa89e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:55.335273 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1192/2390] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:07:55 2021] PUT /identity/v3/projects/65dd6af59fb348eb8c4effd89bada36d/users/7027c7ca2a3446019d9a3bff16511331/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:55.344816 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c56a2d-2380-422a-82af-5a5d212aa89e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:55.345434 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113972f-c0fd-49ad-96ef-6629f9bd01a6 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:55.345733 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113972f-c0fd-49ad-96ef-6629f9bd01a6 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:55.346035 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113972f-c0fd-49ad-96ef-6629f9bd01a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:55.358668 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1199/2391] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:07:55 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:07:55.362805 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c56a2d-2380-422a-82af-5a5d212aa89e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:55.376981 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c56a2d-2380-422a-82af-5a5d212aa89e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:55.381963 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-4113972f-c0fd-49ad-96ef-6629f9bd01a6 None None] MFA Rules not processed for user `7027c7ca2a3446019d9a3bff16511331`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:55.383495 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-4113972f-c0fd-49ad-96ef-6629f9bd01a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:55.445804 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455d973-0e0d-45bd-a7f6-dbc2b3481703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:55.447214 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455d973-0e0d-45bd-a7f6-dbc2b3481703 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:55.447744 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455d973-0e0d-45bd-a7f6-dbc2b3481703 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:55.448245 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455d973-0e0d-45bd-a7f6-dbc2b3481703 admin admin] PATH_INFO: `/v3/projects/5dff8ce800d545b1bef70e9f100eb50a/users/e0f24343057c41a985280477785081bd/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:55.450549 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455d973-0e0d-45bd-a7f6-dbc2b3481703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dff8ce800d545b1bef70e9f100eb50a, user_id=e0f24343057c41a985280477785081bd, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:55.454324 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455d973-0e0d-45bd-a7f6-dbc2b3481703 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:55.472257 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1193/2392] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:55 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:07:55.503586 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113972f-c0fd-49ad-96ef-6629f9bd01a6 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:55.506690 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1200/2393] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:07:55 2021] PUT /identity/v3/projects/5dff8ce800d545b1bef70e9f100eb50a/users/e0f24343057c41a985280477785081bd/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:55.596305 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113972f-c0fd-49ad-96ef-6629f9bd01a6 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:55.683328 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9559b-a70a-4ac6-8e6b-7ffb5dc048c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:55.684411 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9559b-a70a-4ac6-8e6b-7ffb5dc048c6 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:55.684824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9559b-a70a-4ac6-8e6b-7ffb5dc048c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:55.685138 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9559b-a70a-4ac6-8e6b-7ffb5dc048c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:55.759625 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9559b-a70a-4ac6-8e6b-7ffb5dc048c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:55.761150 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9559b-a70a-4ac6-8e6b-7ffb5dc048c6 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:55.773963 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1194/2394] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:55 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:07:55.872934 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455d973-0e0d-45bd-a7f6-dbc2b3481703 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:55.887137 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455d973-0e0d-45bd-a7f6-dbc2b3481703 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:55.891976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9654e40-d9b0-458e-adb0-453a9660416a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:55.893225 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9654e40-d9b0-458e-adb0-453a9660416a service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:55.893718 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9654e40-d9b0-458e-adb0-453a9660416a service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:55.894307 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9654e40-d9b0-458e-adb0-453a9660416a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:55.967938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9654e40-d9b0-458e-adb0-453a9660416a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:55.969391 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9654e40-d9b0-458e-adb0-453a9660416a service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:55.994066 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1201/2395] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:55 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:07:56.214837 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d48a98-ac83-4cf3-849a-691bbaf55a8f None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:56.215203 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d48a98-ac83-4cf3-849a-691bbaf55a8f None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:56.215851 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d48a98-ac83-4cf3-849a-691bbaf55a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:56.299109 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-23d48a98-ac83-4cf3-849a-691bbaf55a8f None None] MFA Rules not processed for user `b1918e2aa8f24655875480ef52df324d`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:56.300849 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-23d48a98-ac83-4cf3-849a-691bbaf55a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:56.396036 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1195/2396] 10.222.0.39 () {58 vars in 968 bytes} [Tue Aug 31 03:07:56 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:56.414051 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9654e40-d9b0-458e-adb0-453a9660416a service cinder] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:56.415819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f9654e40-d9b0-458e-adb0-453a9660416a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:56.619666 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9654e40-d9b0-458e-adb0-453a9660416a service cinder] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:56.624855 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b9b8b-2a7d-4166-bbf3-1e86c4a7fd65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ed84d2e3ce4c85b552732f3294aac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:56.625512 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b9b8b-2a7d-4166-bbf3-1e86c4a7fd65 service swift] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:56.625791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b9b8b-2a7d-4166-bbf3-1e86c4a7fd65 service swift] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:56.626065 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b9b8b-2a7d-4166-bbf3-1e86c4a7fd65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:56.644837 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b9b8b-2a7d-4166-bbf3-1e86c4a7fd65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:56.646416 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b9b8b-2a7d-4166-bbf3-1e86c4a7fd65 service swift] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:56.676887 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1202/2397] 10.222.0.39 () {60 vars in 1385 bytes} [Tue Aug 31 03:07:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 03:07:59.195588 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d48a98-ac83-4cf3-849a-691bbaf55a8f None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:59.343249 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d48a98-ac83-4cf3-849a-691bbaf55a8f None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:59.353059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b9b8b-2a7d-4166-bbf3-1e86c4a7fd65 service swift] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:59.365268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a40c7-6c29-44a5-a789-e57327621c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:59.366280 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a40c7-6c29-44a5-a789-e57327621c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:59.366558 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a40c7-6c29-44a5-a789-e57327621c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:59.366824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a40c7-6c29-44a5-a789-e57327621c59 admin admin] PATH_INFO: `/v3/users/afe44c5be0064f348472d200445c6826` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:59.368478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b9b8b-2a7d-4166-bbf3-1e86c4a7fd65 service swift] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:59.371729 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a40c7-6c29-44a5-a789-e57327621c59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe44c5be0064f348472d200445c6826)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:59.392651 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a40c7-6c29-44a5-a789-e57327621c59 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:59.398057 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aef2ca-d2af-45dc-aad6-e3091348ea18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:59.398924 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aef2ca-d2af-45dc-aad6-e3091348ea18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:59.399208 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aef2ca-d2af-45dc-aad6-e3091348ea18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:59.399508 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aef2ca-d2af-45dc-aad6-e3091348ea18 admin admin] PATH_INFO: `/v3/users/c754df134a854284b1613bf32c244623` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:59.404520 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aef2ca-d2af-45dc-aad6-e3091348ea18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c754df134a854284b1613bf32c244623)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:59.412020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aef2ca-d2af-45dc-aad6-e3091348ea18 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:59.506186 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c76a40c7-6c29-44a5-a789-e57327621c59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe44c5be0064f348472d200445c6826'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:59.527658 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c76a40c7-6c29-44a5-a789-e57327621c59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe44c5be0064f348472d200445c6826'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:59.528474 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c76a40c7-6c29-44a5-a789-e57327621c59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe44c5be0064f348472d200445c6826'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:59.538666 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-05aef2ca-d2af-45dc-aad6-e3091348ea18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c754df134a854284b1613bf32c244623'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:59.539425 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-05aef2ca-d2af-45dc-aad6-e3091348ea18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c754df134a854284b1613bf32c244623'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:59.540217 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-05aef2ca-d2af-45dc-aad6-e3091348ea18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c754df134a854284b1613bf32c244623'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:59.550868 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c76a40c7-6c29-44a5-a789-e57327621c59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe44c5be0064f348472d200445c6826'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:59.559451 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-05aef2ca-d2af-45dc-aad6-e3091348ea18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c754df134a854284b1613bf32c244623'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:59.570981 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c76a40c7-6c29-44a5-a789-e57327621c59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe44c5be0064f348472d200445c6826'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:59.584874 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-05aef2ca-d2af-45dc-aad6-e3091348ea18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c754df134a854284b1613bf32c244623'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:07:59.607739 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1196/2398] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:07:59 2021] DELETE /identity/v3/users/afe44c5be0064f348472d200445c6826 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:07:59.609224 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c59f2-f9c5-4e66-9629-c72ea6592bc3 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:59.609512 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c59f2-f9c5-4e66-9629-c72ea6592bc3 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:59.609802 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c59f2-f9c5-4e66-9629-c72ea6592bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:59.636500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1203/2399] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:07:59 2021] DELETE /identity/v3/users/c754df134a854284b1613bf32c244623 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:07:59.638657 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea661086-d296-40d6-8901-cb081f81fb92 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:59.638657 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea661086-d296-40d6-8901-cb081f81fb92 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:59.638657 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea661086-d296-40d6-8901-cb081f81fb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:59.665094 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-423c59f2-f9c5-4e66-9629-c72ea6592bc3 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:59.666914 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-423c59f2-f9c5-4e66-9629-c72ea6592bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:59.675937 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-ea661086-d296-40d6-8901-cb081f81fb92 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:07:59.677168 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-ea661086-d296-40d6-8901-cb081f81fb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:59.813091 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1197/2400] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:59.825837 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1204/2401] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:07:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:07:59.826047 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c59f2-f9c5-4e66-9629-c72ea6592bc3 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:59.833974 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-423c59f2-f9c5-4e66-9629-c72ea6592bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:59.835193 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea661086-d296-40d6-8901-cb081f81fb92 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:07:59.838027 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-ea661086-d296-40d6-8901-cb081f81fb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:07:59.949337 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c59f2-f9c5-4e66-9629-c72ea6592bc3 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:59.951779 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea661086-d296-40d6-8901-cb081f81fb92 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:07:59.954439 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db889b-cb27-4628-a7f8-f68cdd2d854e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:59.955814 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db889b-cb27-4628-a7f8-f68cdd2d854e service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:59.956107 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db889b-cb27-4628-a7f8-f68cdd2d854e service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:59.956456 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db889b-cb27-4628-a7f8-f68cdd2d854e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:59.964270 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d17d4-43d7-4940-a735-61da08862270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:07:59.965078 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d17d4-43d7-4940-a735-61da08862270 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:07:59.965471 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d17d4-43d7-4940-a735-61da08862270 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:07:59.965856 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d17d4-43d7-4940-a735-61da08862270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:07:59.972345 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db889b-cb27-4628-a7f8-f68cdd2d854e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:59.974612 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db889b-cb27-4628-a7f8-f68cdd2d854e service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:59.984131 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d17d4-43d7-4940-a735-61da08862270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:07:59.986426 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d17d4-43d7-4940-a735-61da08862270 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:07:59.999680 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1205/2402] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:00.014297 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1198/2403] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:07:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:00.512170 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d17d4-43d7-4940-a735-61da08862270 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:00.513710 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-4d0d17d4-43d7-4940-a735-61da08862270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:00.534162 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d17d4-43d7-4940-a735-61da08862270 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:00.551121 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34314d1b-38a1-4183-8657-2cc079746813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:00.552199 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34314d1b-38a1-4183-8657-2cc079746813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:00.552584 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34314d1b-38a1-4183-8657-2cc079746813 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:00.552966 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34314d1b-38a1-4183-8657-2cc079746813 admin admin] PATH_INFO: `/v3/projects/f6738279b4eb4d79aa3cd37575b742d3` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:00.556185 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34314d1b-38a1-4183-8657-2cc079746813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6738279b4eb4d79aa3cd37575b742d3)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:00.558341 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34314d1b-38a1-4183-8657-2cc079746813 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:00.654032 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-34314d1b-38a1-4183-8657-2cc079746813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6738279b4eb4d79aa3cd37575b742d3', 'request_id': 'req-34314d1b-38a1-4183-8657-2cc079746813'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:00.670121 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-34314d1b-38a1-4183-8657-2cc079746813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6738279b4eb4d79aa3cd37575b742d3', 'request_id': 'req-34314d1b-38a1-4183-8657-2cc079746813'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:00.698380 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-34314d1b-38a1-4183-8657-2cc079746813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6738279b4eb4d79aa3cd37575b742d3', 'request_id': 'req-34314d1b-38a1-4183-8657-2cc079746813'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:00.718983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-34314d1b-38a1-4183-8657-2cc079746813 admin admin] The token cache is being invalidate because project f6738279b4eb4d79aa3cd37575b742d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:00.719581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-34314d1b-38a1-4183-8657-2cc079746813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:00.721555 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-34314d1b-38a1-4183-8657-2cc079746813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:00.724517 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1206/2404] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:00 2021] DELETE /identity/v3/projects/f6738279b4eb4d79aa3cd37575b742d3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:00.728497 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db889b-cb27-4628-a7f8-f68cdd2d854e service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:00.744194 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db889b-cb27-4628-a7f8-f68cdd2d854e service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:00.862970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a3cf5-947c-4143-b8bb-196dbd2b2dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:00.864267 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a3cf5-947c-4143-b8bb-196dbd2b2dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:00.864767 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a3cf5-947c-4143-b8bb-196dbd2b2dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:00.865254 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a3cf5-947c-4143-b8bb-196dbd2b2dc4 admin admin] PATH_INFO: `/v3/users/7027c7ca2a3446019d9a3bff16511331` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:00.870391 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a3cf5-947c-4143-b8bb-196dbd2b2dc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7027c7ca2a3446019d9a3bff16511331)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:00.872617 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a3cf5-947c-4143-b8bb-196dbd2b2dc4 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:00.972509 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4a7a3cf5-947c-4143-b8bb-196dbd2b2dc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7027c7ca2a3446019d9a3bff16511331'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.004684 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4a7a3cf5-947c-4143-b8bb-196dbd2b2dc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7027c7ca2a3446019d9a3bff16511331'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.006302 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4a7a3cf5-947c-4143-b8bb-196dbd2b2dc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7027c7ca2a3446019d9a3bff16511331'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.019717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4a7a3cf5-947c-4143-b8bb-196dbd2b2dc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7027c7ca2a3446019d9a3bff16511331'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.035532 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4a7a3cf5-947c-4143-b8bb-196dbd2b2dc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7027c7ca2a3446019d9a3bff16511331'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.043574 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1199/2405] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:08:00 2021] DELETE /identity/v3/users/7027c7ca2a3446019d9a3bff16511331 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:01.324419 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34314d1b-38a1-4183-8657-2cc079746813 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:01.326030 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-34314d1b-38a1-4183-8657-2cc079746813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:01.348429 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34314d1b-38a1-4183-8657-2cc079746813 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:01.449915 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a3cf5-947c-4143-b8bb-196dbd2b2dc4 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:01.452445 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-4a7a3cf5-947c-4143-b8bb-196dbd2b2dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:01.452673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd75a1f-beac-4d9a-aba9-16324f29354e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:01.453609 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd75a1f-beac-4d9a-aba9-16324f29354e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:01.453990 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd75a1f-beac-4d9a-aba9-16324f29354e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:01.454265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd75a1f-beac-4d9a-aba9-16324f29354e admin admin] PATH_INFO: `/v3/projects/48b0123f0673448887c6850abbc5ba11` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:01.455744 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd75a1f-beac-4d9a-aba9-16324f29354e admin admin] RBAC: Authorizing `identity:delete_project(project_id=48b0123f0673448887c6850abbc5ba11)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:01.458034 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd75a1f-beac-4d9a-aba9-16324f29354e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:01.488399 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a3cf5-947c-4143-b8bb-196dbd2b2dc4 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:01.505119 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c4f0b-8381-4745-b5ef-3f089ff0630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:01.506492 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c4f0b-8381-4745-b5ef-3f089ff0630f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:01.506913 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c4f0b-8381-4745-b5ef-3f089ff0630f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:01.507299 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c4f0b-8381-4745-b5ef-3f089ff0630f admin admin] PATH_INFO: `/v3/projects/65dd6af59fb348eb8c4effd89bada36d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:01.509038 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c4f0b-8381-4745-b5ef-3f089ff0630f admin admin] RBAC: Authorizing `identity:delete_project(project_id=65dd6af59fb348eb8c4effd89bada36d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:01.511156 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c4f0b-8381-4745-b5ef-3f089ff0630f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:01.553153 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1cd75a1f-beac-4d9a-aba9-16324f29354e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48b0123f0673448887c6850abbc5ba11', 'request_id': 'req-1cd75a1f-beac-4d9a-aba9-16324f29354e'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.560807 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1cd75a1f-beac-4d9a-aba9-16324f29354e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48b0123f0673448887c6850abbc5ba11', 'request_id': 'req-1cd75a1f-beac-4d9a-aba9-16324f29354e'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.568528 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1cd75a1f-beac-4d9a-aba9-16324f29354e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48b0123f0673448887c6850abbc5ba11', 'request_id': 'req-1cd75a1f-beac-4d9a-aba9-16324f29354e'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.598522 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1cd75a1f-beac-4d9a-aba9-16324f29354e admin admin] The token cache is being invalidate because project 48b0123f0673448887c6850abbc5ba11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:01.599025 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1cd75a1f-beac-4d9a-aba9-16324f29354e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.599982 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1cd75a1f-beac-4d9a-aba9-16324f29354e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.602231 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1207/2406] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:01 2021] DELETE /identity/v3/projects/48b0123f0673448887c6850abbc5ba11 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:01.607482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd75a1f-beac-4d9a-aba9-16324f29354e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:01.608682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-a87c4f0b-8381-4745-b5ef-3f089ff0630f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65dd6af59fb348eb8c4effd89bada36d', 'request_id': 'req-a87c4f0b-8381-4745-b5ef-3f089ff0630f'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.609600 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1cd75a1f-beac-4d9a-aba9-16324f29354e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:01.617322 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-a87c4f0b-8381-4745-b5ef-3f089ff0630f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65dd6af59fb348eb8c4effd89bada36d', 'request_id': 'req-a87c4f0b-8381-4745-b5ef-3f089ff0630f'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.631797 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-a87c4f0b-8381-4745-b5ef-3f089ff0630f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65dd6af59fb348eb8c4effd89bada36d', 'request_id': 'req-a87c4f0b-8381-4745-b5ef-3f089ff0630f'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.653374 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-a87c4f0b-8381-4745-b5ef-3f089ff0630f admin admin] The token cache is being invalidate because project 65dd6af59fb348eb8c4effd89bada36d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:01.653698 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-a87c4f0b-8381-4745-b5ef-3f089ff0630f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.654441 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-a87c4f0b-8381-4745-b5ef-3f089ff0630f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.656230 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1200/2407] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:01 2021] DELETE /identity/v3/projects/65dd6af59fb348eb8c4effd89bada36d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:01.662639 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d77efc-085f-4e51-b39f-6734ec529ad9 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:01.662925 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d77efc-085f-4e51-b39f-6734ec529ad9 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:01.663345 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d77efc-085f-4e51-b39f-6734ec529ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:01.685147 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-38d77efc-085f-4e51-b39f-6734ec529ad9 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:01.687112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-38d77efc-085f-4e51-b39f-6734ec529ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:01.710254 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd75a1f-beac-4d9a-aba9-16324f29354e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:01.810462 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0c32d-4ebd-420d-b55f-f84bf64dc611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:01.811490 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0c32d-4ebd-420d-b55f-f84bf64dc611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:01.812059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0c32d-4ebd-420d-b55f-f84bf64dc611 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:01.812415 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0c32d-4ebd-420d-b55f-f84bf64dc611 admin admin] PATH_INFO: `/v3/users/2ece89a3c25d4d2893bcb86534029926` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:01.814350 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0c32d-4ebd-420d-b55f-f84bf64dc611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ece89a3c25d4d2893bcb86534029926)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:01.816545 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0c32d-4ebd-420d-b55f-f84bf64dc611 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:01.819248 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1201/2408] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:08:01.821269 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93568fbd-56ab-479f-8881-4bfec3e48f80 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:01.821559 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93568fbd-56ab-479f-8881-4bfec3e48f80 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:01.821836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93568fbd-56ab-479f-8881-4bfec3e48f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:01.886808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-93568fbd-56ab-479f-8881-4bfec3e48f80 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:01.888144 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-93568fbd-56ab-479f-8881-4bfec3e48f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:01.914264 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1202/2409] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:01.918778 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93568fbd-56ab-479f-8881-4bfec3e48f80 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:01.926648 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-64b0c32d-4ebd-420d-b55f-f84bf64dc611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ece89a3c25d4d2893bcb86534029926'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.927343 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-64b0c32d-4ebd-420d-b55f-f84bf64dc611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ece89a3c25d4d2893bcb86534029926'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.928133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-64b0c32d-4ebd-420d-b55f-f84bf64dc611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ece89a3c25d4d2893bcb86534029926'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.935298 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93568fbd-56ab-479f-8881-4bfec3e48f80 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:01.946388 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7804b1-998e-4e53-8822-32dd99583172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:01.947354 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7804b1-998e-4e53-8822-32dd99583172 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:01.947827 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7804b1-998e-4e53-8822-32dd99583172 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:01.948277 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7804b1-998e-4e53-8822-32dd99583172 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:01.949156 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7804b1-998e-4e53-8822-32dd99583172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:08:01.949634 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7804b1-998e-4e53-8822-32dd99583172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:01.950632 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-64b0c32d-4ebd-420d-b55f-f84bf64dc611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ece89a3c25d4d2893bcb86534029926'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.952835 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7804b1-998e-4e53-8822-32dd99583172 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:01.969093 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-64b0c32d-4ebd-420d-b55f-f84bf64dc611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ece89a3c25d4d2893bcb86534029926'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:01.975437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1203/2410] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:08:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:08:01.980644 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7804b1-998e-4e53-8822-32dd99583172 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:01.982716 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-9a7804b1-998e-4e53-8822-32dd99583172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:02.000914 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1208/2411] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:08:01 2021] DELETE /identity/v3/users/2ece89a3c25d4d2893bcb86534029926 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:02.002699 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7804b1-998e-4e53-8822-32dd99583172 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:02.137544 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297d3dc-5b6a-4f91-962d-68d1a7299cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:02.138249 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297d3dc-5b6a-4f91-962d-68d1a7299cab admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:02.138637 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297d3dc-5b6a-4f91-962d-68d1a7299cab admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:02.139622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297d3dc-5b6a-4f91-962d-68d1a7299cab admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:02.140427 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297d3dc-5b6a-4f91-962d-68d1a7299cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:02.142760 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297d3dc-5b6a-4f91-962d-68d1a7299cab admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:02.155057 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52579fe-71ea-472a-8989-2f09e9796e24 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:02.155344 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52579fe-71ea-472a-8989-2f09e9796e24 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:02.155657 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52579fe-71ea-472a-8989-2f09e9796e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:02.189608 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1204/2412] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:08:01 2021] POST /identity/v3/projects => generated 367 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:02.193754 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297d3dc-5b6a-4f91-962d-68d1a7299cab admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:02.214285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-d52579fe-71ea-472a-8989-2f09e9796e24 None None] MFA Rules not processed for user `e0f24343057c41a985280477785081bd`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:02.215838 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d52579fe-71ea-472a-8989-2f09e9796e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:02.325775 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297d3dc-5b6a-4f91-962d-68d1a7299cab admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:02.330835 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1209/2413] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:02 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:08:02.340044 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52579fe-71ea-472a-8989-2f09e9796e24 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:02.341668 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d52579fe-71ea-472a-8989-2f09e9796e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:02.342811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d38d1-85a6-443f-a484-380652c1b945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:02.343726 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d38d1-85a6-443f-a484-380652c1b945 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:02.344175 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d38d1-85a6-443f-a484-380652c1b945 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:02.344645 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d38d1-85a6-443f-a484-380652c1b945 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:02.346128 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d38d1-85a6-443f-a484-380652c1b945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:02.349588 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d38d1-85a6-443f-a484-380652c1b945 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:02.386482 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1205/2414] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:08:02 2021] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:02.390366 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d38d1-85a6-443f-a484-380652c1b945 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:02.410303 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d38d1-85a6-443f-a484-380652c1b945 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:02.421837 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4515e-2ddb-431e-ae36-3f56c67bdeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:02.422884 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4515e-2ddb-431e-ae36-3f56c67bdeaa admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:02.423525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4515e-2ddb-431e-ae36-3f56c67bdeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:02.423819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4515e-2ddb-431e-ae36-3f56c67bdeaa admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:02.424831 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4515e-2ddb-431e-ae36-3f56c67bdeaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:02.427304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4515e-2ddb-431e-ae36-3f56c67bdeaa admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:02.443584 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1206/2415] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:02 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:08:02.445507 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4515e-2ddb-431e-ae36-3f56c67bdeaa admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:02.462126 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4515e-2ddb-431e-ae36-3f56c67bdeaa admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:02.464103 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52579fe-71ea-472a-8989-2f09e9796e24 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:02.470818 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82769b12-c205-4d15-923a-8dc88e886702 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:02.471793 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82769b12-c205-4d15-923a-8dc88e886702 service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:02.472076 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82769b12-c205-4d15-923a-8dc88e886702 service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:02.472334 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5fb0c-0612-4d80-b2b6-dd5485874d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:02.472482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82769b12-c205-4d15-923a-8dc88e886702 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:02.473391 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5fb0c-0612-4d80-b2b6-dd5485874d72 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:02.473827 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5fb0c-0612-4d80-b2b6-dd5485874d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:02.474254 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5fb0c-0612-4d80-b2b6-dd5485874d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:02.474384 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-82769b12-c205-4d15-923a-8dc88e886702 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:02.475246 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5fb0c-0612-4d80-b2b6-dd5485874d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:02.477355 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5fb0c-0612-4d80-b2b6-dd5485874d72 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:02.498640 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1207/2416] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:02 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:02.499574 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5fb0c-0612-4d80-b2b6-dd5485874d72 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:02.501622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-3db5fb0c-0612-4d80-b2b6-dd5485874d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:02.515274 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5fb0c-0612-4d80-b2b6-dd5485874d72 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:02.522154 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246a3e5-e227-4e02-8e6b-df1ee4aa6c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:02.523146 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246a3e5-e227-4e02-8e6b-df1ee4aa6c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:02.523470 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246a3e5-e227-4e02-8e6b-df1ee4aa6c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:02.523745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246a3e5-e227-4e02-8e6b-df1ee4aa6c21 admin admin] PATH_INFO: `/v3/projects/c57ffcca48f14bbcb002a941fbd4cfea` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:02.524943 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246a3e5-e227-4e02-8e6b-df1ee4aa6c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c57ffcca48f14bbcb002a941fbd4cfea)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:02.526856 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246a3e5-e227-4e02-8e6b-df1ee4aa6c21 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:02.548667 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82769b12-c205-4d15-923a-8dc88e886702 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:02.550279 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82769b12-c205-4d15-923a-8dc88e886702 service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:02.560836 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1210/2417] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:02 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:08:02.561751 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82769b12-c205-4d15-923a-8dc88e886702 service nova] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:02.572254 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82769b12-c205-4d15-923a-8dc88e886702 service nova] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:02.575175 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d246a3e5-e227-4e02-8e6b-df1ee4aa6c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c57ffcca48f14bbcb002a941fbd4cfea', 'request_id': 'req-d246a3e5-e227-4e02-8e6b-df1ee4aa6c21'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:02.582314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d246a3e5-e227-4e02-8e6b-df1ee4aa6c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c57ffcca48f14bbcb002a941fbd4cfea', 'request_id': 'req-d246a3e5-e227-4e02-8e6b-df1ee4aa6c21'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:02.592130 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d246a3e5-e227-4e02-8e6b-df1ee4aa6c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c57ffcca48f14bbcb002a941fbd4cfea', 'request_id': 'req-d246a3e5-e227-4e02-8e6b-df1ee4aa6c21'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:02.606122 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d246a3e5-e227-4e02-8e6b-df1ee4aa6c21 admin admin] The token cache is being invalidate because project c57ffcca48f14bbcb002a941fbd4cfea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:02.606563 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d246a3e5-e227-4e02-8e6b-df1ee4aa6c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:02.607340 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d246a3e5-e227-4e02-8e6b-df1ee4aa6c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:02.609219 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1208/2418] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:02 2021] DELETE /identity/v3/projects/c57ffcca48f14bbcb002a941fbd4cfea => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:02.617765 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20815e0-6ba1-46a1-8e58-d95a78b40f7d None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:02.618187 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20815e0-6ba1-46a1-8e58-d95a78b40f7d None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:02.618563 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20815e0-6ba1-46a1-8e58-d95a78b40f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:02.639020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ae2e4-57fd-4685-9d07-16782bf5b3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:02.639939 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ae2e4-57fd-4685-9d07-16782bf5b3bf admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:02.640222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ae2e4-57fd-4685-9d07-16782bf5b3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:02.640492 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ae2e4-57fd-4685-9d07-16782bf5b3bf admin admin] PATH_INFO: `/v3/projects/254d6562f03e42658def2aed1bebc1de/users/6d035e4f96fc47409e8275e3d47cbdac/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:02.641142 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-d20815e0-6ba1-46a1-8e58-d95a78b40f7d None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:02.643036 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-d20815e0-6ba1-46a1-8e58-d95a78b40f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:02.652598 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1209/2419] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:08:02.656693 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ae2e4-57fd-4685-9d07-16782bf5b3bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=254d6562f03e42658def2aed1bebc1de, user_id=6d035e4f96fc47409e8275e3d47cbdac, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:02.661429 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebdac1-ed93-46fd-839c-b4640f1a99e5 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:02.661717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebdac1-ed93-46fd-839c-b4640f1a99e5 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:02.661996 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebdac1-ed93-46fd-839c-b4640f1a99e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:02.664521 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ae2e4-57fd-4685-9d07-16782bf5b3bf admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:02.682346 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-b8ebdac1-ed93-46fd-839c-b4640f1a99e5 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:02.683984 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b8ebdac1-ed93-46fd-839c-b4640f1a99e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:02.686863 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1211/2420] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:02 2021] PUT /identity/v3/projects/254d6562f03e42658def2aed1bebc1de/users/6d035e4f96fc47409e8275e3d47cbdac/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:02.697310 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d4ff2-a1f5-4eac-b31a-b170338472ea None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:02.697895 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d4ff2-a1f5-4eac-b31a-b170338472ea None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:02.698340 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d4ff2-a1f5-4eac-b31a-b170338472ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:02.731453 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-215d4ff2-a1f5-4eac-b31a-b170338472ea None None] MFA Rules not processed for user `6d035e4f96fc47409e8275e3d47cbdac`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:02.732791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-215d4ff2-a1f5-4eac-b31a-b170338472ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:02.747585 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1210/2421] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:08:02.752479 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebdac1-ed93-46fd-839c-b4640f1a99e5 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:02.761477 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebdac1-ed93-46fd-839c-b4640f1a99e5 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:02.766145 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98acdcf-e271-4475-895d-72a833fa20ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:02.766804 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98acdcf-e271-4475-895d-72a833fa20ab admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:02.767714 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98acdcf-e271-4475-895d-72a833fa20ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:02.768132 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98acdcf-e271-4475-895d-72a833fa20ab admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:02.768957 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98acdcf-e271-4475-895d-72a833fa20ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:08:02.769268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98acdcf-e271-4475-895d-72a833fa20ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:02.770858 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98acdcf-e271-4475-895d-72a833fa20ab admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:02.782637 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1211/2422] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:08:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:08:02.786990 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98acdcf-e271-4475-895d-72a833fa20ab admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:02.796386 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98acdcf-e271-4475-895d-72a833fa20ab admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:02.801104 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024db5f-af26-447d-8ec6-01d8a96d2179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:02.801695 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024db5f-af26-447d-8ec6-01d8a96d2179 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:02.801963 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024db5f-af26-447d-8ec6-01d8a96d2179 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:02.802212 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1212/2423] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:02 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:02.802342 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024db5f-af26-447d-8ec6-01d8a96d2179 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:02.802890 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024db5f-af26-447d-8ec6-01d8a96d2179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:02.804863 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024db5f-af26-447d-8ec6-01d8a96d2179 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:02.806625 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d4ff2-a1f5-4eac-b31a-b170338472ea None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:02.808061 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-215d4ff2-a1f5-4eac-b31a-b170338472ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:02.821987 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d4ff2-a1f5-4eac-b31a-b170338472ea None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:02.826818 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa23b2-550b-4dbe-979a-9ae02617f51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:02.827581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa23b2-550b-4dbe-979a-9ae02617f51e admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:02.827859 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa23b2-550b-4dbe-979a-9ae02617f51e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:02.828142 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa23b2-550b-4dbe-979a-9ae02617f51e admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:02.828803 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa23b2-550b-4dbe-979a-9ae02617f51e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:02.831271 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa23b2-550b-4dbe-979a-9ae02617f51e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:02.835950 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1212/2424] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:08:02 2021] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:08:02.836809 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024db5f-af26-447d-8ec6-01d8a96d2179 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:02.858140 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1213/2425] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:08:02 2021] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:02.862363 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa23b2-550b-4dbe-979a-9ae02617f51e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:02.909977 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024db5f-af26-447d-8ec6-01d8a96d2179 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:02.934210 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa23b2-550b-4dbe-979a-9ae02617f51e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:02.940003 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10297d-6bb8-4302-8c20-ff200fa53efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:02.940928 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10297d-6bb8-4302-8c20-ff200fa53efc admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:02.941213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10297d-6bb8-4302-8c20-ff200fa53efc admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:02.941482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10297d-6bb8-4302-8c20-ff200fa53efc admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:02.942365 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10297d-6bb8-4302-8c20-ff200fa53efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:02.944381 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10297d-6bb8-4302-8c20-ff200fa53efc admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:02.968584 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1214/2426] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:08:02 2021] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:02.973420 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10297d-6bb8-4302-8c20-ff200fa53efc admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:02.984663 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477edf5-4753-47c1-a3b2-15f29dcb6590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:02.985425 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477edf5-4753-47c1-a3b2-15f29dcb6590 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:02.986425 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477edf5-4753-47c1-a3b2-15f29dcb6590 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:02.986767 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477edf5-4753-47c1-a3b2-15f29dcb6590 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:02.987563 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477edf5-4753-47c1-a3b2-15f29dcb6590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:02.988041 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10297d-6bb8-4302-8c20-ff200fa53efc admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:02.989658 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477edf5-4753-47c1-a3b2-15f29dcb6590 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:02.994437 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13569faf-e8f5-44c6-8fc0-59630817f63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:02.995593 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13569faf-e8f5-44c6-8fc0-59630817f63d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:02.995991 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13569faf-e8f5-44c6-8fc0-59630817f63d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:02.996746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13569faf-e8f5-44c6-8fc0-59630817f63d admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:02.997499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13569faf-e8f5-44c6-8fc0-59630817f63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:02.999253 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13569faf-e8f5-44c6-8fc0-59630817f63d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:03.013340 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1215/2427] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:02 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:08:03.015681 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1213/2428] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:08:02 2021] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:03.017408 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13569faf-e8f5-44c6-8fc0-59630817f63d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:03.018250 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477edf5-4753-47c1-a3b2-15f29dcb6590 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:03.028499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13569faf-e8f5-44c6-8fc0-59630817f63d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:03.030737 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477edf5-4753-47c1-a3b2-15f29dcb6590 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:03.034265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebfe60-168d-48c9-a765-abdf5050efdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:03.034928 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebfe60-168d-48c9-a765-abdf5050efdb admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:03.035213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebfe60-168d-48c9-a765-abdf5050efdb admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:03.035538 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebfe60-168d-48c9-a765-abdf5050efdb admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:03.036265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebfe60-168d-48c9-a765-abdf5050efdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:03.036594 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c4f82-650a-4a86-bc66-0c57463f32d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:03.037778 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4f82-650a-4a86-bc66-0c57463f32d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:03.037976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebfe60-168d-48c9-a765-abdf5050efdb admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:03.038239 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4f82-650a-4a86-bc66-0c57463f32d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:03.038614 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4f82-650a-4a86-bc66-0c57463f32d9 admin admin] PATH_INFO: `/v3/projects/f021d04ff3954f5192477ce786c9d834/users/38d21bf345bb4f4ba6a69f2000b27cf5/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:03.055629 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1216/2429] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:03 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:08:03.056686 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebfe60-168d-48c9-a765-abdf5050efdb admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:03.058836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c4f82-650a-4a86-bc66-0c57463f32d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f021d04ff3954f5192477ce786c9d834, user_id=38d21bf345bb4f4ba6a69f2000b27cf5, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:03.062455 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c4f82-650a-4a86-bc66-0c57463f32d9 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:03.069788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebfe60-168d-48c9-a765-abdf5050efdb admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:03.075611 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43dac27-85aa-4ac3-ad88-80e2583d2b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:03.076257 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dac27-85aa-4ac3-ad88-80e2583d2b26 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:03.076561 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dac27-85aa-4ac3-ad88-80e2583d2b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:03.076841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dac27-85aa-4ac3-ad88-80e2583d2b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:03.077561 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43dac27-85aa-4ac3-ad88-80e2583d2b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:03.079157 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43dac27-85aa-4ac3-ad88-80e2583d2b26 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:03.084363 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1214/2430] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:03 2021] PUT /identity/v3/projects/f021d04ff3954f5192477ce786c9d834/users/38d21bf345bb4f4ba6a69f2000b27cf5/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:08:03.088510 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c4f82-650a-4a86-bc66-0c57463f32d9 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:03.096452 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1217/2431] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:03 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:03.098765 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43dac27-85aa-4ac3-ad88-80e2583d2b26 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:03.112333 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43dac27-85aa-4ac3-ad88-80e2583d2b26 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:03.173398 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c4f82-650a-4a86-bc66-0c57463f32d9 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:03.179054 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e76319-5b23-42a3-a970-952dec4803fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:03.179907 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e76319-5b23-42a3-a970-952dec4803fa admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:03.180268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e76319-5b23-42a3-a970-952dec4803fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:03.180548 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e76319-5b23-42a3-a970-952dec4803fa admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:03.181402 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e76319-5b23-42a3-a970-952dec4803fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:03.183309 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e76319-5b23-42a3-a970-952dec4803fa admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:03.205969 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1215/2432] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:03 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:03.205969 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e76319-5b23-42a3-a970-952dec4803fa admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:03.216773 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab89c71-6829-4c16-b54e-d2062c94dd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:03.217988 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab89c71-6829-4c16-b54e-d2062c94dd49 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:03.218095 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab89c71-6829-4c16-b54e-d2062c94dd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:03.218388 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab89c71-6829-4c16-b54e-d2062c94dd49 admin admin] PATH_INFO: `/v3/projects/45ebbc4412954ac0bd108487cfb87f1f/users/7eee81acd75d4f888f9cd83e3584e105/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:03.226109 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e76319-5b23-42a3-a970-952dec4803fa admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:03.232835 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7eb1a-e965-449c-8707-98d8043e7d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:03.234631 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7eb1a-e965-449c-8707-98d8043e7d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:03.235352 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7eb1a-e965-449c-8707-98d8043e7d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:03.236234 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7eb1a-e965-449c-8707-98d8043e7d69 admin admin] PATH_INFO: `/v3/projects/f021d04ff3954f5192477ce786c9d834/users/38d21bf345bb4f4ba6a69f2000b27cf5/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:03.236791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab89c71-6829-4c16-b54e-d2062c94dd49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45ebbc4412954ac0bd108487cfb87f1f, user_id=7eee81acd75d4f888f9cd83e3584e105, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:03.239072 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7eb1a-e965-449c-8707-98d8043e7d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f021d04ff3954f5192477ce786c9d834, user_id=38d21bf345bb4f4ba6a69f2000b27cf5, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:03.242500 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7eb1a-e965-449c-8707-98d8043e7d69 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:03.244130 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab89c71-6829-4c16-b54e-d2062c94dd49 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:03.258910 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1218/2433] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:03 2021] PUT /identity/v3/projects/45ebbc4412954ac0bd108487cfb87f1f/users/7eee81acd75d4f888f9cd83e3584e105/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:03.267947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1216/2434] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:03 2021] PUT /identity/v3/projects/f021d04ff3954f5192477ce786c9d834/users/38d21bf345bb4f4ba6a69f2000b27cf5/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:03.271011 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae8c6f-9a76-4f17-8294-2a25ef26c5ff None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:03.271303 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae8c6f-9a76-4f17-8294-2a25ef26c5ff None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:03.271441 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af384a-5f23-4965-82f0-6bfb31957809 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:03.271801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae8c6f-9a76-4f17-8294-2a25ef26c5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:03.271915 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af384a-5f23-4965-82f0-6bfb31957809 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:03.271915 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af384a-5f23-4965-82f0-6bfb31957809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:03.308631 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-72ae8c6f-9a76-4f17-8294-2a25ef26c5ff None None] MFA Rules not processed for user `7eee81acd75d4f888f9cd83e3584e105`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:03.309774 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-72ae8c6f-9a76-4f17-8294-2a25ef26c5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:03.312120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-f5af384a-5f23-4965-82f0-6bfb31957809 None None] MFA Rules not processed for user `38d21bf345bb4f4ba6a69f2000b27cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:03.313279 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f5af384a-5f23-4965-82f0-6bfb31957809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:03.398909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1217/2435] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:03 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:08:03.399092 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1219/2436] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:03 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:08:03.406638 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae8c6f-9a76-4f17-8294-2a25ef26c5ff None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:03.408172 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-72ae8c6f-9a76-4f17-8294-2a25ef26c5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:03.411819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af384a-5f23-4965-82f0-6bfb31957809 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:03.413465 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f5af384a-5f23-4965-82f0-6bfb31957809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:03.474869 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae8c6f-9a76-4f17-8294-2a25ef26c5ff None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:03.478720 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b95f8-d6fa-4677-b97f-e83ba5890d7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:03.479505 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b95f8-d6fa-4677-b97f-e83ba5890d7f service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:03.479726 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b95f8-d6fa-4677-b97f-e83ba5890d7f service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:03.479999 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b95f8-d6fa-4677-b97f-e83ba5890d7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:03.490360 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b95f8-d6fa-4677-b97f-e83ba5890d7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:03.491867 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b95f8-d6fa-4677-b97f-e83ba5890d7f service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:03.502024 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1218/2437] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:03 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:08:03.503459 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af384a-5f23-4965-82f0-6bfb31957809 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:03.508573 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9285b-8f32-462d-9253-4522b80f28b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d763da11c58473c9c2cf981b02835f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:03.509961 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9285b-8f32-462d-9253-4522b80f28b1 service glance] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:03.509961 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9285b-8f32-462d-9253-4522b80f28b1 service glance] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:03.510130 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9285b-8f32-462d-9253-4522b80f28b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:03.523977 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9285b-8f32-462d-9253-4522b80f28b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:03.524152 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9285b-8f32-462d-9253-4522b80f28b1 service glance] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:03.540927 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1220/2438] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:03 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:08:04.133191 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7c46a-ee6d-47c9-bb5c-ecbdf5a182af None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:04.133721 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7c46a-ee6d-47c9-bb5c-ecbdf5a182af None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:04.133930 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7c46a-ee6d-47c9-bb5c-ecbdf5a182af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:04.163202 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-19f7c46a-ee6d-47c9-bb5c-ecbdf5a182af None None] MFA Rules not processed for user `b49460aabd874a378370c3ddc9cfa704`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:04.164465 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-19f7c46a-ee6d-47c9-bb5c-ecbdf5a182af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:04.295348 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1219/2439] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:04 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:05.500152 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9285b-8f32-462d-9253-4522b80f28b1 service glance] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:05.573245 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9285b-8f32-462d-9253-4522b80f28b1 service glance] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:05.580791 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc63f0e-91e3-4363-b684-c883f6313f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:05.581762 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc63f0e-91e3-4363-b684-c883f6313f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:05.582046 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc63f0e-91e3-4363-b684-c883f6313f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:05.582318 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc63f0e-91e3-4363-b684-c883f6313f1f admin admin] PATH_INFO: `/v3/users/6d035e4f96fc47409e8275e3d47cbdac` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:05.583583 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc63f0e-91e3-4363-b684-c883f6313f1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d035e4f96fc47409e8275e3d47cbdac)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:05.585543 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc63f0e-91e3-4363-b684-c883f6313f1f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:05.635742 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2fc63f0e-91e3-4363-b684-c883f6313f1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d035e4f96fc47409e8275e3d47cbdac'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:05.636412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2fc63f0e-91e3-4363-b684-c883f6313f1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d035e4f96fc47409e8275e3d47cbdac'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:05.637017 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2fc63f0e-91e3-4363-b684-c883f6313f1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d035e4f96fc47409e8275e3d47cbdac'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:05.649483 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2fc63f0e-91e3-4363-b684-c883f6313f1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d035e4f96fc47409e8275e3d47cbdac'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:05.656970 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2fc63f0e-91e3-4363-b684-c883f6313f1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d035e4f96fc47409e8275e3d47cbdac'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:05.671417 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1221/2440] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:08:05 2021] DELETE /identity/v3/users/6d035e4f96fc47409e8275e3d47cbdac => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:05.675941 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687b96a-04e7-4cd1-b6d8-6f979aa413ae None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:05.676647 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687b96a-04e7-4cd1-b6d8-6f979aa413ae None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:05.676822 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687b96a-04e7-4cd1-b6d8-6f979aa413ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:05.696947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-9687b96a-04e7-4cd1-b6d8-6f979aa413ae None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:05.698149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-9687b96a-04e7-4cd1-b6d8-6f979aa413ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:05.775429 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1220/2441] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:05.785968 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc63f0e-91e3-4363-b684-c883f6313f1f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:05.787922 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-2fc63f0e-91e3-4363-b684-c883f6313f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:05.858710 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc63f0e-91e3-4363-b684-c883f6313f1f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:05.863888 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f8847-f1e2-4eef-a026-ffc78d5fcde8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:05.864572 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f8847-f1e2-4eef-a026-ffc78d5fcde8 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:05.864852 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f8847-f1e2-4eef-a026-ffc78d5fcde8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:05.865126 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f8847-f1e2-4eef-a026-ffc78d5fcde8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:05.874757 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f8847-f1e2-4eef-a026-ffc78d5fcde8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:05.876264 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f8847-f1e2-4eef-a026-ffc78d5fcde8 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:05.885951 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1222/2442] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:06.220457 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687b96a-04e7-4cd1-b6d8-6f979aa413ae None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:06.222338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-9687b96a-04e7-4cd1-b6d8-6f979aa413ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:06.234363 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687b96a-04e7-4cd1-b6d8-6f979aa413ae None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:06.239960 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e05da1-bb48-49dc-8403-ea58f610fcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:06.240884 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e05da1-bb48-49dc-8403-ea58f610fcbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:06.241581 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e05da1-bb48-49dc-8403-ea58f610fcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:06.241581 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e05da1-bb48-49dc-8403-ea58f610fcbe admin admin] PATH_INFO: `/v3/projects/254d6562f03e42658def2aed1bebc1de` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:06.243148 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e05da1-bb48-49dc-8403-ea58f610fcbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=254d6562f03e42658def2aed1bebc1de)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:06.245312 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e05da1-bb48-49dc-8403-ea58f610fcbe admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:06.300262 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-18e05da1-bb48-49dc-8403-ea58f610fcbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '254d6562f03e42658def2aed1bebc1de', 'request_id': 'req-18e05da1-bb48-49dc-8403-ea58f610fcbe'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:06.307116 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-18e05da1-bb48-49dc-8403-ea58f610fcbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '254d6562f03e42658def2aed1bebc1de', 'request_id': 'req-18e05da1-bb48-49dc-8403-ea58f610fcbe'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:06.316786 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-18e05da1-bb48-49dc-8403-ea58f610fcbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '254d6562f03e42658def2aed1bebc1de', 'request_id': 'req-18e05da1-bb48-49dc-8403-ea58f610fcbe'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:06.328561 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-18e05da1-bb48-49dc-8403-ea58f610fcbe admin admin] The token cache is being invalidate because project 254d6562f03e42658def2aed1bebc1de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:06.328991 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-18e05da1-bb48-49dc-8403-ea58f610fcbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:06.329787 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-18e05da1-bb48-49dc-8403-ea58f610fcbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:06.331403 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1221/2443] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:06 2021] DELETE /identity/v3/projects/254d6562f03e42658def2aed1bebc1de => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:06.335639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f8847-f1e2-4eef-a026-ffc78d5fcde8 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:06.347713 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f8847-f1e2-4eef-a026-ffc78d5fcde8 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:06.407251 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc79a0-6df9-45a9-94f3-973291b0488d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:06.409198 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc79a0-6df9-45a9-94f3-973291b0488d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:06.409585 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc79a0-6df9-45a9-94f3-973291b0488d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:06.409938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc79a0-6df9-45a9-94f3-973291b0488d admin admin] PATH_INFO: `/v3/users/38d21bf345bb4f4ba6a69f2000b27cf5` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:06.411264 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc79a0-6df9-45a9-94f3-973291b0488d admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d21bf345bb4f4ba6a69f2000b27cf5)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:06.413309 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc79a0-6df9-45a9-94f3-973291b0488d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:06.467305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2abc79a0-6df9-45a9-94f3-973291b0488d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d21bf345bb4f4ba6a69f2000b27cf5'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:06.468002 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2abc79a0-6df9-45a9-94f3-973291b0488d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d21bf345bb4f4ba6a69f2000b27cf5'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:06.468787 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2abc79a0-6df9-45a9-94f3-973291b0488d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d21bf345bb4f4ba6a69f2000b27cf5'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:06.481843 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2abc79a0-6df9-45a9-94f3-973291b0488d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d21bf345bb4f4ba6a69f2000b27cf5'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:06.490395 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2abc79a0-6df9-45a9-94f3-973291b0488d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d21bf345bb4f4ba6a69f2000b27cf5'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:06.507483 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1223/2444] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:08:06 2021] DELETE /identity/v3/users/38d21bf345bb4f4ba6a69f2000b27cf5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:06.808485 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e05da1-bb48-49dc-8403-ea58f610fcbe admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:06.810001 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-18e05da1-bb48-49dc-8403-ea58f610fcbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:06.822876 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e05da1-bb48-49dc-8403-ea58f610fcbe admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:06.885966 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0e02f-721c-453f-b50d-539517dcca8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:06.886790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0e02f-721c-453f-b50d-539517dcca8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:06.887073 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0e02f-721c-453f-b50d-539517dcca8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:06.887383 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0e02f-721c-453f-b50d-539517dcca8e admin admin] PATH_INFO: `/v3/projects/f021d04ff3954f5192477ce786c9d834` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:06.888572 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0e02f-721c-453f-b50d-539517dcca8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f021d04ff3954f5192477ce786c9d834)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:06.890463 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0e02f-721c-453f-b50d-539517dcca8e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:06.936005 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-eef0e02f-721c-453f-b50d-539517dcca8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f021d04ff3954f5192477ce786c9d834', 'request_id': 'req-eef0e02f-721c-453f-b50d-539517dcca8e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:06.941546 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-eef0e02f-721c-453f-b50d-539517dcca8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f021d04ff3954f5192477ce786c9d834', 'request_id': 'req-eef0e02f-721c-453f-b50d-539517dcca8e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:06.948827 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-eef0e02f-721c-453f-b50d-539517dcca8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f021d04ff3954f5192477ce786c9d834', 'request_id': 'req-eef0e02f-721c-453f-b50d-539517dcca8e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:06.960111 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-eef0e02f-721c-453f-b50d-539517dcca8e admin admin] The token cache is being invalidate because project f021d04ff3954f5192477ce786c9d834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:06.960396 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-eef0e02f-721c-453f-b50d-539517dcca8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:06.961018 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-eef0e02f-721c-453f-b50d-539517dcca8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:06.962659 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1222/2445] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:06 2021] DELETE /identity/v3/projects/f021d04ff3954f5192477ce786c9d834 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:08:06.968313 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dec6e-6975-491d-a7aa-cc861ee18dad None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:06.968605 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dec6e-6975-491d-a7aa-cc861ee18dad None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:06.968882 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dec6e-6975-491d-a7aa-cc861ee18dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:06.988548 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-1b5dec6e-6975-491d-a7aa-cc861ee18dad None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:06.989756 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1b5dec6e-6975-491d-a7aa-cc861ee18dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:07.053901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1224/2446] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:07.061771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1c996-a265-482e-9d9c-f57fe721adfb None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:07.062062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1c996-a265-482e-9d9c-f57fe721adfb None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:07.062355 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1c996-a265-482e-9d9c-f57fe721adfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:07.082004 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-90f1c996-a265-482e-9d9c-f57fe721adfb None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:07.083279 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-90f1c996-a265-482e-9d9c-f57fe721adfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:07.091179 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1223/2447] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:07.095986 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dec6e-6975-491d-a7aa-cc861ee18dad None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:07.105819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dec6e-6975-491d-a7aa-cc861ee18dad None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:07.122041 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42009b93-c71b-4699-b5be-efb3054abb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:07.122738 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42009b93-c71b-4699-b5be-efb3054abb4e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:07.123570 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42009b93-c71b-4699-b5be-efb3054abb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:07.123570 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42009b93-c71b-4699-b5be-efb3054abb4e admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:07.124085 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42009b93-c71b-4699-b5be-efb3054abb4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:08:07.124398 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42009b93-c71b-4699-b5be-efb3054abb4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:07.126063 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42009b93-c71b-4699-b5be-efb3054abb4e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:07.138608 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1225/2448] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:08:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:08:07.144162 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1c996-a265-482e-9d9c-f57fe721adfb None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:07.155469 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1c996-a265-482e-9d9c-f57fe721adfb None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:07.161297 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5769b1-ae1f-4db1-afbd-24c3bcd14022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:07.162008 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5769b1-ae1f-4db1-afbd-24c3bcd14022 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:07.162295 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5769b1-ae1f-4db1-afbd-24c3bcd14022 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:07.162603 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5769b1-ae1f-4db1-afbd-24c3bcd14022 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:07.163294 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5769b1-ae1f-4db1-afbd-24c3bcd14022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:07.165539 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5769b1-ae1f-4db1-afbd-24c3bcd14022 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:07.196469 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1224/2449] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:08:07 2021] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:08:07.197631 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42009b93-c71b-4699-b5be-efb3054abb4e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:07.208610 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42009b93-c71b-4699-b5be-efb3054abb4e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:07.266858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11594268-2652-4307-bf88-10c88a2f5abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:07.267648 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11594268-2652-4307-bf88-10c88a2f5abf admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:07.267940 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11594268-2652-4307-bf88-10c88a2f5abf admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:07.268219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11594268-2652-4307-bf88-10c88a2f5abf admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:07.268899 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11594268-2652-4307-bf88-10c88a2f5abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:07.270809 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11594268-2652-4307-bf88-10c88a2f5abf admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:07.292523 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1226/2450] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:08:07 2021] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:08:07.297151 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5769b1-ae1f-4db1-afbd-24c3bcd14022 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:07.308573 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5769b1-ae1f-4db1-afbd-24c3bcd14022 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:07.314181 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98df5d6-ef1b-49f7-b8f6-31aabd7cdeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:07.315030 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98df5d6-ef1b-49f7-b8f6-31aabd7cdeaa admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:07.315326 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98df5d6-ef1b-49f7-b8f6-31aabd7cdeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:07.315663 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98df5d6-ef1b-49f7-b8f6-31aabd7cdeaa admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:07.316402 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98df5d6-ef1b-49f7-b8f6-31aabd7cdeaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:07.318077 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98df5d6-ef1b-49f7-b8f6-31aabd7cdeaa admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:07.328902 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1225/2451] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:07 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:07.333513 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11594268-2652-4307-bf88-10c88a2f5abf admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:07.343170 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11594268-2652-4307-bf88-10c88a2f5abf admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:07.348049 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133b12c-394b-422b-ae98-33bdde16d68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:07.348696 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133b12c-394b-422b-ae98-33bdde16d68b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:07.348976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133b12c-394b-422b-ae98-33bdde16d68b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:07.349249 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133b12c-394b-422b-ae98-33bdde16d68b admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:07.349959 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133b12c-394b-422b-ae98-33bdde16d68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:07.351553 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133b12c-394b-422b-ae98-33bdde16d68b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:07.361142 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1227/2452] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:07 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:07.365239 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98df5d6-ef1b-49f7-b8f6-31aabd7cdeaa admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:07.375325 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98df5d6-ef1b-49f7-b8f6-31aabd7cdeaa admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:07.380598 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c2f9b-129c-47aa-8541-7c331ad80d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:07.381724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c2f9b-129c-47aa-8541-7c331ad80d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:07.382003 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c2f9b-129c-47aa-8541-7c331ad80d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:07.382278 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c2f9b-129c-47aa-8541-7c331ad80d78 admin admin] PATH_INFO: `/v3/projects/00437a94bf914fb38e82c5f4aef64a62/users/d893decc26b8493ca8c17cb3154dd9c0/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:07.398372 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c2f9b-129c-47aa-8541-7c331ad80d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00437a94bf914fb38e82c5f4aef64a62, user_id=d893decc26b8493ca8c17cb3154dd9c0, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:07.401393 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c2f9b-129c-47aa-8541-7c331ad80d78 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:07.418495 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1226/2453] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:07 2021] PUT /identity/v3/projects/00437a94bf914fb38e82c5f4aef64a62/users/d893decc26b8493ca8c17cb3154dd9c0/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:07.429193 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44996c6-bbb5-4bd6-a71d-2f87b7008f28 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:07.429482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44996c6-bbb5-4bd6-a71d-2f87b7008f28 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:07.429759 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44996c6-bbb5-4bd6-a71d-2f87b7008f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:07.462803 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-d44996c6-bbb5-4bd6-a71d-2f87b7008f28 None None] MFA Rules not processed for user `d893decc26b8493ca8c17cb3154dd9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:07.464166 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d44996c6-bbb5-4bd6-a71d-2f87b7008f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:07.538366 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1228/2454] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:07 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:07.543099 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c2f9b-129c-47aa-8541-7c331ad80d78 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:07.604788 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c2f9b-129c-47aa-8541-7c331ad80d78 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:07.609777 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399f345-a1ce-46b8-97f4-1f936529a22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:07.610438 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399f345-a1ce-46b8-97f4-1f936529a22d admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:07.611274 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399f345-a1ce-46b8-97f4-1f936529a22d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:07.611779 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399f345-a1ce-46b8-97f4-1f936529a22d admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:07.612465 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399f345-a1ce-46b8-97f4-1f936529a22d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:07.614425 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399f345-a1ce-46b8-97f4-1f936529a22d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:07.641891 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1227/2455] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:08:07 2021] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:07.646069 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44996c6-bbb5-4bd6-a71d-2f87b7008f28 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:07.657182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44996c6-bbb5-4bd6-a71d-2f87b7008f28 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:07.714370 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5635e-a6b7-4d81-87ec-5cc3dd73846b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:07.715043 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5635e-a6b7-4d81-87ec-5cc3dd73846b admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:07.715329 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5635e-a6b7-4d81-87ec-5cc3dd73846b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:07.715640 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5635e-a6b7-4d81-87ec-5cc3dd73846b admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:07.716347 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5635e-a6b7-4d81-87ec-5cc3dd73846b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:07.718317 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5635e-a6b7-4d81-87ec-5cc3dd73846b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:07.743344 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1229/2456] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:08:07 2021] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:07.744552 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399f345-a1ce-46b8-97f4-1f936529a22d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:07.756074 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399f345-a1ce-46b8-97f4-1f936529a22d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:07.760762 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d3579-532e-4d16-be6b-2af9076d7c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:07.761426 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d3579-532e-4d16-be6b-2af9076d7c54 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:07.761708 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d3579-532e-4d16-be6b-2af9076d7c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:07.761984 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d3579-532e-4d16-be6b-2af9076d7c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:07.762729 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d3579-532e-4d16-be6b-2af9076d7c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:07.764347 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d3579-532e-4d16-be6b-2af9076d7c54 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:07.774947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1228/2457] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:08:07.780602 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5635e-a6b7-4d81-87ec-5cc3dd73846b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:07.791537 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5635e-a6b7-4d81-87ec-5cc3dd73846b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:07.796599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359422ca-a22b-48d8-9230-a88f960a8acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:07.797735 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359422ca-a22b-48d8-9230-a88f960a8acb admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:07.798552 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359422ca-a22b-48d8-9230-a88f960a8acb admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:07.798871 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359422ca-a22b-48d8-9230-a88f960a8acb admin admin] PATH_INFO: `/v3/projects/4aa3af78c62f4d619a6e2b4753de89d6/users/51cf215aac6f4ca4a9c5ba0725259d34/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:07.814819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359422ca-a22b-48d8-9230-a88f960a8acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa3af78c62f4d619a6e2b4753de89d6, user_id=51cf215aac6f4ca4a9c5ba0725259d34, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:07.817611 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359422ca-a22b-48d8-9230-a88f960a8acb admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:07.833137 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1230/2458] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:07 2021] PUT /identity/v3/projects/4aa3af78c62f4d619a6e2b4753de89d6/users/51cf215aac6f4ca4a9c5ba0725259d34/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:07.836473 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d3579-532e-4d16-be6b-2af9076d7c54 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:07.846873 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d3579-532e-4d16-be6b-2af9076d7c54 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:07.909166 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbbdac-d013-4d24-85ec-6633836836d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:07.909755 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbbdac-d013-4d24-85ec-6633836836d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:07.910040 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbbdac-d013-4d24-85ec-6633836836d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:07.910319 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbbdac-d013-4d24-85ec-6633836836d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:07.911052 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbbdac-d013-4d24-85ec-6633836836d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:07.912697 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbbdac-d013-4d24-85ec-6633836836d0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:07.923009 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1229/2459] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:07 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:08:07.927242 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359422ca-a22b-48d8-9230-a88f960a8acb admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:07.938353 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359422ca-a22b-48d8-9230-a88f960a8acb admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:07.943136 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699e81e-ab4f-4821-a9b9-7826711986da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:07.944037 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699e81e-ab4f-4821-a9b9-7826711986da admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:07.944322 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699e81e-ab4f-4821-a9b9-7826711986da admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:07.944594 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699e81e-ab4f-4821-a9b9-7826711986da admin admin] PATH_INFO: `/v3/projects/4aa3af78c62f4d619a6e2b4753de89d6/users/51cf215aac6f4ca4a9c5ba0725259d34/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:07.946559 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699e81e-ab4f-4821-a9b9-7826711986da admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa3af78c62f4d619a6e2b4753de89d6, user_id=51cf215aac6f4ca4a9c5ba0725259d34, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:07.949235 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699e81e-ab4f-4821-a9b9-7826711986da admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:07.960241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1231/2460] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:07 2021] PUT /identity/v3/projects/4aa3af78c62f4d619a6e2b4753de89d6/users/51cf215aac6f4ca4a9c5ba0725259d34/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:08:07.972559 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfce8f-9f19-407e-b5a5-5c58aeed1e22 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:07.972852 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfce8f-9f19-407e-b5a5-5c58aeed1e22 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:07.973134 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfce8f-9f19-407e-b5a5-5c58aeed1e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:07.999549 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-5ecfce8f-9f19-407e-b5a5-5c58aeed1e22 None None] MFA Rules not processed for user `51cf215aac6f4ca4a9c5ba0725259d34`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:08.000806 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-5ecfce8f-9f19-407e-b5a5-5c58aeed1e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:08.071300 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1230/2461] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:07 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:08.083315 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699e81e-ab4f-4821-a9b9-7826711986da admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:08.085157 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c699e81e-ab4f-4821-a9b9-7826711986da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:08.152227 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699e81e-ab4f-4821-a9b9-7826711986da admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:08.155862 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a82f78-3d8f-4dd0-bf38-2fd6e02ffedc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:08.156497 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a82f78-3d8f-4dd0-bf38-2fd6e02ffedc service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:08.156779 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a82f78-3d8f-4dd0-bf38-2fd6e02ffedc service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:08.157055 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a82f78-3d8f-4dd0-bf38-2fd6e02ffedc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:08.165966 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a82f78-3d8f-4dd0-bf38-2fd6e02ffedc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:08.167393 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a82f78-3d8f-4dd0-bf38-2fd6e02ffedc service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:08.176732 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1232/2462] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:08 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:08.474198 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfce8f-9f19-407e-b5a5-5c58aeed1e22 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:08.483297 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfce8f-9f19-407e-b5a5-5c58aeed1e22 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:08.488854 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa831147-9c05-4635-a609-c3409a8e88a5 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51cf215aac6f4ca4a9c5ba0725259d34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4aa3af78c62f4d619a6e2b4753de89d6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:08.489536 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa831147-9c05-4635-a609-c3409a8e88a5 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:08.489900 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa831147-9c05-4635-a609-c3409a8e88a5 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:08.490407 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa831147-9c05-4635-a609-c3409a8e88a5 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:08.492747 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa831147-9c05-4635-a609-c3409a8e88a5 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:08:08.492747 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa831147-9c05-4635-a609-c3409a8e88a5 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:08.494727 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa831147-9c05-4635-a609-c3409a8e88a5 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:08.511794 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1231/2463] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:08:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:08:08.515188 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a82f78-3d8f-4dd0-bf38-2fd6e02ffedc service cinder] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:08.524327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a82f78-3d8f-4dd0-bf38-2fd6e02ffedc service cinder] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:08.529036 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de44db-7dd4-4196-b39d-38ca5fc19801 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51cf215aac6f4ca4a9c5ba0725259d34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4aa3af78c62f4d619a6e2b4753de89d6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:08.529635 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de44db-7dd4-4196-b39d-38ca5fc19801 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:08.529929 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de44db-7dd4-4196-b39d-38ca5fc19801 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:08.530210 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de44db-7dd4-4196-b39d-38ca5fc19801 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:08.530897 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de44db-7dd4-4196-b39d-38ca5fc19801 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:08.532869 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de44db-7dd4-4196-b39d-38ca5fc19801 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:08.561367 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1233/2464] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:08:08 2021] POST /identity/v3/projects => generated 354 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:08:08.565528 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa831147-9c05-4635-a609-c3409a8e88a5 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:08.576839 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa831147-9c05-4635-a609-c3409a8e88a5 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:08.635671 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1764e47-1fd0-4dd7-a07c-d1d969a13b6e tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51cf215aac6f4ca4a9c5ba0725259d34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4aa3af78c62f4d619a6e2b4753de89d6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:08.636349 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1764e47-1fd0-4dd7-a07c-d1d969a13b6e tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:08.636635 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1764e47-1fd0-4dd7-a07c-d1d969a13b6e tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:08.636921 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1764e47-1fd0-4dd7-a07c-d1d969a13b6e tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:08.640836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1764e47-1fd0-4dd7-a07c-d1d969a13b6e tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:08:08.640836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1764e47-1fd0-4dd7-a07c-d1d969a13b6e tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:08.640836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1764e47-1fd0-4dd7-a07c-d1d969a13b6e tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:08.655181 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1232/2465] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:08:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:08:08.690473 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de44db-7dd4-4196-b39d-38ca5fc19801 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:08.703076 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de44db-7dd4-4196-b39d-38ca5fc19801 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:08.708795 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226eb382-ae8f-4ac5-bd97-1098f51bba80 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51cf215aac6f4ca4a9c5ba0725259d34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4aa3af78c62f4d619a6e2b4753de89d6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:08.709503 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226eb382-ae8f-4ac5-bd97-1098f51bba80 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:08.709788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226eb382-ae8f-4ac5-bd97-1098f51bba80 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:08.710064 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226eb382-ae8f-4ac5-bd97-1098f51bba80 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] PATH_INFO: `/v3/projects/c8101739818c47fb8c144bc9e3455787` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:08.711572 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226eb382-ae8f-4ac5-bd97-1098f51bba80 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c8101739818c47fb8c144bc9e3455787)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:08.713820 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226eb382-ae8f-4ac5-bd97-1098f51bba80 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:08.788151 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-226eb382-ae8f-4ac5-bd97-1098f51bba80 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8101739818c47fb8c144bc9e3455787', 'request_id': 'req-226eb382-ae8f-4ac5-bd97-1098f51bba80'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:08.796014 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-226eb382-ae8f-4ac5-bd97-1098f51bba80 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8101739818c47fb8c144bc9e3455787', 'request_id': 'req-226eb382-ae8f-4ac5-bd97-1098f51bba80'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:08.803133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-226eb382-ae8f-4ac5-bd97-1098f51bba80 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8101739818c47fb8c144bc9e3455787', 'request_id': 'req-226eb382-ae8f-4ac5-bd97-1098f51bba80'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:08.820180 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-226eb382-ae8f-4ac5-bd97-1098f51bba80 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] The token cache is being invalidate because project c8101739818c47fb8c144bc9e3455787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:08.820465 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-226eb382-ae8f-4ac5-bd97-1098f51bba80 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:08.821192 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-226eb382-ae8f-4ac5-bd97-1098f51bba80 tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:08.822785 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1234/2466] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:08 2021] DELETE /identity/v3/projects/c8101739818c47fb8c144bc9e3455787 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:09.028679 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1764e47-1fd0-4dd7-a07c-d1d969a13b6e tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:09.030869 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-d1764e47-1fd0-4dd7-a07c-d1d969a13b6e tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:09.113669 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1764e47-1fd0-4dd7-a07c-d1d969a13b6e tempest-VolumeQuotaClassesTest-725491302 tempest-VolumeQuotaClassesTest-725491302-project-admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:09.183933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ad0fd-ee7b-4ec8-ad5f-24a4b164c177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:09.184816 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ad0fd-ee7b-4ec8-ad5f-24a4b164c177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:09.185089 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ad0fd-ee7b-4ec8-ad5f-24a4b164c177 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:09.185356 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ad0fd-ee7b-4ec8-ad5f-24a4b164c177 admin admin] PATH_INFO: `/v3/users/d893decc26b8493ca8c17cb3154dd9c0` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:09.186538 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ad0fd-ee7b-4ec8-ad5f-24a4b164c177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d893decc26b8493ca8c17cb3154dd9c0)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:09.188496 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ad0fd-ee7b-4ec8-ad5f-24a4b164c177 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:09.249062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-121ad0fd-ee7b-4ec8-ad5f-24a4b164c177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd893decc26b8493ca8c17cb3154dd9c0'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:09.263811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-121ad0fd-ee7b-4ec8-ad5f-24a4b164c177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd893decc26b8493ca8c17cb3154dd9c0'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:09.264525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-121ad0fd-ee7b-4ec8-ad5f-24a4b164c177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd893decc26b8493ca8c17cb3154dd9c0'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:09.271688 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-121ad0fd-ee7b-4ec8-ad5f-24a4b164c177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd893decc26b8493ca8c17cb3154dd9c0'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:09.279329 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-121ad0fd-ee7b-4ec8-ad5f-24a4b164c177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd893decc26b8493ca8c17cb3154dd9c0'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:09.286073 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1233/2467] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:08:09 2021] DELETE /identity/v3/users/d893decc26b8493ca8c17cb3154dd9c0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:09.290942 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabca9a8-c768-4123-b481-27aa2caf548a None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:09.291227 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabca9a8-c768-4123-b481-27aa2caf548a None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:09.291539 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabca9a8-c768-4123-b481-27aa2caf548a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:09.309906 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-aabca9a8-c768-4123-b481-27aa2caf548a None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:09.311099 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-aabca9a8-c768-4123-b481-27aa2caf548a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:09.374303 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1235/2468] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:08:09.384850 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ad0fd-ee7b-4ec8-ad5f-24a4b164c177 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:09.386279 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-121ad0fd-ee7b-4ec8-ad5f-24a4b164c177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:09.443771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ad0fd-ee7b-4ec8-ad5f-24a4b164c177 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:09.447490 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2fff0-8148-49e2-985b-ab6a0f688b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:09.448124 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2fff0-8148-49e2-985b-ab6a0f688b68 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:09.448409 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2fff0-8148-49e2-985b-ab6a0f688b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:09.448731 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2fff0-8148-49e2-985b-ab6a0f688b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:09.458247 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2fff0-8148-49e2-985b-ab6a0f688b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:09.459717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2fff0-8148-49e2-985b-ab6a0f688b68 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:09.469039 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1234/2469] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:09.767760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabca9a8-c768-4123-b481-27aa2caf548a None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:09.769237 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-aabca9a8-c768-4123-b481-27aa2caf548a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:09.781448 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabca9a8-c768-4123-b481-27aa2caf548a None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:09.786736 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19902ef4-1ca3-444c-91db-a0a49a8642bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:09.787621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19902ef4-1ca3-444c-91db-a0a49a8642bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:09.787908 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19902ef4-1ca3-444c-91db-a0a49a8642bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:09.788185 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19902ef4-1ca3-444c-91db-a0a49a8642bb admin admin] PATH_INFO: `/v3/projects/00437a94bf914fb38e82c5f4aef64a62` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:09.789390 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19902ef4-1ca3-444c-91db-a0a49a8642bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=00437a94bf914fb38e82c5f4aef64a62)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:09.791303 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19902ef4-1ca3-444c-91db-a0a49a8642bb admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:09.838526 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-19902ef4-1ca3-444c-91db-a0a49a8642bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00437a94bf914fb38e82c5f4aef64a62', 'request_id': 'req-19902ef4-1ca3-444c-91db-a0a49a8642bb'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:09.844487 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-19902ef4-1ca3-444c-91db-a0a49a8642bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00437a94bf914fb38e82c5f4aef64a62', 'request_id': 'req-19902ef4-1ca3-444c-91db-a0a49a8642bb'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:09.850532 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-19902ef4-1ca3-444c-91db-a0a49a8642bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00437a94bf914fb38e82c5f4aef64a62', 'request_id': 'req-19902ef4-1ca3-444c-91db-a0a49a8642bb'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:09.863156 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-19902ef4-1ca3-444c-91db-a0a49a8642bb admin admin] The token cache is being invalidate because project 00437a94bf914fb38e82c5f4aef64a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:09.863482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-19902ef4-1ca3-444c-91db-a0a49a8642bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:09.864237 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-19902ef4-1ca3-444c-91db-a0a49a8642bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:09.865916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1236/2470] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:09 2021] DELETE /identity/v3/projects/00437a94bf914fb38e82c5f4aef64a62 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:09.870105 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2fff0-8148-49e2-985b-ab6a0f688b68 service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:09.879949 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2fff0-8148-49e2-985b-ab6a0f688b68 service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:09.939262 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d08db-c25e-469f-899d-e42512306c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:09.940235 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d08db-c25e-469f-899d-e42512306c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:09.940514 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d08db-c25e-469f-899d-e42512306c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:09.940786 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d08db-c25e-469f-899d-e42512306c5f admin admin] PATH_INFO: `/v3/users/51cf215aac6f4ca4a9c5ba0725259d34` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:09.941952 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d08db-c25e-469f-899d-e42512306c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=51cf215aac6f4ca4a9c5ba0725259d34)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:09.943891 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d08db-c25e-469f-899d-e42512306c5f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:09.991480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4f4d08db-c25e-469f-899d-e42512306c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51cf215aac6f4ca4a9c5ba0725259d34'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:10.004164 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4f4d08db-c25e-469f-899d-e42512306c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51cf215aac6f4ca4a9c5ba0725259d34'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:10.004884 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4f4d08db-c25e-469f-899d-e42512306c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51cf215aac6f4ca4a9c5ba0725259d34'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:10.011649 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4f4d08db-c25e-469f-899d-e42512306c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51cf215aac6f4ca4a9c5ba0725259d34'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:10.019759 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4f4d08db-c25e-469f-899d-e42512306c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51cf215aac6f4ca4a9c5ba0725259d34'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:10.025616 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1235/2471] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:08:09 2021] DELETE /identity/v3/users/51cf215aac6f4ca4a9c5ba0725259d34 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:10.311999 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19902ef4-1ca3-444c-91db-a0a49a8642bb admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:10.313407 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-19902ef4-1ca3-444c-91db-a0a49a8642bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:10.329409 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19902ef4-1ca3-444c-91db-a0a49a8642bb admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:10.387227 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931ea51-fafb-4079-97d1-eb7546027a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:10.388125 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931ea51-fafb-4079-97d1-eb7546027a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:10.388406 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931ea51-fafb-4079-97d1-eb7546027a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:10.388681 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931ea51-fafb-4079-97d1-eb7546027a91 admin admin] PATH_INFO: `/v3/projects/4aa3af78c62f4d619a6e2b4753de89d6` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:10.389879 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931ea51-fafb-4079-97d1-eb7546027a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa3af78c62f4d619a6e2b4753de89d6)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:10.391841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931ea51-fafb-4079-97d1-eb7546027a91 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:10.437127 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-3931ea51-fafb-4079-97d1-eb7546027a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa3af78c62f4d619a6e2b4753de89d6', 'request_id': 'req-3931ea51-fafb-4079-97d1-eb7546027a91'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:10.443163 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-3931ea51-fafb-4079-97d1-eb7546027a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa3af78c62f4d619a6e2b4753de89d6', 'request_id': 'req-3931ea51-fafb-4079-97d1-eb7546027a91'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:10.448749 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-3931ea51-fafb-4079-97d1-eb7546027a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa3af78c62f4d619a6e2b4753de89d6', 'request_id': 'req-3931ea51-fafb-4079-97d1-eb7546027a91'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:10.461230 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-3931ea51-fafb-4079-97d1-eb7546027a91 admin admin] The token cache is being invalidate because project 4aa3af78c62f4d619a6e2b4753de89d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:10.461540 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-3931ea51-fafb-4079-97d1-eb7546027a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:10.462157 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-3931ea51-fafb-4079-97d1-eb7546027a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:10.464100 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1237/2472] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:10 2021] DELETE /identity/v3/projects/4aa3af78c62f4d619a6e2b4753de89d6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:10.471028 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce832667-96cc-48d0-8909-1fe528c1554e None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:10.471643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce832667-96cc-48d0-8909-1fe528c1554e None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:10.471643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce832667-96cc-48d0-8909-1fe528c1554e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:10.490075 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-ce832667-96cc-48d0-8909-1fe528c1554e None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:10.491292 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ce832667-96cc-48d0-8909-1fe528c1554e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:10.549525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1236/2473] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:08:10.557255 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575563d-7bd4-4423-a920-c49974a8b4d6 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:10.557481 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575563d-7bd4-4423-a920-c49974a8b4d6 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:10.557761 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575563d-7bd4-4423-a920-c49974a8b4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:10.575560 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-0575563d-7bd4-4423-a920-c49974a8b4d6 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:10.576754 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0575563d-7bd4-4423-a920-c49974a8b4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:10.585588 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1238/2474] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:10.590342 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce832667-96cc-48d0-8909-1fe528c1554e None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:10.600829 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce832667-96cc-48d0-8909-1fe528c1554e None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:10.605264 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203aa2d1-3d44-44cf-b529-6d6fe45bbff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:10.605920 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203aa2d1-3d44-44cf-b529-6d6fe45bbff4 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:10.606306 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203aa2d1-3d44-44cf-b529-6d6fe45bbff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:10.606590 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203aa2d1-3d44-44cf-b529-6d6fe45bbff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:10.607411 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203aa2d1-3d44-44cf-b529-6d6fe45bbff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:08:10.607731 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203aa2d1-3d44-44cf-b529-6d6fe45bbff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:10.609520 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203aa2d1-3d44-44cf-b529-6d6fe45bbff4 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:10.624536 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1237/2475] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:08:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:08:10.626854 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575563d-7bd4-4423-a920-c49974a8b4d6 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:10.636588 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575563d-7bd4-4423-a920-c49974a8b4d6 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:10.641243 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5d20d-e8c0-4f28-8801-6b784354dc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:10.642673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5d20d-e8c0-4f28-8801-6b784354dc2c admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:10.642955 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5d20d-e8c0-4f28-8801-6b784354dc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:10.643226 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5d20d-e8c0-4f28-8801-6b784354dc2c admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:10.643942 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5d20d-e8c0-4f28-8801-6b784354dc2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:10.645826 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5d20d-e8c0-4f28-8801-6b784354dc2c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:10.670097 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1239/2476] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:08:10 2021] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:08:10.676453 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203aa2d1-3d44-44cf-b529-6d6fe45bbff4 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:10.691204 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203aa2d1-3d44-44cf-b529-6d6fe45bbff4 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:10.749623 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004dd59-f709-4889-94ed-4f1d04320fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:10.750290 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004dd59-f709-4889-94ed-4f1d04320fae admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:10.750573 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004dd59-f709-4889-94ed-4f1d04320fae admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:10.750849 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004dd59-f709-4889-94ed-4f1d04320fae admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:10.751590 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004dd59-f709-4889-94ed-4f1d04320fae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:10.753491 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004dd59-f709-4889-94ed-4f1d04320fae admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:10.776987 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1238/2477] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:08:10 2021] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:10.778220 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5d20d-e8c0-4f28-8801-6b784354dc2c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:10.789626 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5d20d-e8c0-4f28-8801-6b784354dc2c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:10.794269 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45845d24-492a-4637-9f6c-6886ba1bbb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:10.794930 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45845d24-492a-4637-9f6c-6886ba1bbb3e admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:10.795220 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45845d24-492a-4637-9f6c-6886ba1bbb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:10.795529 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45845d24-492a-4637-9f6c-6886ba1bbb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:10.796380 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45845d24-492a-4637-9f6c-6886ba1bbb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:10.798180 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45845d24-492a-4637-9f6c-6886ba1bbb3e admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:10.809388 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1240/2478] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:10 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:10.813443 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004dd59-f709-4889-94ed-4f1d04320fae admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:10.823611 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004dd59-f709-4889-94ed-4f1d04320fae admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:10.828247 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225f4fe-c004-4bb3-834f-1136bdf8d347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:10.828908 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225f4fe-c004-4bb3-834f-1136bdf8d347 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:10.829701 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225f4fe-c004-4bb3-834f-1136bdf8d347 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:10.829976 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225f4fe-c004-4bb3-834f-1136bdf8d347 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:10.830846 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225f4fe-c004-4bb3-834f-1136bdf8d347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:10.832493 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225f4fe-c004-4bb3-834f-1136bdf8d347 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:10.842718 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1239/2479] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:10.847670 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45845d24-492a-4637-9f6c-6886ba1bbb3e admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:10.857601 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45845d24-492a-4637-9f6c-6886ba1bbb3e admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:10.862451 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823c30c-fe85-4fff-afb6-e9199a340b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:10.863321 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823c30c-fe85-4fff-afb6-e9199a340b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:10.863637 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823c30c-fe85-4fff-afb6-e9199a340b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:10.863913 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823c30c-fe85-4fff-afb6-e9199a340b7d admin admin] PATH_INFO: `/v3/projects/b74cb1272945417d9bbed187b8208eb4/users/0d1a97ebc6cf4319b3f48a1cbf3be3f3/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:10.878714 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823c30c-fe85-4fff-afb6-e9199a340b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74cb1272945417d9bbed187b8208eb4, user_id=0d1a97ebc6cf4319b3f48a1cbf3be3f3, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:10.881734 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823c30c-fe85-4fff-afb6-e9199a340b7d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:10.896226 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1241/2480] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:10 2021] PUT /identity/v3/projects/b74cb1272945417d9bbed187b8208eb4/users/0d1a97ebc6cf4319b3f48a1cbf3be3f3/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:10.906588 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbae529-7821-42bf-ba1e-22e1093c7fcf None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:10.906883 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbae529-7821-42bf-ba1e-22e1093c7fcf None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:10.907168 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbae529-7821-42bf-ba1e-22e1093c7fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:10.935057 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-bdbae529-7821-42bf-ba1e-22e1093c7fcf None None] MFA Rules not processed for user `0d1a97ebc6cf4319b3f48a1cbf3be3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:10.936311 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-bdbae529-7821-42bf-ba1e-22e1093c7fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:11.004661 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1240/2481] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:10 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:11.009627 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823c30c-fe85-4fff-afb6-e9199a340b7d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:11.070901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823c30c-fe85-4fff-afb6-e9199a340b7d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:11.075582 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b6374-9387-44bb-8919-5d0314b0bc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:11.076242 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b6374-9387-44bb-8919-5d0314b0bc7c admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:11.076529 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b6374-9387-44bb-8919-5d0314b0bc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:11.076813 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b6374-9387-44bb-8919-5d0314b0bc7c admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:11.077507 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b6374-9387-44bb-8919-5d0314b0bc7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:11.080086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b6374-9387-44bb-8919-5d0314b0bc7c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:11.104358 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1242/2482] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:08:11 2021] POST /identity/v3/projects => generated 399 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:08:11.108412 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbae529-7821-42bf-ba1e-22e1093c7fcf None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:11.119938 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbae529-7821-42bf-ba1e-22e1093c7fcf None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:11.180501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf4dd9-04a7-4f21-b34a-6e7c57a323f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:11.181165 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf4dd9-04a7-4f21-b34a-6e7c57a323f0 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:11.181441 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf4dd9-04a7-4f21-b34a-6e7c57a323f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:11.181735 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf4dd9-04a7-4f21-b34a-6e7c57a323f0 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:11.182406 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf4dd9-04a7-4f21-b34a-6e7c57a323f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:11.184343 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf4dd9-04a7-4f21-b34a-6e7c57a323f0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:11.206585 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1241/2483] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:08:11 2021] POST /identity/v3/users => generated 306 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:11.213951 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b6374-9387-44bb-8919-5d0314b0bc7c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:11.224415 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b6374-9387-44bb-8919-5d0314b0bc7c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:11.230784 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e16c5-b8ea-4988-a251-ccb7c118dea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:11.231576 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e16c5-b8ea-4988-a251-ccb7c118dea1 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:11.231935 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e16c5-b8ea-4988-a251-ccb7c118dea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:11.232279 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e16c5-b8ea-4988-a251-ccb7c118dea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:11.233117 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e16c5-b8ea-4988-a251-ccb7c118dea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:11.234728 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e16c5-b8ea-4988-a251-ccb7c118dea1 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:11.247158 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1243/2484] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:11 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:11.252946 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf4dd9-04a7-4f21-b34a-6e7c57a323f0 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:11.263202 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf4dd9-04a7-4f21-b34a-6e7c57a323f0 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:11.268580 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e73fc-f34c-4938-b1b3-bef9e5e17256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:11.269468 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e73fc-f34c-4938-b1b3-bef9e5e17256 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:11.269880 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e73fc-f34c-4938-b1b3-bef9e5e17256 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:11.270162 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e73fc-f34c-4938-b1b3-bef9e5e17256 admin admin] PATH_INFO: `/v3/projects/54d5b30baebc49e9aeaed21c6ea47ff3/users/6fa859524c3a4d74b00a48268cf6d229/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:11.285309 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e73fc-f34c-4938-b1b3-bef9e5e17256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d5b30baebc49e9aeaed21c6ea47ff3, user_id=6fa859524c3a4d74b00a48268cf6d229, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:11.288412 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e73fc-f34c-4938-b1b3-bef9e5e17256 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:11.302437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1242/2485] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:11 2021] PUT /identity/v3/projects/54d5b30baebc49e9aeaed21c6ea47ff3/users/6fa859524c3a4d74b00a48268cf6d229/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:11.306442 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e16c5-b8ea-4988-a251-ccb7c118dea1 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:11.318082 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e16c5-b8ea-4988-a251-ccb7c118dea1 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:11.377901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae75c3e-bc00-4793-9179-4df0ee51094f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:11.378580 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae75c3e-bc00-4793-9179-4df0ee51094f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:11.378866 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae75c3e-bc00-4793-9179-4df0ee51094f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:11.379207 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae75c3e-bc00-4793-9179-4df0ee51094f admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:11.380155 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae75c3e-bc00-4793-9179-4df0ee51094f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:11.382166 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae75c3e-bc00-4793-9179-4df0ee51094f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:11.392834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1244/2486] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:11 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:11.396815 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e73fc-f34c-4938-b1b3-bef9e5e17256 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:11.406969 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e73fc-f34c-4938-b1b3-bef9e5e17256 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:11.411895 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d0df1-5aa5-4a56-81d0-4cc1fe222eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:11.412772 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d0df1-5aa5-4a56-81d0-4cc1fe222eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:11.413056 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d0df1-5aa5-4a56-81d0-4cc1fe222eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:11.413331 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d0df1-5aa5-4a56-81d0-4cc1fe222eb5 admin admin] PATH_INFO: `/v3/projects/54d5b30baebc49e9aeaed21c6ea47ff3/users/6fa859524c3a4d74b00a48268cf6d229/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:11.415263 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d0df1-5aa5-4a56-81d0-4cc1fe222eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d5b30baebc49e9aeaed21c6ea47ff3, user_id=6fa859524c3a4d74b00a48268cf6d229, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:11.418008 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d0df1-5aa5-4a56-81d0-4cc1fe222eb5 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:11.428962 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1243/2487] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:11 2021] PUT /identity/v3/projects/54d5b30baebc49e9aeaed21c6ea47ff3/users/6fa859524c3a4d74b00a48268cf6d229/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:11.440428 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252859e-bc1e-4b39-bc1e-135b5b5b04fd None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:11.440797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252859e-bc1e-4b39-bc1e-135b5b5b04fd None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:11.441075 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252859e-bc1e-4b39-bc1e-135b5b5b04fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:11.466461 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-d252859e-bc1e-4b39-bc1e-135b5b5b04fd None None] MFA Rules not processed for user `6fa859524c3a4d74b00a48268cf6d229`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:11.467690 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d252859e-bc1e-4b39-bc1e-135b5b5b04fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:11.533906 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1245/2488] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:11 2021] POST /identity/v3/auth/tokens => generated 3486 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:11.543881 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d0df1-5aa5-4a56-81d0-4cc1fe222eb5 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:11.545587 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b44d0df1-5aa5-4a56-81d0-4cc1fe222eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:11.604371 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d0df1-5aa5-4a56-81d0-4cc1fe222eb5 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:11.608298 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43212a-63aa-4f65-ab70-45ff40faae65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:11.608941 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43212a-63aa-4f65-ab70-45ff40faae65 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:11.609225 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43212a-63aa-4f65-ab70-45ff40faae65 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:11.609504 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43212a-63aa-4f65-ab70-45ff40faae65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:11.619835 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43212a-63aa-4f65-ab70-45ff40faae65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:11.621296 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43212a-63aa-4f65-ab70-45ff40faae65 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:11.632347 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1244/2489] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:11 2021] GET /identity/v3/auth/tokens => generated 3486 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:11.712345 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252859e-bc1e-4b39-bc1e-135b5b5b04fd None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:11.714009 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d252859e-bc1e-4b39-bc1e-135b5b5b04fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:11.726442 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252859e-bc1e-4b39-bc1e-135b5b5b04fd None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:11.730105 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72f81c-0fe2-4dfa-a3d2-c9d49a827b32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:11.730737 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72f81c-0fe2-4dfa-a3d2-c9d49a827b32 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:11.731021 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72f81c-0fe2-4dfa-a3d2-c9d49a827b32 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:11.731295 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72f81c-0fe2-4dfa-a3d2-c9d49a827b32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:11.787535 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72f81c-0fe2-4dfa-a3d2-c9d49a827b32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:11.788973 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72f81c-0fe2-4dfa-a3d2-c9d49a827b32 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:11.799106 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1246/2490] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:11 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:16.881460 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43212a-63aa-4f65-ab70-45ff40faae65 service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:16.950586 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43212a-63aa-4f65-ab70-45ff40faae65 service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:16.960110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b1bec-3016-42a5-b604-54e37d0c91e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:16.961115 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b1bec-3016-42a5-b604-54e37d0c91e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:16.961406 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b1bec-3016-42a5-b604-54e37d0c91e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:16.961686 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b1bec-3016-42a5-b604-54e37d0c91e3 admin admin] PATH_INFO: `/v3/users/0d1a97ebc6cf4319b3f48a1cbf3be3f3` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:16.962887 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b1bec-3016-42a5-b604-54e37d0c91e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d1a97ebc6cf4319b3f48a1cbf3be3f3)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:16.964856 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b1bec-3016-42a5-b604-54e37d0c91e3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:17.015630 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-6b0b1bec-3016-42a5-b604-54e37d0c91e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d1a97ebc6cf4319b3f48a1cbf3be3f3'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:17.028156 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-6b0b1bec-3016-42a5-b604-54e37d0c91e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d1a97ebc6cf4319b3f48a1cbf3be3f3'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:17.028868 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-6b0b1bec-3016-42a5-b604-54e37d0c91e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d1a97ebc6cf4319b3f48a1cbf3be3f3'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:17.039971 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-6b0b1bec-3016-42a5-b604-54e37d0c91e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d1a97ebc6cf4319b3f48a1cbf3be3f3'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:17.049444 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-6b0b1bec-3016-42a5-b604-54e37d0c91e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d1a97ebc6cf4319b3f48a1cbf3be3f3'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:17.056441 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1245/2491] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:08:16 2021] DELETE /identity/v3/users/0d1a97ebc6cf4319b3f48a1cbf3be3f3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:17.060888 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176e12f-a96c-4298-b278-b15ea90d6cfd None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:17.061402 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176e12f-a96c-4298-b278-b15ea90d6cfd None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:17.061506 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176e12f-a96c-4298-b278-b15ea90d6cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:17.080583 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-3176e12f-a96c-4298-b278-b15ea90d6cfd None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:17.081808 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-3176e12f-a96c-4298-b278-b15ea90d6cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:17.139843 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1247/2492] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:17.150435 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b1bec-3016-42a5-b604-54e37d0c91e3 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:17.151854 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-6b0b1bec-3016-42a5-b604-54e37d0c91e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:17.210973 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b1bec-3016-42a5-b604-54e37d0c91e3 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:17.214719 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9285c3b-2a8e-4944-b97d-18f181d3c28f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:17.215384 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9285c3b-2a8e-4944-b97d-18f181d3c28f service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:17.215696 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9285c3b-2a8e-4944-b97d-18f181d3c28f service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:17.215970 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9285c3b-2a8e-4944-b97d-18f181d3c28f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:17.231110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9285c3b-2a8e-4944-b97d-18f181d3c28f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:17.232603 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9285c3b-2a8e-4944-b97d-18f181d3c28f service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:17.243927 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1246/2493] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:17.561690 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176e12f-a96c-4298-b278-b15ea90d6cfd None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:17.563278 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-3176e12f-a96c-4298-b278-b15ea90d6cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:17.588499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176e12f-a96c-4298-b278-b15ea90d6cfd None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:17.594305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d66f8-47f8-41c7-8304-fa1186d2ecb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:17.595884 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d66f8-47f8-41c7-8304-fa1186d2ecb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:17.596407 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d66f8-47f8-41c7-8304-fa1186d2ecb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:17.596751 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d66f8-47f8-41c7-8304-fa1186d2ecb5 admin admin] PATH_INFO: `/v3/projects/b74cb1272945417d9bbed187b8208eb4` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:17.598019 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d66f8-47f8-41c7-8304-fa1186d2ecb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74cb1272945417d9bbed187b8208eb4)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:17.600058 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d66f8-47f8-41c7-8304-fa1186d2ecb5 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:17.648196 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-3b0d66f8-47f8-41c7-8304-fa1186d2ecb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74cb1272945417d9bbed187b8208eb4', 'request_id': 'req-3b0d66f8-47f8-41c7-8304-fa1186d2ecb5'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:17.654093 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-3b0d66f8-47f8-41c7-8304-fa1186d2ecb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74cb1272945417d9bbed187b8208eb4', 'request_id': 'req-3b0d66f8-47f8-41c7-8304-fa1186d2ecb5'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:17.660330 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-3b0d66f8-47f8-41c7-8304-fa1186d2ecb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74cb1272945417d9bbed187b8208eb4', 'request_id': 'req-3b0d66f8-47f8-41c7-8304-fa1186d2ecb5'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:17.675189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-3b0d66f8-47f8-41c7-8304-fa1186d2ecb5 admin admin] The token cache is being invalidate because project b74cb1272945417d9bbed187b8208eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:17.675643 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-3b0d66f8-47f8-41c7-8304-fa1186d2ecb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:17.676066 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-3b0d66f8-47f8-41c7-8304-fa1186d2ecb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:17.677845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1248/2494] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:17 2021] DELETE /identity/v3/projects/b74cb1272945417d9bbed187b8208eb4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:08:17.681841 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9285c3b-2a8e-4944-b97d-18f181d3c28f service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:17.691335 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9285c3b-2a8e-4944-b97d-18f181d3c28f service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:17.748439 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97848f-cea0-4df3-ae4e-eb8406658e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:17.749316 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97848f-cea0-4df3-ae4e-eb8406658e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:17.749601 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97848f-cea0-4df3-ae4e-eb8406658e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:17.749878 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97848f-cea0-4df3-ae4e-eb8406658e99 admin admin] PATH_INFO: `/v3/users/6fa859524c3a4d74b00a48268cf6d229` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:17.751593 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97848f-cea0-4df3-ae4e-eb8406658e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fa859524c3a4d74b00a48268cf6d229)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:17.753523 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97848f-cea0-4df3-ae4e-eb8406658e99 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:17.798725 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2c97848f-cea0-4df3-ae4e-eb8406658e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fa859524c3a4d74b00a48268cf6d229'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:17.809977 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2c97848f-cea0-4df3-ae4e-eb8406658e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fa859524c3a4d74b00a48268cf6d229'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:17.810631 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2c97848f-cea0-4df3-ae4e-eb8406658e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fa859524c3a4d74b00a48268cf6d229'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:17.820480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2c97848f-cea0-4df3-ae4e-eb8406658e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fa859524c3a4d74b00a48268cf6d229'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:17.826936 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2c97848f-cea0-4df3-ae4e-eb8406658e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fa859524c3a4d74b00a48268cf6d229'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:17.832960 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1247/2495] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:08:17 2021] DELETE /identity/v3/users/6fa859524c3a4d74b00a48268cf6d229 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:18.131851 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d66f8-47f8-41c7-8304-fa1186d2ecb5 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:18.133279 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-3b0d66f8-47f8-41c7-8304-fa1186d2ecb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:18.146493 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d66f8-47f8-41c7-8304-fa1186d2ecb5 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:18.207190 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c75e28-3737-40f7-9366-2ce6647bfd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:18.207991 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c75e28-3737-40f7-9366-2ce6647bfd38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:18.208281 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c75e28-3737-40f7-9366-2ce6647bfd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:18.208554 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c75e28-3737-40f7-9366-2ce6647bfd38 admin admin] PATH_INFO: `/v3/projects/54d5b30baebc49e9aeaed21c6ea47ff3` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:18.209735 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c75e28-3737-40f7-9366-2ce6647bfd38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d5b30baebc49e9aeaed21c6ea47ff3)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:18.211670 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c75e28-3737-40f7-9366-2ce6647bfd38 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:18.259711 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c5c75e28-3737-40f7-9366-2ce6647bfd38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d5b30baebc49e9aeaed21c6ea47ff3', 'request_id': 'req-c5c75e28-3737-40f7-9366-2ce6647bfd38'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:18.266100 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c5c75e28-3737-40f7-9366-2ce6647bfd38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d5b30baebc49e9aeaed21c6ea47ff3', 'request_id': 'req-c5c75e28-3737-40f7-9366-2ce6647bfd38'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:18.272407 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c5c75e28-3737-40f7-9366-2ce6647bfd38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d5b30baebc49e9aeaed21c6ea47ff3', 'request_id': 'req-c5c75e28-3737-40f7-9366-2ce6647bfd38'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:18.285879 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c5c75e28-3737-40f7-9366-2ce6647bfd38 admin admin] The token cache is being invalidate because project 54d5b30baebc49e9aeaed21c6ea47ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:18.286174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c5c75e28-3737-40f7-9366-2ce6647bfd38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:18.286818 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-c5c75e28-3737-40f7-9366-2ce6647bfd38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:18.288390 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1249/2496] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:18 2021] DELETE /identity/v3/projects/54d5b30baebc49e9aeaed21c6ea47ff3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:18.295115 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ac8d2-ea6e-4315-baab-ffbe52c1d2c6 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:18.295682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ac8d2-ea6e-4315-baab-ffbe52c1d2c6 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:18.295791 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ac8d2-ea6e-4315-baab-ffbe52c1d2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:18.315896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-730ac8d2-ea6e-4315-baab-ffbe52c1d2c6 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:18.317201 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-730ac8d2-ea6e-4315-baab-ffbe52c1d2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:18.375813 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1248/2497] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:18.384345 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d98b58-af0a-4848-a024-e32ae978b757 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:18.384632 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d98b58-af0a-4848-a024-e32ae978b757 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:18.384910 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d98b58-af0a-4848-a024-e32ae978b757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:18.403539 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-26d98b58-af0a-4848-a024-e32ae978b757 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:18.404736 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-26d98b58-af0a-4848-a024-e32ae978b757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:18.413392 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1250/2498] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:18.418400 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ac8d2-ea6e-4315-baab-ffbe52c1d2c6 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:18.428915 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ac8d2-ea6e-4315-baab-ffbe52c1d2c6 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:18.434091 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fffbc-93f6-4bb8-ac4b-5217241d3a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:18.434748 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fffbc-93f6-4bb8-ac4b-5217241d3a1d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:18.435027 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fffbc-93f6-4bb8-ac4b-5217241d3a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:18.435302 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fffbc-93f6-4bb8-ac4b-5217241d3a1d admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:18.436050 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fffbc-93f6-4bb8-ac4b-5217241d3a1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:08:18.436354 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fffbc-93f6-4bb8-ac4b-5217241d3a1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:18.437940 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fffbc-93f6-4bb8-ac4b-5217241d3a1d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:18.449842 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1249/2499] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:08:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:08:18.454976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d98b58-af0a-4848-a024-e32ae978b757 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:18.464223 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d98b58-af0a-4848-a024-e32ae978b757 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:18.468945 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666376f-bf94-42d7-9259-100e1876e0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:18.470634 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666376f-bf94-42d7-9259-100e1876e0dd admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:18.470899 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666376f-bf94-42d7-9259-100e1876e0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:18.471176 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666376f-bf94-42d7-9259-100e1876e0dd admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:18.471980 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666376f-bf94-42d7-9259-100e1876e0dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:18.474196 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666376f-bf94-42d7-9259-100e1876e0dd admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:18.500490 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1251/2500] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:08:18 2021] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:08:18.505248 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fffbc-93f6-4bb8-ac4b-5217241d3a1d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:18.516582 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fffbc-93f6-4bb8-ac4b-5217241d3a1d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:18.575222 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dba51b-fff9-4b12-a50a-65589791b0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:18.575917 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dba51b-fff9-4b12-a50a-65589791b0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:18.576198 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dba51b-fff9-4b12-a50a-65589791b0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:18.576471 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dba51b-fff9-4b12-a50a-65589791b0c8 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:18.577161 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dba51b-fff9-4b12-a50a-65589791b0c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:18.579083 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dba51b-fff9-4b12-a50a-65589791b0c8 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:18.599066 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1250/2501] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:08:18 2021] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:08:18.603065 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666376f-bf94-42d7-9259-100e1876e0dd admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:18.614541 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666376f-bf94-42d7-9259-100e1876e0dd admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:18.619497 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f51378-ff85-4496-a628-9fd5acdc2480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:18.620160 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f51378-ff85-4496-a628-9fd5acdc2480 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:18.620442 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f51378-ff85-4496-a628-9fd5acdc2480 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:18.620715 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f51378-ff85-4496-a628-9fd5acdc2480 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:18.621492 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f51378-ff85-4496-a628-9fd5acdc2480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:18.623082 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f51378-ff85-4496-a628-9fd5acdc2480 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:18.634998 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1252/2502] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:18 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:18.638592 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dba51b-fff9-4b12-a50a-65589791b0c8 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:18.649043 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dba51b-fff9-4b12-a50a-65589791b0c8 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:18.653834 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b903b-35e8-4292-aa2a-8674ca26797d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:18.654493 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b903b-35e8-4292-aa2a-8674ca26797d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:18.654775 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b903b-35e8-4292-aa2a-8674ca26797d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:18.655049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b903b-35e8-4292-aa2a-8674ca26797d admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:18.655878 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b903b-35e8-4292-aa2a-8674ca26797d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:18.658039 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b903b-35e8-4292-aa2a-8674ca26797d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:18.669719 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1251/2503] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:18 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:18.674273 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f51378-ff85-4496-a628-9fd5acdc2480 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:18.684874 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f51378-ff85-4496-a628-9fd5acdc2480 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:18.690120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85290b32-58bc-4fb0-afe4-b9f4d6756189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:18.690997 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290b32-58bc-4fb0-afe4-b9f4d6756189 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:18.691280 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290b32-58bc-4fb0-afe4-b9f4d6756189 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:18.691591 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290b32-58bc-4fb0-afe4-b9f4d6756189 admin admin] PATH_INFO: `/v3/projects/49f25aa1468442fcbc67e819fef69fb0/users/47af3c6ff432477184eae3f7cb09df20/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:18.706547 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85290b32-58bc-4fb0-afe4-b9f4d6756189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49f25aa1468442fcbc67e819fef69fb0, user_id=47af3c6ff432477184eae3f7cb09df20, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:18.709309 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85290b32-58bc-4fb0-afe4-b9f4d6756189 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:18.723123 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1253/2504] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:18 2021] PUT /identity/v3/projects/49f25aa1468442fcbc67e819fef69fb0/users/47af3c6ff432477184eae3f7cb09df20/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:08:18.733130 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9b6b4-903c-485c-ab46-49aff0372455 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:18.733420 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9b6b4-903c-485c-ab46-49aff0372455 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:18.733699 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9b6b4-903c-485c-ab46-49aff0372455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:18.761428 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-b4c9b6b4-903c-485c-ab46-49aff0372455 None None] MFA Rules not processed for user `47af3c6ff432477184eae3f7cb09df20`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:18.762643 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b4c9b6b4-903c-485c-ab46-49aff0372455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:18.826785 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1252/2505] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:18 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:18.831929 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85290b32-58bc-4fb0-afe4-b9f4d6756189 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:18.892958 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85290b32-58bc-4fb0-afe4-b9f4d6756189 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:18.900108 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc8e70-7f4c-495a-a05a-3b65cf381001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:18.900783 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc8e70-7f4c-495a-a05a-3b65cf381001 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:18.901063 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc8e70-7f4c-495a-a05a-3b65cf381001 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:18.901336 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc8e70-7f4c-495a-a05a-3b65cf381001 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:18.902201 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc8e70-7f4c-495a-a05a-3b65cf381001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:18.904512 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc8e70-7f4c-495a-a05a-3b65cf381001 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:18.930872 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1254/2506] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:08:18 2021] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:18.934847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9b6b4-903c-485c-ab46-49aff0372455 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:18.948123 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9b6b4-903c-485c-ab46-49aff0372455 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:19.010754 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3653d6-deb5-4f79-bc58-4340fc76049e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:19.011454 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3653d6-deb5-4f79-bc58-4340fc76049e admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:19.011735 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3653d6-deb5-4f79-bc58-4340fc76049e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:19.012009 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3653d6-deb5-4f79-bc58-4340fc76049e admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:19.012698 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3653d6-deb5-4f79-bc58-4340fc76049e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:19.014612 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3653d6-deb5-4f79-bc58-4340fc76049e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:19.036133 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1253/2507] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:08:18 2021] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:19.040566 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc8e70-7f4c-495a-a05a-3b65cf381001 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:19.052054 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc8e70-7f4c-495a-a05a-3b65cf381001 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:19.057022 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963b12b-7f98-4331-bf66-cc2cc4e25fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:19.057692 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963b12b-7f98-4331-bf66-cc2cc4e25fbe admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:19.057971 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963b12b-7f98-4331-bf66-cc2cc4e25fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:19.058246 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963b12b-7f98-4331-bf66-cc2cc4e25fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:19.058963 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963b12b-7f98-4331-bf66-cc2cc4e25fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:19.060666 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963b12b-7f98-4331-bf66-cc2cc4e25fbe admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:19.072921 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1255/2508] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:19 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:08:19.077114 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3653d6-deb5-4f79-bc58-4340fc76049e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:19.087584 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3653d6-deb5-4f79-bc58-4340fc76049e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:19.092225 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea704ed-85b7-4995-b44a-d92af9a61042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:19.093090 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea704ed-85b7-4995-b44a-d92af9a61042 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:19.093386 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea704ed-85b7-4995-b44a-d92af9a61042 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:19.093656 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea704ed-85b7-4995-b44a-d92af9a61042 admin admin] PATH_INFO: `/v3/projects/a0b6cf63adb34fac9850c90e128f59c5/users/8b9f47cc1d3348929f64535f001ecc9d/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:19.109091 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea704ed-85b7-4995-b44a-d92af9a61042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b6cf63adb34fac9850c90e128f59c5, user_id=8b9f47cc1d3348929f64535f001ecc9d, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:19.112049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea704ed-85b7-4995-b44a-d92af9a61042 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:19.125456 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1254/2509] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:19 2021] PUT /identity/v3/projects/a0b6cf63adb34fac9850c90e128f59c5/users/8b9f47cc1d3348929f64535f001ecc9d/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:19.129712 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963b12b-7f98-4331-bf66-cc2cc4e25fbe admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:19.141060 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963b12b-7f98-4331-bf66-cc2cc4e25fbe admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:19.196550 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643819b-c889-44b1-b674-ad5596f16466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:19.197210 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643819b-c889-44b1-b674-ad5596f16466 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:19.197501 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643819b-c889-44b1-b674-ad5596f16466 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:19.197777 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643819b-c889-44b1-b674-ad5596f16466 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:19.198484 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643819b-c889-44b1-b674-ad5596f16466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:19.200095 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643819b-c889-44b1-b674-ad5596f16466 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:19.210211 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1256/2510] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:19 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:19.214472 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea704ed-85b7-4995-b44a-d92af9a61042 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:19.225457 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea704ed-85b7-4995-b44a-d92af9a61042 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:19.230124 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36d1d3-7bf3-4d08-8e91-b20ef6adacad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:19.230990 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36d1d3-7bf3-4d08-8e91-b20ef6adacad admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:19.231271 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36d1d3-7bf3-4d08-8e91-b20ef6adacad admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:19.231577 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36d1d3-7bf3-4d08-8e91-b20ef6adacad admin admin] PATH_INFO: `/v3/projects/a0b6cf63adb34fac9850c90e128f59c5/users/8b9f47cc1d3348929f64535f001ecc9d/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:19.233535 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36d1d3-7bf3-4d08-8e91-b20ef6adacad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b6cf63adb34fac9850c90e128f59c5, user_id=8b9f47cc1d3348929f64535f001ecc9d, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:19.236509 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36d1d3-7bf3-4d08-8e91-b20ef6adacad admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:19.248596 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1255/2511] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:19 2021] PUT /identity/v3/projects/a0b6cf63adb34fac9850c90e128f59c5/users/8b9f47cc1d3348929f64535f001ecc9d/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:19.261304 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dd2d3-8903-4085-8414-325e7cee080a None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:19.261695 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dd2d3-8903-4085-8414-325e7cee080a None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:19.262180 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657dd2d3-8903-4085-8414-325e7cee080a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:19.296780 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-657dd2d3-8903-4085-8414-325e7cee080a None None] MFA Rules not processed for user `8b9f47cc1d3348929f64535f001ecc9d`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:19.298027 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-657dd2d3-8903-4085-8414-325e7cee080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:19.374835 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1257/2512] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:19 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:19.386529 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36d1d3-7bf3-4d08-8e91-b20ef6adacad admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:19.388308 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ba36d1d3-7bf3-4d08-8e91-b20ef6adacad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:19.446630 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36d1d3-7bf3-4d08-8e91-b20ef6adacad admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:19.450359 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbf0bb-4f69-44aa-baa4-af2dd46b1888 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:19.451011 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbf0bb-4f69-44aa-baa4-af2dd46b1888 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:19.451291 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbf0bb-4f69-44aa-baa4-af2dd46b1888 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:19.451601 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbf0bb-4f69-44aa-baa4-af2dd46b1888 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:19.462437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbf0bb-4f69-44aa-baa4-af2dd46b1888 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:19.463918 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbf0bb-4f69-44aa-baa4-af2dd46b1888 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:19.473429 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1256/2513] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:19 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:19.594043 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dd2d3-8903-4085-8414-325e7cee080a None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:19.657701 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657dd2d3-8903-4085-8414-325e7cee080a None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:19.662533 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61212cb8-a49f-4f41-ba37-4c0ecbeb674a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:19.663350 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61212cb8-a49f-4f41-ba37-4c0ecbeb674a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:19.663662 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61212cb8-a49f-4f41-ba37-4c0ecbeb674a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:19.663939 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61212cb8-a49f-4f41-ba37-4c0ecbeb674a admin admin] PATH_INFO: `/v3/users/47af3c6ff432477184eae3f7cb09df20` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:19.665128 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61212cb8-a49f-4f41-ba37-4c0ecbeb674a admin admin] RBAC: Authorizing `identity:delete_user(user_id=47af3c6ff432477184eae3f7cb09df20)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:19.667058 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61212cb8-a49f-4f41-ba37-4c0ecbeb674a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:19.714726 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-61212cb8-a49f-4f41-ba37-4c0ecbeb674a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47af3c6ff432477184eae3f7cb09df20'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:19.715272 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-61212cb8-a49f-4f41-ba37-4c0ecbeb674a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47af3c6ff432477184eae3f7cb09df20'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:19.715933 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-61212cb8-a49f-4f41-ba37-4c0ecbeb674a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47af3c6ff432477184eae3f7cb09df20'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:19.727999 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-61212cb8-a49f-4f41-ba37-4c0ecbeb674a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47af3c6ff432477184eae3f7cb09df20'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:19.737160 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-61212cb8-a49f-4f41-ba37-4c0ecbeb674a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47af3c6ff432477184eae3f7cb09df20'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:19.749182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1258/2514] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:08:19 2021] DELETE /identity/v3/users/47af3c6ff432477184eae3f7cb09df20 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:19.754546 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83737491-a2fa-417c-9da7-dd4b6af69a4c None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:19.754837 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83737491-a2fa-417c-9da7-dd4b6af69a4c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:19.755114 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83737491-a2fa-417c-9da7-dd4b6af69a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:19.773104 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-83737491-a2fa-417c-9da7-dd4b6af69a4c None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:19.774271 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-83737491-a2fa-417c-9da7-dd4b6af69a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:19.832624 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1257/2515] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:19.843108 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61212cb8-a49f-4f41-ba37-4c0ecbeb674a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:19.844518 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-61212cb8-a49f-4f41-ba37-4c0ecbeb674a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:19.903638 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61212cb8-a49f-4f41-ba37-4c0ecbeb674a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:19.907908 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db47f7-be04-450e-b4e5-f511769ed621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:19.908570 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db47f7-be04-450e-b4e5-f511769ed621 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:19.908851 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db47f7-be04-450e-b4e5-f511769ed621 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:19.909125 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db47f7-be04-450e-b4e5-f511769ed621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:19.918599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db47f7-be04-450e-b4e5-f511769ed621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:19.920086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db47f7-be04-450e-b4e5-f511769ed621 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:19.931098 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1259/2516] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:20.217069 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83737491-a2fa-417c-9da7-dd4b6af69a4c None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:20.218554 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-83737491-a2fa-417c-9da7-dd4b6af69a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:20.233810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83737491-a2fa-417c-9da7-dd4b6af69a4c None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:20.239257 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9cb91-801c-4526-89f7-71fcadadf23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:20.240193 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9cb91-801c-4526-89f7-71fcadadf23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:20.240470 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9cb91-801c-4526-89f7-71fcadadf23b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:20.240745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9cb91-801c-4526-89f7-71fcadadf23b admin admin] PATH_INFO: `/v3/projects/49f25aa1468442fcbc67e819fef69fb0` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:20.241920 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9cb91-801c-4526-89f7-71fcadadf23b admin admin] RBAC: Authorizing `identity:delete_project(project_id=49f25aa1468442fcbc67e819fef69fb0)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:20.243889 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9cb91-801c-4526-89f7-71fcadadf23b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:20.289849 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-82b9cb91-801c-4526-89f7-71fcadadf23b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49f25aa1468442fcbc67e819fef69fb0', 'request_id': 'req-82b9cb91-801c-4526-89f7-71fcadadf23b'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:20.295318 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-82b9cb91-801c-4526-89f7-71fcadadf23b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49f25aa1468442fcbc67e819fef69fb0', 'request_id': 'req-82b9cb91-801c-4526-89f7-71fcadadf23b'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:20.303616 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-82b9cb91-801c-4526-89f7-71fcadadf23b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49f25aa1468442fcbc67e819fef69fb0', 'request_id': 'req-82b9cb91-801c-4526-89f7-71fcadadf23b'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:20.315199 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-82b9cb91-801c-4526-89f7-71fcadadf23b admin admin] The token cache is being invalidate because project 49f25aa1468442fcbc67e819fef69fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:20.315544 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-82b9cb91-801c-4526-89f7-71fcadadf23b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:20.316404 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-82b9cb91-801c-4526-89f7-71fcadadf23b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:20.317949 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1258/2517] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:20 2021] DELETE /identity/v3/projects/49f25aa1468442fcbc67e819fef69fb0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:20.322163 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db47f7-be04-450e-b4e5-f511769ed621 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:20.333800 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db47f7-be04-450e-b4e5-f511769ed621 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:20.388047 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d77f2-b2f7-4f9c-9848-96f3487663de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:20.388924 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d77f2-b2f7-4f9c-9848-96f3487663de admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:20.389207 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d77f2-b2f7-4f9c-9848-96f3487663de admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:20.389484 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d77f2-b2f7-4f9c-9848-96f3487663de admin admin] PATH_INFO: `/v3/users/8b9f47cc1d3348929f64535f001ecc9d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:20.390659 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d77f2-b2f7-4f9c-9848-96f3487663de admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b9f47cc1d3348929f64535f001ecc9d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:20.393333 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d77f2-b2f7-4f9c-9848-96f3487663de admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:20.438941 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-fe7d77f2-b2f7-4f9c-9848-96f3487663de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b9f47cc1d3348929f64535f001ecc9d'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:20.439626 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-fe7d77f2-b2f7-4f9c-9848-96f3487663de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b9f47cc1d3348929f64535f001ecc9d'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:20.440217 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-fe7d77f2-b2f7-4f9c-9848-96f3487663de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b9f47cc1d3348929f64535f001ecc9d'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:20.452574 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-fe7d77f2-b2f7-4f9c-9848-96f3487663de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b9f47cc1d3348929f64535f001ecc9d'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:20.460597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-fe7d77f2-b2f7-4f9c-9848-96f3487663de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b9f47cc1d3348929f64535f001ecc9d'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:20.473924 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1260/2518] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:08:20 2021] DELETE /identity/v3/users/8b9f47cc1d3348929f64535f001ecc9d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:20.794149 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9cb91-801c-4526-89f7-71fcadadf23b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:20.795620 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-82b9cb91-801c-4526-89f7-71fcadadf23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:20.809975 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9cb91-801c-4526-89f7-71fcadadf23b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:20.866893 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f256d0-c62c-4aac-b2e2-1c25c656fa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:20.867803 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f256d0-c62c-4aac-b2e2-1c25c656fa3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:20.868087 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f256d0-c62c-4aac-b2e2-1c25c656fa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:20.868364 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f256d0-c62c-4aac-b2e2-1c25c656fa3a admin admin] PATH_INFO: `/v3/projects/a0b6cf63adb34fac9850c90e128f59c5` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:20.869537 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f256d0-c62c-4aac-b2e2-1c25c656fa3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b6cf63adb34fac9850c90e128f59c5)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:20.871468 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f256d0-c62c-4aac-b2e2-1c25c656fa3a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:20.917095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-f7f256d0-c62c-4aac-b2e2-1c25c656fa3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b6cf63adb34fac9850c90e128f59c5', 'request_id': 'req-f7f256d0-c62c-4aac-b2e2-1c25c656fa3a'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:20.922632 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-f7f256d0-c62c-4aac-b2e2-1c25c656fa3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b6cf63adb34fac9850c90e128f59c5', 'request_id': 'req-f7f256d0-c62c-4aac-b2e2-1c25c656fa3a'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:20.930287 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-f7f256d0-c62c-4aac-b2e2-1c25c656fa3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b6cf63adb34fac9850c90e128f59c5', 'request_id': 'req-f7f256d0-c62c-4aac-b2e2-1c25c656fa3a'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:20.941645 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-f7f256d0-c62c-4aac-b2e2-1c25c656fa3a admin admin] The token cache is being invalidate because project a0b6cf63adb34fac9850c90e128f59c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:20.941928 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-f7f256d0-c62c-4aac-b2e2-1c25c656fa3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:20.942544 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-f7f256d0-c62c-4aac-b2e2-1c25c656fa3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:20.944312 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1259/2519] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:20 2021] DELETE /identity/v3/projects/a0b6cf63adb34fac9850c90e128f59c5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:20.951479 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f514a-7da9-4b1b-9f2f-190e1e7a8258 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:20.951984 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f514a-7da9-4b1b-9f2f-190e1e7a8258 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:20.952472 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f514a-7da9-4b1b-9f2f-190e1e7a8258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:20.972633 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-a10f514a-7da9-4b1b-9f2f-190e1e7a8258 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:20.973843 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a10f514a-7da9-4b1b-9f2f-190e1e7a8258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:21.032064 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1261/2520] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:21.039934 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f04c49-67a5-4580-ab36-2163fcd876d6 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:21.040225 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f04c49-67a5-4580-ab36-2163fcd876d6 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:21.040499 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f04c49-67a5-4580-ab36-2163fcd876d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:21.059123 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-65f04c49-67a5-4580-ab36-2163fcd876d6 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:21.060363 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-65f04c49-67a5-4580-ab36-2163fcd876d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:21.069137 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1260/2521] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:21.073080 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f514a-7da9-4b1b-9f2f-190e1e7a8258 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:21.083875 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f514a-7da9-4b1b-9f2f-190e1e7a8258 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:21.088503 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ffc22-b515-4789-9710-8fb9c643b7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:21.089147 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ffc22-b515-4789-9710-8fb9c643b7cb admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:21.089433 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ffc22-b515-4789-9710-8fb9c643b7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:21.089705 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ffc22-b515-4789-9710-8fb9c643b7cb admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:21.090417 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ffc22-b515-4789-9710-8fb9c643b7cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:08:21.090721 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ffc22-b515-4789-9710-8fb9c643b7cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:21.092330 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ffc22-b515-4789-9710-8fb9c643b7cb admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:21.105124 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1262/2522] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:08:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:08:21.109505 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f04c49-67a5-4580-ab36-2163fcd876d6 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:21.120231 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f04c49-67a5-4580-ab36-2163fcd876d6 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:21.125328 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883fb90-2957-426d-95d1-1ec3c9a2067c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:21.126560 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883fb90-2957-426d-95d1-1ec3c9a2067c admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:21.126880 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883fb90-2957-426d-95d1-1ec3c9a2067c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:21.127133 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883fb90-2957-426d-95d1-1ec3c9a2067c admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:21.127864 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883fb90-2957-426d-95d1-1ec3c9a2067c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:21.129756 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883fb90-2957-426d-95d1-1ec3c9a2067c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:21.164808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1261/2523] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:08:21 2021] POST /identity/v3/projects => generated 409 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:08:21.169017 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ffc22-b515-4789-9710-8fb9c643b7cb admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:21.179612 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ffc22-b515-4789-9710-8fb9c643b7cb admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:21.236234 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517292c8-c330-4193-94c0-476680f3c2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:21.236896 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517292c8-c330-4193-94c0-476680f3c2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:21.237181 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517292c8-c330-4193-94c0-476680f3c2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:21.237454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517292c8-c330-4193-94c0-476680f3c2c3 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:21.238139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517292c8-c330-4193-94c0-476680f3c2c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:21.240104 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517292c8-c330-4193-94c0-476680f3c2c3 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:21.259937 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1263/2524] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:08:21 2021] POST /identity/v3/users => generated 305 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:08:21.264217 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883fb90-2957-426d-95d1-1ec3c9a2067c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:21.274650 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883fb90-2957-426d-95d1-1ec3c9a2067c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:21.279430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd52ee-bd5f-4ca3-a1c3-ee263b84c2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:21.280088 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd52ee-bd5f-4ca3-a1c3-ee263b84c2bf admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:21.280370 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd52ee-bd5f-4ca3-a1c3-ee263b84c2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:21.280671 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd52ee-bd5f-4ca3-a1c3-ee263b84c2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:21.281395 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd52ee-bd5f-4ca3-a1c3-ee263b84c2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:21.283040 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd52ee-bd5f-4ca3-a1c3-ee263b84c2bf admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:21.293290 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1262/2525] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:21.297506 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517292c8-c330-4193-94c0-476680f3c2c3 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:21.309276 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517292c8-c330-4193-94c0-476680f3c2c3 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:21.314534 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502302e-df13-4ce2-a10c-a7957b19554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:21.315190 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502302e-df13-4ce2-a10c-a7957b19554b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:21.315502 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502302e-df13-4ce2-a10c-a7957b19554b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:21.315773 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502302e-df13-4ce2-a10c-a7957b19554b admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:21.316486 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502302e-df13-4ce2-a10c-a7957b19554b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:21.318062 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502302e-df13-4ce2-a10c-a7957b19554b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:21.328690 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1264/2526] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:21 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:21.333300 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd52ee-bd5f-4ca3-a1c3-ee263b84c2bf admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:21.343511 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd52ee-bd5f-4ca3-a1c3-ee263b84c2bf admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:21.348693 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56d63f-5a0e-4e5b-9a00-ffaf210bc55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:21.349562 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56d63f-5a0e-4e5b-9a00-ffaf210bc55b admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:21.349840 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56d63f-5a0e-4e5b-9a00-ffaf210bc55b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:21.350112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56d63f-5a0e-4e5b-9a00-ffaf210bc55b admin admin] PATH_INFO: `/v3/projects/cd9d1514b7784d428cd38e02c7addd71/users/42cc029035764c1f9a8e158075d18a48/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:21.366020 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56d63f-5a0e-4e5b-9a00-ffaf210bc55b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9d1514b7784d428cd38e02c7addd71, user_id=42cc029035764c1f9a8e158075d18a48, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:21.368704 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56d63f-5a0e-4e5b-9a00-ffaf210bc55b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:21.383034 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1263/2527] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:21 2021] PUT /identity/v3/projects/cd9d1514b7784d428cd38e02c7addd71/users/42cc029035764c1f9a8e158075d18a48/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:21.394370 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66db2f-26ad-4571-bc6f-5e223995de9a None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:21.394660 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66db2f-26ad-4571-bc6f-5e223995de9a None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:21.394938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66db2f-26ad-4571-bc6f-5e223995de9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:21.421209 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-5d66db2f-26ad-4571-bc6f-5e223995de9a None None] MFA Rules not processed for user `42cc029035764c1f9a8e158075d18a48`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:21.422539 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-5d66db2f-26ad-4571-bc6f-5e223995de9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:21.493097 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1265/2528] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:21 2021] POST /identity/v3/auth/tokens => generated 3429 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:21.497804 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56d63f-5a0e-4e5b-9a00-ffaf210bc55b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:21.557975 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56d63f-5a0e-4e5b-9a00-ffaf210bc55b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:21.562588 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12b213-2be2-4c07-83a6-f8c405b24f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:21.563238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12b213-2be2-4c07-83a6-f8c405b24f2c admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:21.563583 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12b213-2be2-4c07-83a6-f8c405b24f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:21.563853 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12b213-2be2-4c07-83a6-f8c405b24f2c admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:21.564693 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12b213-2be2-4c07-83a6-f8c405b24f2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:21.566666 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12b213-2be2-4c07-83a6-f8c405b24f2c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:21.590914 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1264/2529] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:08:21 2021] POST /identity/v3/projects => generated 409 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:08:21.595254 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66db2f-26ad-4571-bc6f-5e223995de9a None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:21.605617 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66db2f-26ad-4571-bc6f-5e223995de9a None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:21.661594 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26eff7-5485-4209-bad9-3c13e257cbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:21.662262 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26eff7-5485-4209-bad9-3c13e257cbfc admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:21.662543 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26eff7-5485-4209-bad9-3c13e257cbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:21.662858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26eff7-5485-4209-bad9-3c13e257cbfc admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:21.663538 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26eff7-5485-4209-bad9-3c13e257cbfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:21.665460 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26eff7-5485-4209-bad9-3c13e257cbfc admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:21.685816 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1266/2530] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:08:21 2021] POST /identity/v3/users => generated 311 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:21.689906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12b213-2be2-4c07-83a6-f8c405b24f2c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:21.700025 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12b213-2be2-4c07-83a6-f8c405b24f2c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:21.704866 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b81d4-19cb-4b0f-839f-da344da6c9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:21.705524 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b81d4-19cb-4b0f-839f-da344da6c9fa admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:21.705807 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b81d4-19cb-4b0f-839f-da344da6c9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:21.706083 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b81d4-19cb-4b0f-839f-da344da6c9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:21.706794 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b81d4-19cb-4b0f-839f-da344da6c9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:21.708429 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b81d4-19cb-4b0f-839f-da344da6c9fa admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:21.723537 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1265/2531] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:21 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:08:21.724577 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26eff7-5485-4209-bad9-3c13e257cbfc admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:21.734279 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26eff7-5485-4209-bad9-3c13e257cbfc admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:21.739405 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf5e77-115c-408a-a5f5-0bd77c4b11c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:21.740308 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf5e77-115c-408a-a5f5-0bd77c4b11c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:21.740588 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf5e77-115c-408a-a5f5-0bd77c4b11c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:21.740860 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf5e77-115c-408a-a5f5-0bd77c4b11c9 admin admin] PATH_INFO: `/v3/projects/f40a47d0cc45499891960541f2fd0a62/users/b03bfd925e054988bb248aaae77e3421/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:21.756680 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf5e77-115c-408a-a5f5-0bd77c4b11c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40a47d0cc45499891960541f2fd0a62, user_id=b03bfd925e054988bb248aaae77e3421, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:21.759284 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf5e77-115c-408a-a5f5-0bd77c4b11c9 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:21.772288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1267/2532] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:21 2021] PUT /identity/v3/projects/f40a47d0cc45499891960541f2fd0a62/users/b03bfd925e054988bb248aaae77e3421/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:08:21.776155 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b81d4-19cb-4b0f-839f-da344da6c9fa admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:21.786875 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b81d4-19cb-4b0f-839f-da344da6c9fa admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:21.850570 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b9732-f772-4346-a3cb-13863e986ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:21.851306 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b9732-f772-4346-a3cb-13863e986ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:21.851478 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b9732-f772-4346-a3cb-13863e986ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:21.851756 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b9732-f772-4346-a3cb-13863e986ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:21.852485 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b9732-f772-4346-a3cb-13863e986ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:21.854088 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b9732-f772-4346-a3cb-13863e986ce3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:21.865098 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1266/2533] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:21 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:21.869092 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf5e77-115c-408a-a5f5-0bd77c4b11c9 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:21.881820 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf5e77-115c-408a-a5f5-0bd77c4b11c9 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:21.888848 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161aa403-d9a6-4490-aab4-1f7aa64b8bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:21.889895 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161aa403-d9a6-4490-aab4-1f7aa64b8bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:21.890317 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161aa403-d9a6-4490-aab4-1f7aa64b8bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:21.890730 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161aa403-d9a6-4490-aab4-1f7aa64b8bc1 admin admin] PATH_INFO: `/v3/projects/f40a47d0cc45499891960541f2fd0a62/users/b03bfd925e054988bb248aaae77e3421/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:21.893383 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161aa403-d9a6-4490-aab4-1f7aa64b8bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40a47d0cc45499891960541f2fd0a62, user_id=b03bfd925e054988bb248aaae77e3421, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:21.896259 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161aa403-d9a6-4490-aab4-1f7aa64b8bc1 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:21.906560 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1268/2534] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:21 2021] PUT /identity/v3/projects/f40a47d0cc45499891960541f2fd0a62/users/b03bfd925e054988bb248aaae77e3421/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:08:21.916873 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4145dde-a68e-46b1-8012-dee5a65ae223 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:21.917164 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4145dde-a68e-46b1-8012-dee5a65ae223 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:21.917444 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4145dde-a68e-46b1-8012-dee5a65ae223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:21.946308 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-a4145dde-a68e-46b1-8012-dee5a65ae223 None None] MFA Rules not processed for user `b03bfd925e054988bb248aaae77e3421`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:21.947566 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a4145dde-a68e-46b1-8012-dee5a65ae223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:22.017363 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1267/2535] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:21 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:22.027583 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161aa403-d9a6-4490-aab4-1f7aa64b8bc1 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:22.029437 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-161aa403-d9a6-4490-aab4-1f7aa64b8bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:22.087908 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161aa403-d9a6-4490-aab4-1f7aa64b8bc1 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:22.091553 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4e1fc-9508-4bc2-86c6-7de0cda3cac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:22.092202 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4e1fc-9508-4bc2-86c6-7de0cda3cac0 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:22.092482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4e1fc-9508-4bc2-86c6-7de0cda3cac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:22.092759 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4e1fc-9508-4bc2-86c6-7de0cda3cac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:22.101540 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4e1fc-9508-4bc2-86c6-7de0cda3cac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:22.102914 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4e1fc-9508-4bc2-86c6-7de0cda3cac0 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:22.112983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1269/2536] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:22 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:22.254227 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4145dde-a68e-46b1-8012-dee5a65ae223 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:22.264303 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4145dde-a68e-46b1-8012-dee5a65ae223 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:22.268516 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0437689-0d0e-4573-9b08-f30477fdd349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:22.269148 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0437689-0d0e-4573-9b08-f30477fdd349 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:22.269431 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0437689-0d0e-4573-9b08-f30477fdd349 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:22.269735 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0437689-0d0e-4573-9b08-f30477fdd349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:22.325641 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0437689-0d0e-4573-9b08-f30477fdd349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:22.327093 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0437689-0d0e-4573-9b08-f30477fdd349 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:22.336449 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1268/2537] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:22 2021] GET /identity/v3/auth/tokens => generated 3429 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:30.594013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4e1fc-9508-4bc2-86c6-7de0cda3cac0 service cinder] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:30.655259 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4e1fc-9508-4bc2-86c6-7de0cda3cac0 service cinder] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:30.660333 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136d423-c257-44d7-86cf-f2a4d9234360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:30.661189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136d423-c257-44d7-86cf-f2a4d9234360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:30.661467 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136d423-c257-44d7-86cf-f2a4d9234360 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:30.661741 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136d423-c257-44d7-86cf-f2a4d9234360 admin admin] PATH_INFO: `/v3/users/42cc029035764c1f9a8e158075d18a48` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:30.662915 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136d423-c257-44d7-86cf-f2a4d9234360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42cc029035764c1f9a8e158075d18a48)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:30.664853 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136d423-c257-44d7-86cf-f2a4d9234360 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:30.708511 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-d136d423-c257-44d7-86cf-f2a4d9234360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42cc029035764c1f9a8e158075d18a48'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:30.709158 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-d136d423-c257-44d7-86cf-f2a4d9234360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42cc029035764c1f9a8e158075d18a48'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:30.709769 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-d136d423-c257-44d7-86cf-f2a4d9234360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42cc029035764c1f9a8e158075d18a48'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:30.722096 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-d136d423-c257-44d7-86cf-f2a4d9234360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42cc029035764c1f9a8e158075d18a48'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:30.728808 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-d136d423-c257-44d7-86cf-f2a4d9234360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42cc029035764c1f9a8e158075d18a48'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:30.741388 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1270/2538] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:08:30 2021] DELETE /identity/v3/users/42cc029035764c1f9a8e158075d18a48 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:30.745908 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250870ef-71a1-4d68-ab69-361028d775b1 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:30.746367 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250870ef-71a1-4d68-ab69-361028d775b1 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:30.746463 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250870ef-71a1-4d68-ab69-361028d775b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:30.763282 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-250870ef-71a1-4d68-ab69-361028d775b1 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:30.764476 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-250870ef-71a1-4d68-ab69-361028d775b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:30.819113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1269/2539] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:30.828873 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136d423-c257-44d7-86cf-f2a4d9234360 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:30.830276 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d136d423-c257-44d7-86cf-f2a4d9234360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:30.884664 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136d423-c257-44d7-86cf-f2a4d9234360 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:30.888307 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2530fcd-6c8d-4dc9-bc76-f349d9b549c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:30.888937 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2530fcd-6c8d-4dc9-bc76-f349d9b549c1 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:30.889218 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2530fcd-6c8d-4dc9-bc76-f349d9b549c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:30.889491 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2530fcd-6c8d-4dc9-bc76-f349d9b549c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:30.898723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2530fcd-6c8d-4dc9-bc76-f349d9b549c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:30.900161 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2530fcd-6c8d-4dc9-bc76-f349d9b549c1 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:30.909805 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1271/2540] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:31.181525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250870ef-71a1-4d68-ab69-361028d775b1 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:31.183297 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-250870ef-71a1-4d68-ab69-361028d775b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:31.196099 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250870ef-71a1-4d68-ab69-361028d775b1 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:31.200943 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882f5eb-d886-417c-a338-25bca5ad9f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:31.201934 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882f5eb-d886-417c-a338-25bca5ad9f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:31.202214 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882f5eb-d886-417c-a338-25bca5ad9f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:31.202496 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882f5eb-d886-417c-a338-25bca5ad9f68 admin admin] PATH_INFO: `/v3/projects/cd9d1514b7784d428cd38e02c7addd71` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:31.203716 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882f5eb-d886-417c-a338-25bca5ad9f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9d1514b7784d428cd38e02c7addd71)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:31.206215 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882f5eb-d886-417c-a338-25bca5ad9f68 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:31.250337 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-7882f5eb-d886-417c-a338-25bca5ad9f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9d1514b7784d428cd38e02c7addd71', 'request_id': 'req-7882f5eb-d886-417c-a338-25bca5ad9f68'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:31.257412 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-7882f5eb-d886-417c-a338-25bca5ad9f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9d1514b7784d428cd38e02c7addd71', 'request_id': 'req-7882f5eb-d886-417c-a338-25bca5ad9f68'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:31.264705 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-7882f5eb-d886-417c-a338-25bca5ad9f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9d1514b7784d428cd38e02c7addd71', 'request_id': 'req-7882f5eb-d886-417c-a338-25bca5ad9f68'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:31.276876 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-7882f5eb-d886-417c-a338-25bca5ad9f68 admin admin] The token cache is being invalidate because project cd9d1514b7784d428cd38e02c7addd71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:31.277160 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-7882f5eb-d886-417c-a338-25bca5ad9f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:31.277805 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-7882f5eb-d886-417c-a338-25bca5ad9f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:31.279412 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1270/2541] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:31 2021] DELETE /identity/v3/projects/cd9d1514b7784d428cd38e02c7addd71 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:31.283381 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2530fcd-6c8d-4dc9-bc76-f349d9b549c1 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:31.293177 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2530fcd-6c8d-4dc9-bc76-f349d9b549c1 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:31.348505 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e925de6-c8b8-492a-b989-2bb6e5099847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:31.349365 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e925de6-c8b8-492a-b989-2bb6e5099847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:31.349648 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e925de6-c8b8-492a-b989-2bb6e5099847 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:31.349923 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e925de6-c8b8-492a-b989-2bb6e5099847 admin admin] PATH_INFO: `/v3/users/b03bfd925e054988bb248aaae77e3421` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:31.351095 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e925de6-c8b8-492a-b989-2bb6e5099847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b03bfd925e054988bb248aaae77e3421)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:31.353046 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e925de6-c8b8-492a-b989-2bb6e5099847 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:31.398289 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2e925de6-c8b8-492a-b989-2bb6e5099847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b03bfd925e054988bb248aaae77e3421'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:31.398939 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2e925de6-c8b8-492a-b989-2bb6e5099847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b03bfd925e054988bb248aaae77e3421'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:31.399579 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2e925de6-c8b8-492a-b989-2bb6e5099847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b03bfd925e054988bb248aaae77e3421'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:31.411346 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2e925de6-c8b8-492a-b989-2bb6e5099847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b03bfd925e054988bb248aaae77e3421'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:31.418507 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2e925de6-c8b8-492a-b989-2bb6e5099847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b03bfd925e054988bb248aaae77e3421'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:31.431134 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1272/2542] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:08:31 2021] DELETE /identity/v3/users/b03bfd925e054988bb248aaae77e3421 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:31.704796 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882f5eb-d886-417c-a338-25bca5ad9f68 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:31.706768 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-7882f5eb-d886-417c-a338-25bca5ad9f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:31.720031 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882f5eb-d886-417c-a338-25bca5ad9f68 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:31.776010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cfed5-cc02-4ceb-9355-fbfe392e910f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:31.776869 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cfed5-cc02-4ceb-9355-fbfe392e910f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:31.777150 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cfed5-cc02-4ceb-9355-fbfe392e910f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:31.777451 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cfed5-cc02-4ceb-9355-fbfe392e910f admin admin] PATH_INFO: `/v3/projects/f40a47d0cc45499891960541f2fd0a62` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:31.778653 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cfed5-cc02-4ceb-9355-fbfe392e910f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40a47d0cc45499891960541f2fd0a62)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:31.780633 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526cfed5-cc02-4ceb-9355-fbfe392e910f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:31.824486 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-526cfed5-cc02-4ceb-9355-fbfe392e910f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40a47d0cc45499891960541f2fd0a62', 'request_id': 'req-526cfed5-cc02-4ceb-9355-fbfe392e910f'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:31.829580 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-526cfed5-cc02-4ceb-9355-fbfe392e910f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40a47d0cc45499891960541f2fd0a62', 'request_id': 'req-526cfed5-cc02-4ceb-9355-fbfe392e910f'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:31.837315 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-526cfed5-cc02-4ceb-9355-fbfe392e910f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40a47d0cc45499891960541f2fd0a62', 'request_id': 'req-526cfed5-cc02-4ceb-9355-fbfe392e910f'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:31.848789 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-526cfed5-cc02-4ceb-9355-fbfe392e910f admin admin] The token cache is being invalidate because project f40a47d0cc45499891960541f2fd0a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:31.849076 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-526cfed5-cc02-4ceb-9355-fbfe392e910f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:31.849712 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-526cfed5-cc02-4ceb-9355-fbfe392e910f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:31.851232 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1271/2543] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:31 2021] DELETE /identity/v3/projects/f40a47d0cc45499891960541f2fd0a62 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:08:31.861495 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313a230-d3b4-44f5-847d-72905452e672 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:31.862004 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313a230-d3b4-44f5-847d-72905452e672 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:31.862104 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313a230-d3b4-44f5-847d-72905452e672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:31.881421 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-4313a230-d3b4-44f5-847d-72905452e672 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:31.882600 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-4313a230-d3b4-44f5-847d-72905452e672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:31.937768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1273/2544] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:31.946133 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c47f44-f311-4af0-9aed-66944249abd0 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:31.946449 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c47f44-f311-4af0-9aed-66944249abd0 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:31.946726 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c47f44-f311-4af0-9aed-66944249abd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:31.965240 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-64c47f44-f311-4af0-9aed-66944249abd0 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:31.966426 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-64c47f44-f311-4af0-9aed-66944249abd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:31.974357 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1272/2545] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:08:31.978335 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313a230-d3b4-44f5-847d-72905452e672 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:31.987859 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313a230-d3b4-44f5-847d-72905452e672 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:31.992412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1b086-883b-4e33-b0dc-147b6f0456b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:31.993058 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1b086-883b-4e33-b0dc-147b6f0456b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:31.993344 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1b086-883b-4e33-b0dc-147b6f0456b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:31.993639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1b086-883b-4e33-b0dc-147b6f0456b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:31.994334 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1b086-883b-4e33-b0dc-147b6f0456b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:08:31.994648 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1b086-883b-4e33-b0dc-147b6f0456b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:31.996269 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1b086-883b-4e33-b0dc-147b6f0456b1 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:32.008139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1274/2546] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:08:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:08:32.012214 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c47f44-f311-4af0-9aed-66944249abd0 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:32.021769 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c47f44-f311-4af0-9aed-66944249abd0 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:32.026476 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9ab90-9193-45ad-bedb-72885d1471ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:32.027129 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9ab90-9193-45ad-bedb-72885d1471ec admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:32.027556 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9ab90-9193-45ad-bedb-72885d1471ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:32.027853 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9ab90-9193-45ad-bedb-72885d1471ec admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:32.028535 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9ab90-9193-45ad-bedb-72885d1471ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:32.030432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9ab90-9193-45ad-bedb-72885d1471ec admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:32.055177 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1273/2547] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:08:32 2021] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:08:32.059291 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1b086-883b-4e33-b0dc-147b6f0456b1 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:32.069822 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1b086-883b-4e33-b0dc-147b6f0456b1 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:32.123968 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3216e00-6285-4e04-a37c-0caa71ca7845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:32.125198 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3216e00-6285-4e04-a37c-0caa71ca7845 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:32.125767 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3216e00-6285-4e04-a37c-0caa71ca7845 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:32.126110 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3216e00-6285-4e04-a37c-0caa71ca7845 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:32.126792 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3216e00-6285-4e04-a37c-0caa71ca7845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:32.129358 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3216e00-6285-4e04-a37c-0caa71ca7845 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:32.151151 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1275/2548] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:08:32 2021] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:08:32.155288 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9ab90-9193-45ad-bedb-72885d1471ec admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:32.165574 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9ab90-9193-45ad-bedb-72885d1471ec admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:32.170244 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80944e45-0697-47ed-928c-af94aaf6d6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:32.170898 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80944e45-0697-47ed-928c-af94aaf6d6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:32.171182 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80944e45-0697-47ed-928c-af94aaf6d6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:32.171501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80944e45-0697-47ed-928c-af94aaf6d6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:32.172235 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80944e45-0697-47ed-928c-af94aaf6d6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:32.173812 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80944e45-0697-47ed-928c-af94aaf6d6a3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:32.184260 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1274/2549] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:32 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:32.188115 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3216e00-6285-4e04-a37c-0caa71ca7845 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:32.199057 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3216e00-6285-4e04-a37c-0caa71ca7845 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:32.204304 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e7beb-512c-4ff3-a346-8f6da89fec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:32.204969 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e7beb-512c-4ff3-a346-8f6da89fec8f admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:32.205250 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e7beb-512c-4ff3-a346-8f6da89fec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:32.206075 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e7beb-512c-4ff3-a346-8f6da89fec8f admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:32.206784 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e7beb-512c-4ff3-a346-8f6da89fec8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:32.208430 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e7beb-512c-4ff3-a346-8f6da89fec8f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:32.218511 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1276/2550] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:32 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:08:32.223046 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80944e45-0697-47ed-928c-af94aaf6d6a3 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:32.232905 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80944e45-0697-47ed-928c-af94aaf6d6a3 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:32.237675 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14eb005-060b-432a-b6a4-fd1d1a306f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:32.238543 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eb005-060b-432a-b6a4-fd1d1a306f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:32.238852 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eb005-060b-432a-b6a4-fd1d1a306f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:32.239128 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eb005-060b-432a-b6a4-fd1d1a306f46 admin admin] PATH_INFO: `/v3/projects/70ee5256a5e84d8aacfc24350d09d31d/users/5b94ed686ac6402e87cab80b29ef034b/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:32.253809 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14eb005-060b-432a-b6a4-fd1d1a306f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ee5256a5e84d8aacfc24350d09d31d, user_id=5b94ed686ac6402e87cab80b29ef034b, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:32.256790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14eb005-060b-432a-b6a4-fd1d1a306f46 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:32.270201 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1275/2551] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:32 2021] PUT /identity/v3/projects/70ee5256a5e84d8aacfc24350d09d31d/users/5b94ed686ac6402e87cab80b29ef034b/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:08:32.281238 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941ea99-d3b4-41b6-b3d2-16163127fdb2 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:32.281619 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941ea99-d3b4-41b6-b3d2-16163127fdb2 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:32.281894 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941ea99-d3b4-41b6-b3d2-16163127fdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:32.308959 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-c941ea99-d3b4-41b6-b3d2-16163127fdb2 None None] MFA Rules not processed for user `5b94ed686ac6402e87cab80b29ef034b`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:32.310161 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c941ea99-d3b4-41b6-b3d2-16163127fdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:32.373260 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1277/2552] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:32 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:32.378361 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14eb005-060b-432a-b6a4-fd1d1a306f46 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:32.437765 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14eb005-060b-432a-b6a4-fd1d1a306f46 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:32.443141 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b425b-ab3b-4018-85fa-3cd90813dbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:32.443817 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b425b-ab3b-4018-85fa-3cd90813dbe3 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:32.444099 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b425b-ab3b-4018-85fa-3cd90813dbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:32.444372 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b425b-ab3b-4018-85fa-3cd90813dbe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:32.445042 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b425b-ab3b-4018-85fa-3cd90813dbe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:32.446923 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b425b-ab3b-4018-85fa-3cd90813dbe3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:32.470630 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1276/2553] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:08:32 2021] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:32.474938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941ea99-d3b4-41b6-b3d2-16163127fdb2 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:32.485226 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941ea99-d3b4-41b6-b3d2-16163127fdb2 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:32.541563 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821991c-4c54-4417-bc9c-7ec16c5b2be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:32.542221 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821991c-4c54-4417-bc9c-7ec16c5b2be5 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:32.542499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821991c-4c54-4417-bc9c-7ec16c5b2be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:32.542771 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821991c-4c54-4417-bc9c-7ec16c5b2be5 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:32.543491 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821991c-4c54-4417-bc9c-7ec16c5b2be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:32.545380 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821991c-4c54-4417-bc9c-7ec16c5b2be5 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:32.564854 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1278/2554] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:08:32 2021] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:32.568604 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b425b-ab3b-4018-85fa-3cd90813dbe3 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:32.578620 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b425b-ab3b-4018-85fa-3cd90813dbe3 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:32.583972 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab02918-f4e9-470a-bf26-7a054f691372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:32.584626 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab02918-f4e9-470a-bf26-7a054f691372 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:32.584912 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab02918-f4e9-470a-bf26-7a054f691372 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:32.585190 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab02918-f4e9-470a-bf26-7a054f691372 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:32.585905 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab02918-f4e9-470a-bf26-7a054f691372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:32.587541 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab02918-f4e9-470a-bf26-7a054f691372 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:32.598251 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1277/2555] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:32 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:32.602157 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821991c-4c54-4417-bc9c-7ec16c5b2be5 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:32.611845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821991c-4c54-4417-bc9c-7ec16c5b2be5 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:32.616445 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818de7d6-3dd9-48bb-9943-373f4853243a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:32.617099 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818de7d6-3dd9-48bb-9943-373f4853243a admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:32.617383 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818de7d6-3dd9-48bb-9943-373f4853243a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:32.617661 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818de7d6-3dd9-48bb-9943-373f4853243a admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:32.618379 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818de7d6-3dd9-48bb-9943-373f4853243a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:32.619996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818de7d6-3dd9-48bb-9943-373f4853243a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:32.629781 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1279/2556] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:32 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:32.633827 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab02918-f4e9-470a-bf26-7a054f691372 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:32.644081 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab02918-f4e9-470a-bf26-7a054f691372 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:32.648691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94992b2b-4b03-44f9-b355-47409242e1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:32.649542 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94992b2b-4b03-44f9-b355-47409242e1b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:32.649818 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94992b2b-4b03-44f9-b355-47409242e1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:32.650088 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94992b2b-4b03-44f9-b355-47409242e1b6 admin admin] PATH_INFO: `/v3/projects/59945356afad4d84b65d29208f464adc/users/b429647b37e24213a358a540384cad97/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:32.664459 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94992b2b-4b03-44f9-b355-47409242e1b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59945356afad4d84b65d29208f464adc, user_id=b429647b37e24213a358a540384cad97, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:32.667081 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94992b2b-4b03-44f9-b355-47409242e1b6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:32.680551 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1278/2557] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:32 2021] PUT /identity/v3/projects/59945356afad4d84b65d29208f464adc/users/b429647b37e24213a358a540384cad97/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:32.691003 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bc88f-24a1-44cd-861d-d72a887e8e7c None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:32.691287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bc88f-24a1-44cd-861d-d72a887e8e7c None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:32.691588 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bc88f-24a1-44cd-861d-d72a887e8e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:32.717746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-1b6bc88f-24a1-44cd-861d-d72a887e8e7c None None] MFA Rules not processed for user `b429647b37e24213a358a540384cad97`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:32.718967 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1b6bc88f-24a1-44cd-861d-d72a887e8e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:32.782786 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1280/2558] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:32 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:32.787228 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94992b2b-4b03-44f9-b355-47409242e1b6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:32.847429 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94992b2b-4b03-44f9-b355-47409242e1b6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:32.852003 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a4ac6-9eee-49d2-8067-8b7ec42b589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:32.852645 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a4ac6-9eee-49d2-8067-8b7ec42b589f admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:32.852929 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a4ac6-9eee-49d2-8067-8b7ec42b589f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:32.853202 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a4ac6-9eee-49d2-8067-8b7ec42b589f admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:32.853898 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a4ac6-9eee-49d2-8067-8b7ec42b589f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:32.855809 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a4ac6-9eee-49d2-8067-8b7ec42b589f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:32.880190 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1279/2559] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:08:32 2021] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:32.884353 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bc88f-24a1-44cd-861d-d72a887e8e7c None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:32.895430 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bc88f-24a1-44cd-861d-d72a887e8e7c None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:32.949614 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8aa560-1167-416f-8eb5-0da997ad01e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:32.950273 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8aa560-1167-416f-8eb5-0da997ad01e7 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:32.950556 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8aa560-1167-416f-8eb5-0da997ad01e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:32.950829 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8aa560-1167-416f-8eb5-0da997ad01e7 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:32.951542 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8aa560-1167-416f-8eb5-0da997ad01e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:32.953435 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8aa560-1167-416f-8eb5-0da997ad01e7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:32.973698 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1281/2560] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:08:32 2021] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:32.977689 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a4ac6-9eee-49d2-8067-8b7ec42b589f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:32.988572 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a4ac6-9eee-49d2-8067-8b7ec42b589f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:32.993154 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f29651-f23f-413d-9bec-d6a0664e3756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:32.993827 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f29651-f23f-413d-9bec-d6a0664e3756 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:32.994112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f29651-f23f-413d-9bec-d6a0664e3756 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:32.994384 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f29651-f23f-413d-9bec-d6a0664e3756 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:32.995088 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f29651-f23f-413d-9bec-d6a0664e3756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:32.996685 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f29651-f23f-413d-9bec-d6a0664e3756 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:33.006686 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1280/2561] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:32 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:08:33.010495 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8aa560-1167-416f-8eb5-0da997ad01e7 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:33.019990 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8aa560-1167-416f-8eb5-0da997ad01e7 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:33.024510 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339912b-97b0-4f6f-9e02-683b418b2d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:33.025368 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339912b-97b0-4f6f-9e02-683b418b2d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:33.025645 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339912b-97b0-4f6f-9e02-683b418b2d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:33.025916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339912b-97b0-4f6f-9e02-683b418b2d19 admin admin] PATH_INFO: `/v3/projects/27d6082cb396474497d389a563f212b7/users/e320413d283547459b8df06e952cebbc/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:33.040324 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339912b-97b0-4f6f-9e02-683b418b2d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d6082cb396474497d389a563f212b7, user_id=e320413d283547459b8df06e952cebbc, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:33.042940 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339912b-97b0-4f6f-9e02-683b418b2d19 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:33.056768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1282/2562] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:33 2021] PUT /identity/v3/projects/27d6082cb396474497d389a563f212b7/users/e320413d283547459b8df06e952cebbc/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:08:33.060491 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f29651-f23f-413d-9bec-d6a0664e3756 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:33.070650 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f29651-f23f-413d-9bec-d6a0664e3756 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:33.124879 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea9cb1-7157-4f74-835e-16e92ef92296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:33.125544 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea9cb1-7157-4f74-835e-16e92ef92296 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:33.125821 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea9cb1-7157-4f74-835e-16e92ef92296 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:33.126090 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea9cb1-7157-4f74-835e-16e92ef92296 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:33.126801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea9cb1-7157-4f74-835e-16e92ef92296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:33.129436 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea9cb1-7157-4f74-835e-16e92ef92296 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:33.139449 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1281/2563] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:33 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:08:33.144706 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339912b-97b0-4f6f-9e02-683b418b2d19 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:33.154678 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339912b-97b0-4f6f-9e02-683b418b2d19 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:33.160294 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aee3eb-06ce-4df4-bda3-7ef4491d4b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:33.161208 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aee3eb-06ce-4df4-bda3-7ef4491d4b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:33.161488 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aee3eb-06ce-4df4-bda3-7ef4491d4b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:33.161768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aee3eb-06ce-4df4-bda3-7ef4491d4b8b admin admin] PATH_INFO: `/v3/projects/27d6082cb396474497d389a563f212b7/users/e320413d283547459b8df06e952cebbc/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:33.163714 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aee3eb-06ce-4df4-bda3-7ef4491d4b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d6082cb396474497d389a563f212b7, user_id=e320413d283547459b8df06e952cebbc, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:33.166836 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aee3eb-06ce-4df4-bda3-7ef4491d4b8b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:33.178133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1283/2564] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:33 2021] PUT /identity/v3/projects/27d6082cb396474497d389a563f212b7/users/e320413d283547459b8df06e952cebbc/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:33.188299 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27bcdc-51d0-4ad0-87e4-ee214ba51a48 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:33.188585 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27bcdc-51d0-4ad0-87e4-ee214ba51a48 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:33.188856 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27bcdc-51d0-4ad0-87e4-ee214ba51a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:33.214729 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-3e27bcdc-51d0-4ad0-87e4-ee214ba51a48 None None] MFA Rules not processed for user `e320413d283547459b8df06e952cebbc`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:33.215939 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-3e27bcdc-51d0-4ad0-87e4-ee214ba51a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:33.279304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1282/2565] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:33 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:33.291051 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aee3eb-06ce-4df4-bda3-7ef4491d4b8b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:33.292870 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f8aee3eb-06ce-4df4-bda3-7ef4491d4b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:33.347909 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aee3eb-06ce-4df4-bda3-7ef4491d4b8b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:33.351541 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba82f4d-8e14-4c13-91ee-b1fd0461224e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:33.352169 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba82f4d-8e14-4c13-91ee-b1fd0461224e service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:33.352448 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba82f4d-8e14-4c13-91ee-b1fd0461224e service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:33.352718 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba82f4d-8e14-4c13-91ee-b1fd0461224e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:33.408284 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba82f4d-8e14-4c13-91ee-b1fd0461224e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:33.409805 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba82f4d-8e14-4c13-91ee-b1fd0461224e service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:33.418922 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1284/2566] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:33 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:34.895000 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27bcdc-51d0-4ad0-87e4-ee214ba51a48 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:34.904311 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27bcdc-51d0-4ad0-87e4-ee214ba51a48 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:34.907899 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c500569-b82c-4db7-9d81-18d369a92476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:34.908528 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c500569-b82c-4db7-9d81-18d369a92476 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:34.909370 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c500569-b82c-4db7-9d81-18d369a92476 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:34.909696 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c500569-b82c-4db7-9d81-18d369a92476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:34.963113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c500569-b82c-4db7-9d81-18d369a92476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:34.964528 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c500569-b82c-4db7-9d81-18d369a92476 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:34.973629 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1283/2567] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:34 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:35.467063 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba82f4d-8e14-4c13-91ee-b1fd0461224e service cinder] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:35.476090 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba82f4d-8e14-4c13-91ee-b1fd0461224e service cinder] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:35.479686 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70d95a-78f3-46cd-97bd-c8b492389ff2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:35.480254 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70d95a-78f3-46cd-97bd-c8b492389ff2 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:35.480531 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70d95a-78f3-46cd-97bd-c8b492389ff2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:35.480834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70d95a-78f3-46cd-97bd-c8b492389ff2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:35.489628 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70d95a-78f3-46cd-97bd-c8b492389ff2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:35.491026 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70d95a-78f3-46cd-97bd-c8b492389ff2 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:35.500337 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1285/2568] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:35 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:46.104715 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c500569-b82c-4db7-9d81-18d369a92476 service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:46.213097 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c500569-b82c-4db7-9d81-18d369a92476 service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:46.226335 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42a210-816e-4feb-9d15-35b64343d813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:46.227690 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42a210-816e-4feb-9d15-35b64343d813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:46.228151 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42a210-816e-4feb-9d15-35b64343d813 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:46.228905 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42a210-816e-4feb-9d15-35b64343d813 admin admin] PATH_INFO: `/v3/users/5b94ed686ac6402e87cab80b29ef034b` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:46.230600 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42a210-816e-4feb-9d15-35b64343d813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b94ed686ac6402e87cab80b29ef034b)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:46.240245 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42a210-816e-4feb-9d15-35b64343d813 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:46.320000 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ae42a210-816e-4feb-9d15-35b64343d813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b94ed686ac6402e87cab80b29ef034b'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:46.336999 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ae42a210-816e-4feb-9d15-35b64343d813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b94ed686ac6402e87cab80b29ef034b'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:46.337847 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ae42a210-816e-4feb-9d15-35b64343d813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b94ed686ac6402e87cab80b29ef034b'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:46.344865 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ae42a210-816e-4feb-9d15-35b64343d813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b94ed686ac6402e87cab80b29ef034b'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:46.354226 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-ae42a210-816e-4feb-9d15-35b64343d813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b94ed686ac6402e87cab80b29ef034b'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:46.361630 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1284/2569] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:08:46 2021] DELETE /identity/v3/users/5b94ed686ac6402e87cab80b29ef034b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:46.366985 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806995b-e702-4684-8a72-7d300e2dc533 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:46.367597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806995b-e702-4684-8a72-7d300e2dc533 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:46.367597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806995b-e702-4684-8a72-7d300e2dc533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:46.387947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-6806995b-e702-4684-8a72-7d300e2dc533 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:46.389190 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-6806995b-e702-4684-8a72-7d300e2dc533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:46.450752 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1286/2570] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:46.461638 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42a210-816e-4feb-9d15-35b64343d813 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:46.463222 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ae42a210-816e-4feb-9d15-35b64343d813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:46.524198 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42a210-816e-4feb-9d15-35b64343d813 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:46.528036 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d7119-0733-474c-b2f2-05276c4f883e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:46.528692 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d7119-0733-474c-b2f2-05276c4f883e service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:46.528977 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d7119-0733-474c-b2f2-05276c4f883e service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:46.529295 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d7119-0733-474c-b2f2-05276c4f883e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:46.539560 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d7119-0733-474c-b2f2-05276c4f883e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:46.541042 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d7119-0733-474c-b2f2-05276c4f883e service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:46.552535 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1285/2571] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:46.835030 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806995b-e702-4684-8a72-7d300e2dc533 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:46.836666 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-6806995b-e702-4684-8a72-7d300e2dc533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:46.851810 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806995b-e702-4684-8a72-7d300e2dc533 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:46.856864 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17d8c9-bbfa-40e9-a55d-d2a24c4fbe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:46.857718 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17d8c9-bbfa-40e9-a55d-d2a24c4fbe8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:46.858002 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17d8c9-bbfa-40e9-a55d-d2a24c4fbe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:46.858278 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17d8c9-bbfa-40e9-a55d-d2a24c4fbe8b admin admin] PATH_INFO: `/v3/projects/70ee5256a5e84d8aacfc24350d09d31d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:46.859535 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17d8c9-bbfa-40e9-a55d-d2a24c4fbe8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ee5256a5e84d8aacfc24350d09d31d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:46.861436 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17d8c9-bbfa-40e9-a55d-d2a24c4fbe8b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:46.906651 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1f17d8c9-bbfa-40e9-a55d-d2a24c4fbe8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ee5256a5e84d8aacfc24350d09d31d', 'request_id': 'req-1f17d8c9-bbfa-40e9-a55d-d2a24c4fbe8b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:46.913214 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1f17d8c9-bbfa-40e9-a55d-d2a24c4fbe8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ee5256a5e84d8aacfc24350d09d31d', 'request_id': 'req-1f17d8c9-bbfa-40e9-a55d-d2a24c4fbe8b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:46.918681 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1f17d8c9-bbfa-40e9-a55d-d2a24c4fbe8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ee5256a5e84d8aacfc24350d09d31d', 'request_id': 'req-1f17d8c9-bbfa-40e9-a55d-d2a24c4fbe8b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:46.930916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1f17d8c9-bbfa-40e9-a55d-d2a24c4fbe8b admin admin] The token cache is being invalidate because project 70ee5256a5e84d8aacfc24350d09d31d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:46.931209 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1f17d8c9-bbfa-40e9-a55d-d2a24c4fbe8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:46.931872 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1f17d8c9-bbfa-40e9-a55d-d2a24c4fbe8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:46.933410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1287/2572] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:46 2021] DELETE /identity/v3/projects/70ee5256a5e84d8aacfc24350d09d31d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:46.937358 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d7119-0733-474c-b2f2-05276c4f883e service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:46.946827 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d7119-0733-474c-b2f2-05276c4f883e service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:47.000249 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925dfd5-f4eb-4808-b94d-1830cac9644d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:47.001103 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925dfd5-f4eb-4808-b94d-1830cac9644d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:47.001382 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925dfd5-f4eb-4808-b94d-1830cac9644d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:47.001658 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925dfd5-f4eb-4808-b94d-1830cac9644d admin admin] PATH_INFO: `/v3/users/b429647b37e24213a358a540384cad97` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:47.002854 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925dfd5-f4eb-4808-b94d-1830cac9644d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b429647b37e24213a358a540384cad97)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:47.004794 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925dfd5-f4eb-4808-b94d-1830cac9644d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:47.048666 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5925dfd5-f4eb-4808-b94d-1830cac9644d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b429647b37e24213a358a540384cad97'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:47.060418 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5925dfd5-f4eb-4808-b94d-1830cac9644d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b429647b37e24213a358a540384cad97'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:47.061059 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5925dfd5-f4eb-4808-b94d-1830cac9644d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b429647b37e24213a358a540384cad97'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:47.067589 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5925dfd5-f4eb-4808-b94d-1830cac9644d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b429647b37e24213a358a540384cad97'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:47.074264 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5925dfd5-f4eb-4808-b94d-1830cac9644d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b429647b37e24213a358a540384cad97'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:47.080589 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1286/2573] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:08:46 2021] DELETE /identity/v3/users/b429647b37e24213a358a540384cad97 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:47.364199 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17d8c9-bbfa-40e9-a55d-d2a24c4fbe8b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:47.365721 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1f17d8c9-bbfa-40e9-a55d-d2a24c4fbe8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:47.379666 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17d8c9-bbfa-40e9-a55d-d2a24c4fbe8b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:47.463887 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf7c20-2c59-4d62-aaf2-33bca5c61ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:47.464822 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf7c20-2c59-4d62-aaf2-33bca5c61ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:47.465175 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf7c20-2c59-4d62-aaf2-33bca5c61ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:47.465499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf7c20-2c59-4d62-aaf2-33bca5c61ba2 admin admin] PATH_INFO: `/v3/projects/59945356afad4d84b65d29208f464adc` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:47.466620 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf7c20-2c59-4d62-aaf2-33bca5c61ba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59945356afad4d84b65d29208f464adc)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:47.468545 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf7c20-2c59-4d62-aaf2-33bca5c61ba2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:47.513996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e2bf7c20-2c59-4d62-aaf2-33bca5c61ba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59945356afad4d84b65d29208f464adc', 'request_id': 'req-e2bf7c20-2c59-4d62-aaf2-33bca5c61ba2'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:47.520867 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e2bf7c20-2c59-4d62-aaf2-33bca5c61ba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59945356afad4d84b65d29208f464adc', 'request_id': 'req-e2bf7c20-2c59-4d62-aaf2-33bca5c61ba2'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:47.526645 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e2bf7c20-2c59-4d62-aaf2-33bca5c61ba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59945356afad4d84b65d29208f464adc', 'request_id': 'req-e2bf7c20-2c59-4d62-aaf2-33bca5c61ba2'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:47.540138 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e2bf7c20-2c59-4d62-aaf2-33bca5c61ba2 admin admin] The token cache is being invalidate because project 59945356afad4d84b65d29208f464adc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:47.540489 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e2bf7c20-2c59-4d62-aaf2-33bca5c61ba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:47.541078 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e2bf7c20-2c59-4d62-aaf2-33bca5c61ba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:47.543112 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1288/2574] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:47 2021] DELETE /identity/v3/projects/59945356afad4d84b65d29208f464adc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:08:47.547194 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925dfd5-f4eb-4808-b94d-1830cac9644d admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:47.548914 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-5925dfd5-f4eb-4808-b94d-1830cac9644d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:47.562922 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925dfd5-f4eb-4808-b94d-1830cac9644d admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:47.645652 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a059175-42a2-4e86-b47f-34a11fd036f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:47.646333 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a059175-42a2-4e86-b47f-34a11fd036f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:47.646615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a059175-42a2-4e86-b47f-34a11fd036f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:47.646941 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a059175-42a2-4e86-b47f-34a11fd036f3 admin admin] PATH_INFO: `/v3/users/e320413d283547459b8df06e952cebbc` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:47.648242 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a059175-42a2-4e86-b47f-34a11fd036f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e320413d283547459b8df06e952cebbc)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:47.650278 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a059175-42a2-4e86-b47f-34a11fd036f3 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:47.706237 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1a059175-42a2-4e86-b47f-34a11fd036f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e320413d283547459b8df06e952cebbc'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:47.718444 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1a059175-42a2-4e86-b47f-34a11fd036f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e320413d283547459b8df06e952cebbc'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:47.719133 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1a059175-42a2-4e86-b47f-34a11fd036f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e320413d283547459b8df06e952cebbc'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:47.726738 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1a059175-42a2-4e86-b47f-34a11fd036f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e320413d283547459b8df06e952cebbc'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:47.735811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-1a059175-42a2-4e86-b47f-34a11fd036f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e320413d283547459b8df06e952cebbc'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:47.742283 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1287/2575] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:08:47 2021] DELETE /identity/v3/users/e320413d283547459b8df06e952cebbc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:48.018860 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf7c20-2c59-4d62-aaf2-33bca5c61ba2 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:48.020306 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-e2bf7c20-2c59-4d62-aaf2-33bca5c61ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:48.035811 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf7c20-2c59-4d62-aaf2-33bca5c61ba2 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:48.093964 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538aacc5-b31a-45e7-a282-cb673defacc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:48.094817 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538aacc5-b31a-45e7-a282-cb673defacc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:48.095102 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538aacc5-b31a-45e7-a282-cb673defacc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:48.095407 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538aacc5-b31a-45e7-a282-cb673defacc7 admin admin] PATH_INFO: `/v3/projects/27d6082cb396474497d389a563f212b7` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:48.097182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538aacc5-b31a-45e7-a282-cb673defacc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d6082cb396474497d389a563f212b7)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:48.099084 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538aacc5-b31a-45e7-a282-cb673defacc7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:48.142501 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-538aacc5-b31a-45e7-a282-cb673defacc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d6082cb396474497d389a563f212b7', 'request_id': 'req-538aacc5-b31a-45e7-a282-cb673defacc7'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:48.148990 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-538aacc5-b31a-45e7-a282-cb673defacc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d6082cb396474497d389a563f212b7', 'request_id': 'req-538aacc5-b31a-45e7-a282-cb673defacc7'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:48.154172 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-538aacc5-b31a-45e7-a282-cb673defacc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d6082cb396474497d389a563f212b7', 'request_id': 'req-538aacc5-b31a-45e7-a282-cb673defacc7'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:48.166748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-538aacc5-b31a-45e7-a282-cb673defacc7 admin admin] The token cache is being invalidate because project 27d6082cb396474497d389a563f212b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:48.167036 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-538aacc5-b31a-45e7-a282-cb673defacc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:48.167666 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-538aacc5-b31a-45e7-a282-cb673defacc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:48.169186 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1289/2576] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:48 2021] DELETE /identity/v3/projects/27d6082cb396474497d389a563f212b7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:48.175659 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a3e2-8063-4f9e-8e19-7559c57f46de None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:48.175953 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a3e2-8063-4f9e-8e19-7559c57f46de None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:48.176234 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a3e2-8063-4f9e-8e19-7559c57f46de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:48.196556 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-c782a3e2-8063-4f9e-8e19-7559c57f46de None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:48.197744 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c782a3e2-8063-4f9e-8e19-7559c57f46de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:48.255588 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1288/2577] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:48.263803 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d9e7d-ccef-4538-b7fb-ada29503bdfc None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:48.264091 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d9e7d-ccef-4538-b7fb-ada29503bdfc None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:48.264387 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d9e7d-ccef-4538-b7fb-ada29503bdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:48.282007 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-d10d9e7d-ccef-4538-b7fb-ada29503bdfc None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:48.283187 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d10d9e7d-ccef-4538-b7fb-ada29503bdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:48.290923 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1290/2578] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:48.295116 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782a3e2-8063-4f9e-8e19-7559c57f46de None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:48.305246 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782a3e2-8063-4f9e-8e19-7559c57f46de None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:48.309793 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db542c-c7b8-4f0f-b291-bbb7726fc054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:48.310436 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db542c-c7b8-4f0f-b291-bbb7726fc054 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:48.310723 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db542c-c7b8-4f0f-b291-bbb7726fc054 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:48.311000 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db542c-c7b8-4f0f-b291-bbb7726fc054 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:48.311745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db542c-c7b8-4f0f-b291-bbb7726fc054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:08:48.312058 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db542c-c7b8-4f0f-b291-bbb7726fc054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:48.313627 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db542c-c7b8-4f0f-b291-bbb7726fc054 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:48.325349 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1289/2579] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:08:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:08:48.329476 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d9e7d-ccef-4538-b7fb-ada29503bdfc None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:48.338708 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d9e7d-ccef-4538-b7fb-ada29503bdfc None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:48.343348 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90325451-6005-413b-bd06-1a924cf90f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:48.344016 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90325451-6005-413b-bd06-1a924cf90f8d admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:48.344302 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90325451-6005-413b-bd06-1a924cf90f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:48.344579 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90325451-6005-413b-bd06-1a924cf90f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:48.345268 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90325451-6005-413b-bd06-1a924cf90f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:48.347289 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90325451-6005-413b-bd06-1a924cf90f8d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:48.372623 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1291/2580] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:08:48 2021] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:48.376522 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db542c-c7b8-4f0f-b291-bbb7726fc054 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:48.387723 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db542c-c7b8-4f0f-b291-bbb7726fc054 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:48.441148 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb2f86-a88b-4717-a3a6-1389fbe60c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:48.441803 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb2f86-a88b-4717-a3a6-1389fbe60c69 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:48.442085 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb2f86-a88b-4717-a3a6-1389fbe60c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:48.442359 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb2f86-a88b-4717-a3a6-1389fbe60c69 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:48.443041 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb2f86-a88b-4717-a3a6-1389fbe60c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:48.444967 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb2f86-a88b-4717-a3a6-1389fbe60c69 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:48.463899 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1290/2581] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:08:48 2021] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:48.467796 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90325451-6005-413b-bd06-1a924cf90f8d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:48.479088 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90325451-6005-413b-bd06-1a924cf90f8d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:48.484278 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc79e0-1318-4f02-8feb-bfb69c269212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:48.484968 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc79e0-1318-4f02-8feb-bfb69c269212 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:48.485249 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc79e0-1318-4f02-8feb-bfb69c269212 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:48.485523 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc79e0-1318-4f02-8feb-bfb69c269212 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:48.486245 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc79e0-1318-4f02-8feb-bfb69c269212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:48.488595 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc79e0-1318-4f02-8feb-bfb69c269212 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:48.499120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1292/2582] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:48 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:48.504275 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb2f86-a88b-4717-a3a6-1389fbe60c69 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:48.516627 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb2f86-a88b-4717-a3a6-1389fbe60c69 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:48.524170 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff084401-9b7c-4d26-9d25-2080d05479c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:48.525222 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff084401-9b7c-4d26-9d25-2080d05479c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:48.525901 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff084401-9b7c-4d26-9d25-2080d05479c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:48.526282 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff084401-9b7c-4d26-9d25-2080d05479c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:48.527150 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff084401-9b7c-4d26-9d25-2080d05479c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:48.528940 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff084401-9b7c-4d26-9d25-2080d05479c9 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:48.540411 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1291/2583] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:48 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:08:48.543543 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc79e0-1318-4f02-8feb-bfb69c269212 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:48.554587 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc79e0-1318-4f02-8feb-bfb69c269212 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:48.559262 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03b97d-24f3-4d2c-b3d6-2115974af977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:48.560167 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03b97d-24f3-4d2c-b3d6-2115974af977 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:48.560450 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03b97d-24f3-4d2c-b3d6-2115974af977 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:48.560727 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03b97d-24f3-4d2c-b3d6-2115974af977 admin admin] PATH_INFO: `/v3/projects/9f05f60fdf724db6b67661af1a59e887/users/4942dd1502a94dc2acdf8906c2263d17/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:48.579089 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03b97d-24f3-4d2c-b3d6-2115974af977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f05f60fdf724db6b67661af1a59e887, user_id=4942dd1502a94dc2acdf8906c2263d17, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:48.582553 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03b97d-24f3-4d2c-b3d6-2115974af977 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:48.597310 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1293/2584] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:48 2021] PUT /identity/v3/projects/9f05f60fdf724db6b67661af1a59e887/users/4942dd1502a94dc2acdf8906c2263d17/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:48.607063 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ecf1b-a1cc-4d01-a99f-dee18bf076cd None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:48.607582 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ecf1b-a1cc-4d01-a99f-dee18bf076cd None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:48.607683 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ecf1b-a1cc-4d01-a99f-dee18bf076cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:48.634322 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-4e5ecf1b-a1cc-4d01-a99f-dee18bf076cd None None] MFA Rules not processed for user `4942dd1502a94dc2acdf8906c2263d17`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:48.635475 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-4e5ecf1b-a1cc-4d01-a99f-dee18bf076cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:48.700377 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1292/2585] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:48 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:48.710685 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03b97d-24f3-4d2c-b3d6-2115974af977 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:48.712545 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0c03b97d-24f3-4d2c-b3d6-2115974af977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:48.767123 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03b97d-24f3-4d2c-b3d6-2115974af977 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:48.770892 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68919c3-1e93-4a82-b9c1-edb649ce4a48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:48.771562 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68919c3-1e93-4a82-b9c1-edb649ce4a48 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:48.771843 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68919c3-1e93-4a82-b9c1-edb649ce4a48 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:48.772115 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68919c3-1e93-4a82-b9c1-edb649ce4a48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:48.780334 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68919c3-1e93-4a82-b9c1-edb649ce4a48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:48.781740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68919c3-1e93-4a82-b9c1-edb649ce4a48 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:48.790803 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1294/2586] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:48 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:08:52.245267 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe99294-f6e2-4563-a8cc-f9aae4b7ae2d None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:52.245798 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe99294-f6e2-4563-a8cc-f9aae4b7ae2d None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:52.245898 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe99294-f6e2-4563-a8cc-f9aae4b7ae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:52.264159 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-ebe99294-f6e2-4563-a8cc-f9aae4b7ae2d None None] MFA Rules not processed for user `4942dd1502a94dc2acdf8906c2263d17`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:52.265482 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ebe99294-f6e2-4563-a8cc-f9aae4b7ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:52.272595 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1293/2587] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:52 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:56.543947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68919c3-1e93-4a82-b9c1-edb649ce4a48 service cinder] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:56.546580 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d68919c3-1e93-4a82-b9c1-edb649ce4a48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:56.658392 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68919c3-1e93-4a82-b9c1-edb649ce4a48 service cinder] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:56.667271 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf49d4c-58e8-4ccd-9ce2-6870b4ac2879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:56.668746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf49d4c-58e8-4ccd-9ce2-6870b4ac2879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:56.669222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf49d4c-58e8-4ccd-9ce2-6870b4ac2879 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:56.670032 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf49d4c-58e8-4ccd-9ce2-6870b4ac2879 admin admin] PATH_INFO: `/v3/users/7eee81acd75d4f888f9cd83e3584e105` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:56.671574 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf49d4c-58e8-4ccd-9ce2-6870b4ac2879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eee81acd75d4f888f9cd83e3584e105)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:56.674367 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf49d4c-58e8-4ccd-9ce2-6870b4ac2879 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:56.758342 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-cdf49d4c-58e8-4ccd-9ce2-6870b4ac2879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eee81acd75d4f888f9cd83e3584e105'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:56.759331 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-cdf49d4c-58e8-4ccd-9ce2-6870b4ac2879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eee81acd75d4f888f9cd83e3584e105'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:56.760623 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-cdf49d4c-58e8-4ccd-9ce2-6870b4ac2879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eee81acd75d4f888f9cd83e3584e105'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:56.802218 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-cdf49d4c-58e8-4ccd-9ce2-6870b4ac2879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eee81acd75d4f888f9cd83e3584e105'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:56.812768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-cdf49d4c-58e8-4ccd-9ce2-6870b4ac2879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eee81acd75d4f888f9cd83e3584e105'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:56.835043 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1295/2588] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:08:56 2021] DELETE /identity/v3/users/7eee81acd75d4f888f9cd83e3584e105 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:56.840311 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6011241-f439-4a70-9c1e-e2f1d78df6a0 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:56.840967 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6011241-f439-4a70-9c1e-e2f1d78df6a0 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:56.840967 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6011241-f439-4a70-9c1e-e2f1d78df6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:56.883982 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-b6011241-f439-4a70-9c1e-e2f1d78df6a0 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:56.887582 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b6011241-f439-4a70-9c1e-e2f1d78df6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:57.028615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1294/2589] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:57.044453 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf49d4c-58e8-4ccd-9ce2-6870b4ac2879 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:57.052499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-cdf49d4c-58e8-4ccd-9ce2-6870b4ac2879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:57.157151 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf49d4c-58e8-4ccd-9ce2-6870b4ac2879 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:57.171736 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd07d8-412a-41a6-8c97-8d714ac4e18f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:57.172677 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd07d8-412a-41a6-8c97-8d714ac4e18f service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:57.173206 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd07d8-412a-41a6-8c97-8d714ac4e18f service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:57.173855 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd07d8-412a-41a6-8c97-8d714ac4e18f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:57.187890 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd07d8-412a-41a6-8c97-8d714ac4e18f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:57.189677 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd07d8-412a-41a6-8c97-8d714ac4e18f service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:57.208526 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1296/2590] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:57.501248 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6011241-f439-4a70-9c1e-e2f1d78df6a0 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:57.502793 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b6011241-f439-4a70-9c1e-e2f1d78df6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:57.515782 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6011241-f439-4a70-9c1e-e2f1d78df6a0 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:57.520788 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3186580-3c7c-4144-91d0-744053b19571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:57.521676 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3186580-3c7c-4144-91d0-744053b19571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:57.529719 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3186580-3c7c-4144-91d0-744053b19571 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:57.530447 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3186580-3c7c-4144-91d0-744053b19571 admin admin] PATH_INFO: `/v3/users/0205de7c01fb4cedb6f011e067f3f6e1` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:57.532340 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3186580-3c7c-4144-91d0-744053b19571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0205de7c01fb4cedb6f011e067f3f6e1)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:57.535335 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3186580-3c7c-4144-91d0-744053b19571 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:57.593568 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c3186580-3c7c-4144-91d0-744053b19571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0205de7c01fb4cedb6f011e067f3f6e1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:57.606487 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c3186580-3c7c-4144-91d0-744053b19571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0205de7c01fb4cedb6f011e067f3f6e1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:57.607459 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c3186580-3c7c-4144-91d0-744053b19571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0205de7c01fb4cedb6f011e067f3f6e1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:57.615549 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c3186580-3c7c-4144-91d0-744053b19571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0205de7c01fb4cedb6f011e067f3f6e1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:57.636455 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c3186580-3c7c-4144-91d0-744053b19571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0205de7c01fb4cedb6f011e067f3f6e1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:57.649224 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1295/2591] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:08:57 2021] DELETE /identity/v3/users/0205de7c01fb4cedb6f011e067f3f6e1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:57.813219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd07d8-412a-41a6-8c97-8d714ac4e18f service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:57.816327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-26dd07d8-412a-41a6-8c97-8d714ac4e18f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:57.833596 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3186580-3c7c-4144-91d0-744053b19571 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:57.835831 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c3186580-3c7c-4144-91d0-744053b19571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:57.859349 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd07d8-412a-41a6-8c97-8d714ac4e18f service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:57.917135 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3186580-3c7c-4144-91d0-744053b19571 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:57.938616 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4562ffc-be22-4bdc-a4e2-b3b6c763bde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:57.942606 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4562ffc-be22-4bdc-a4e2-b3b6c763bde1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:57.943431 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4562ffc-be22-4bdc-a4e2-b3b6c763bde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:57.943791 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4562ffc-be22-4bdc-a4e2-b3b6c763bde1 admin admin] PATH_INFO: `/v3/projects/45ebbc4412954ac0bd108487cfb87f1f` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:57.946107 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4562ffc-be22-4bdc-a4e2-b3b6c763bde1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45ebbc4412954ac0bd108487cfb87f1f)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:57.949492 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4562ffc-be22-4bdc-a4e2-b3b6c763bde1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:57.967103 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be14e6-ac95-49af-b85c-b8d6c5c7901e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:57.968956 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be14e6-ac95-49af-b85c-b8d6c5c7901e service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:57.970174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be14e6-ac95-49af-b85c-b8d6c5c7901e service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:57.970548 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be14e6-ac95-49af-b85c-b8d6c5c7901e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:57.976277 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-65be14e6-ac95-49af-b85c-b8d6c5c7901e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:58.016703 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d4562ffc-be22-4bdc-a4e2-b3b6c763bde1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45ebbc4412954ac0bd108487cfb87f1f', 'request_id': 'req-d4562ffc-be22-4bdc-a4e2-b3b6c763bde1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:58.037913 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d4562ffc-be22-4bdc-a4e2-b3b6c763bde1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45ebbc4412954ac0bd108487cfb87f1f', 'request_id': 'req-d4562ffc-be22-4bdc-a4e2-b3b6c763bde1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:58.048174 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d4562ffc-be22-4bdc-a4e2-b3b6c763bde1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45ebbc4412954ac0bd108487cfb87f1f', 'request_id': 'req-d4562ffc-be22-4bdc-a4e2-b3b6c763bde1'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:58.062413 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d4562ffc-be22-4bdc-a4e2-b3b6c763bde1 admin admin] The token cache is being invalidate because project 45ebbc4412954ac0bd108487cfb87f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:58.063025 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d4562ffc-be22-4bdc-a4e2-b3b6c763bde1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:58.063927 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d4562ffc-be22-4bdc-a4e2-b3b6c763bde1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:58.067107 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1296/2592] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:57 2021] DELETE /identity/v3/projects/45ebbc4412954ac0bd108487cfb87f1f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:58.068350 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4562ffc-be22-4bdc-a4e2-b3b6c763bde1 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:58.069977 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-d4562ffc-be22-4bdc-a4e2-b3b6c763bde1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:58.094849 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be14e6-ac95-49af-b85c-b8d6c5c7901e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:58.096500 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be14e6-ac95-49af-b85c-b8d6c5c7901e service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:58.113244 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1297/2593] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:57 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:58.115233 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931efacb-5c8c-41d6-87f0-07f546908119 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:58.115593 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931efacb-5c8c-41d6-87f0-07f546908119 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:58.115824 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931efacb-5c8c-41d6-87f0-07f546908119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:58.145360 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-931efacb-5c8c-41d6-87f0-07f546908119 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:58.147393 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-931efacb-5c8c-41d6-87f0-07f546908119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:58.168315 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4562ffc-be22-4bdc-a4e2-b3b6c763bde1 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:58.175204 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee1972-a0e5-4918-8cf1-d51a0194f5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:58.176683 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee1972-a0e5-4918-8cf1-d51a0194f5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:58.177086 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee1972-a0e5-4918-8cf1-d51a0194f5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:58.177432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee1972-a0e5-4918-8cf1-d51a0194f5e8 admin admin] PATH_INFO: `/v3/projects/8e39e80825e64d5e9390f9fae29c38cc` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:58.178819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee1972-a0e5-4918-8cf1-d51a0194f5e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e39e80825e64d5e9390f9fae29c38cc)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:58.181086 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee1972-a0e5-4918-8cf1-d51a0194f5e8 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:58.242989 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1298/2594] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:58.251093 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-65ee1972-a0e5-4918-8cf1-d51a0194f5e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e39e80825e64d5e9390f9fae29c38cc', 'request_id': 'req-65ee1972-a0e5-4918-8cf1-d51a0194f5e8'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:58.251269 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ad4db-a95c-42b8-8ca3-b27197919a39 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:58.251708 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ad4db-a95c-42b8-8ca3-b27197919a39 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:58.252015 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ad4db-a95c-42b8-8ca3-b27197919a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:58.258048 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-65ee1972-a0e5-4918-8cf1-d51a0194f5e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e39e80825e64d5e9390f9fae29c38cc', 'request_id': 'req-65ee1972-a0e5-4918-8cf1-d51a0194f5e8'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:58.264735 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-65ee1972-a0e5-4918-8cf1-d51a0194f5e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e39e80825e64d5e9390f9fae29c38cc', 'request_id': 'req-65ee1972-a0e5-4918-8cf1-d51a0194f5e8'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:58.271087 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-177ad4db-a95c-42b8-8ca3-b27197919a39 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:58.272344 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-177ad4db-a95c-42b8-8ca3-b27197919a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:58.276995 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-65ee1972-a0e5-4918-8cf1-d51a0194f5e8 admin admin] The token cache is being invalidate because project 8e39e80825e64d5e9390f9fae29c38cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:08:58.277292 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-65ee1972-a0e5-4918-8cf1-d51a0194f5e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:58.277966 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-65ee1972-a0e5-4918-8cf1-d51a0194f5e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:08:58.279852 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1297/2595] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:08:58 2021] DELETE /identity/v3/projects/8e39e80825e64d5e9390f9fae29c38cc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:58.285958 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4b13d-f13f-4a21-86ea-caf3e5377fb5 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:58.286239 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4b13d-f13f-4a21-86ea-caf3e5377fb5 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:58.286522 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4b13d-f13f-4a21-86ea-caf3e5377fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:58.309556 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-6ce4b13d-f13f-4a21-86ea-caf3e5377fb5 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:58.311342 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-6ce4b13d-f13f-4a21-86ea-caf3e5377fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:58.367852 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1299/2596] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:08:58.371017 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ad4db-a95c-42b8-8ca3-b27197919a39 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:58.390575 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ad4db-a95c-42b8-8ca3-b27197919a39 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:58.399967 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4d816-16a2-46c0-ad1d-55320dbfe11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:58.400681 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4d816-16a2-46c0-ad1d-55320dbfe11d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:58.401086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4d816-16a2-46c0-ad1d-55320dbfe11d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:58.401238 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4d816-16a2-46c0-ad1d-55320dbfe11d admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:58.402416 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4d816-16a2-46c0-ad1d-55320dbfe11d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:08:58.402727 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4d816-16a2-46c0-ad1d-55320dbfe11d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:58.404378 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4d816-16a2-46c0-ad1d-55320dbfe11d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:58.418322 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1298/2597] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:08:58.422104 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1300/2598] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:08:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:08:58.432768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4d816-16a2-46c0-ad1d-55320dbfe11d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:58.433310 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ff837-d4b3-4a9f-8df9-5e3da35dc94b None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:58.433768 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ff837-d4b3-4a9f-8df9-5e3da35dc94b None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:58.434369 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ff837-d4b3-4a9f-8df9-5e3da35dc94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:58.450196 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4d816-16a2-46c0-ad1d-55320dbfe11d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:58.471963 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5834e89-3c88-4828-bacc-feda48ca4aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:58.474915 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5834e89-3c88-4828-bacc-feda48ca4aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:58.475461 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5834e89-3c88-4828-bacc-feda48ca4aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:58.476291 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-827ff837-d4b3-4a9f-8df9-5e3da35dc94b None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:58.477093 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5834e89-3c88-4828-bacc-feda48ca4aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:58.477801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-827ff837-d4b3-4a9f-8df9-5e3da35dc94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:58.479020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5834e89-3c88-4828-bacc-feda48ca4aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:58.484867 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5834e89-3c88-4828-bacc-feda48ca4aa6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:58.507036 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1299/2599] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:58.508646 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ff837-d4b3-4a9f-8df9-5e3da35dc94b None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:58.523164 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ff837-d4b3-4a9f-8df9-5e3da35dc94b None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:58.540822 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55c6be-5ec8-4255-9488-ece9b7a78a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:58.541503 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55c6be-5ec8-4255-9488-ece9b7a78a0e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:58.541789 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55c6be-5ec8-4255-9488-ece9b7a78a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:58.542065 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55c6be-5ec8-4255-9488-ece9b7a78a0e admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:58.542798 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55c6be-5ec8-4255-9488-ece9b7a78a0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:08:58.543112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55c6be-5ec8-4255-9488-ece9b7a78a0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:58.544757 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55c6be-5ec8-4255-9488-ece9b7a78a0e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:58.547039 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1301/2600] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:08:58 2021] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:58.551723 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5834e89-3c88-4828-bacc-feda48ca4aa6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:58.565885 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1300/2601] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:08:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:08:58.570653 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55c6be-5ec8-4255-9488-ece9b7a78a0e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:58.581385 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55c6be-5ec8-4255-9488-ece9b7a78a0e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:58.672866 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e62dc-0b0a-420a-bacf-75a9b8b89f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:58.673850 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e62dc-0b0a-420a-bacf-75a9b8b89f61 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:58.674751 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e62dc-0b0a-420a-bacf-75a9b8b89f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:58.675101 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e62dc-0b0a-420a-bacf-75a9b8b89f61 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:58.679767 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e62dc-0b0a-420a-bacf-75a9b8b89f61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:58.684383 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e62dc-0b0a-420a-bacf-75a9b8b89f61 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:58.700988 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5834e89-3c88-4828-bacc-feda48ca4aa6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:58.741899 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93466f0f-b40b-4f06-a46e-5a454e3f69fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:58.743462 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93466f0f-b40b-4f06-a46e-5a454e3f69fa admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:58.744248 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93466f0f-b40b-4f06-a46e-5a454e3f69fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:58.744248 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93466f0f-b40b-4f06-a46e-5a454e3f69fa admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:58.744488 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1301/2602] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:08:58 2021] POST /identity/v3/projects => generated 399 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:58.745129 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93466f0f-b40b-4f06-a46e-5a454e3f69fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:58.747655 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93466f0f-b40b-4f06-a46e-5a454e3f69fa admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:58.749959 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e62dc-0b0a-420a-bacf-75a9b8b89f61 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:58.777011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1302/2603] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:08:58 2021] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:08:58.780974 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93466f0f-b40b-4f06-a46e-5a454e3f69fa admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:58.797793 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93466f0f-b40b-4f06-a46e-5a454e3f69fa admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:58.857321 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e62dc-0b0a-420a-bacf-75a9b8b89f61 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:58.863987 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a3536-c6be-41b1-9256-8211b14f1254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:58.864481 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a3536-c6be-41b1-9256-8211b14f1254 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:58.864825 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a3536-c6be-41b1-9256-8211b14f1254 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:58.864940 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a3536-c6be-41b1-9256-8211b14f1254 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:58.865867 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a3536-c6be-41b1-9256-8211b14f1254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:58.867855 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a3536-c6be-41b1-9256-8211b14f1254 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:58.884736 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13a9de-bcde-4c6f-9f6f-1589d7d1d279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:58.885425 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13a9de-bcde-4c6f-9f6f-1589d7d1d279 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:58.885736 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13a9de-bcde-4c6f-9f6f-1589d7d1d279 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:58.886010 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13a9de-bcde-4c6f-9f6f-1589d7d1d279 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:58.886775 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13a9de-bcde-4c6f-9f6f-1589d7d1d279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:58.888871 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13a9de-bcde-4c6f-9f6f-1589d7d1d279 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:58.898330 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1302/2604] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:08:58 2021] POST /identity/v3/users => generated 300 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:08:58.903409 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1303/2605] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:58 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:58.904569 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a3536-c6be-41b1-9256-8211b14f1254 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:58.905994 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13a9de-bcde-4c6f-9f6f-1589d7d1d279 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:58.919779 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13a9de-bcde-4c6f-9f6f-1589d7d1d279 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:58.919985 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a3536-c6be-41b1-9256-8211b14f1254 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:58.926506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104551cb-5761-419c-bf71-ea15ca37cf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:58.927173 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104551cb-5761-419c-bf71-ea15ca37cf19 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:58.927527 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104551cb-5761-419c-bf71-ea15ca37cf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:58.927802 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104551cb-5761-419c-bf71-ea15ca37cf19 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:58.929313 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104551cb-5761-419c-bf71-ea15ca37cf19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:58.931069 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104551cb-5761-419c-bf71-ea15ca37cf19 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:58.935449 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079041ec-3568-4216-bd2d-e2349fe65c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:58.936425 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079041ec-3568-4216-bd2d-e2349fe65c02 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:58.936928 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079041ec-3568-4216-bd2d-e2349fe65c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:58.937998 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079041ec-3568-4216-bd2d-e2349fe65c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:58.938841 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079041ec-3568-4216-bd2d-e2349fe65c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:58.941427 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079041ec-3568-4216-bd2d-e2349fe65c02 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:58.942746 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1303/2606] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:58 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:58.946432 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104551cb-5761-419c-bf71-ea15ca37cf19 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:58.961056 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1304/2607] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:58 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:08:58.961056 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079041ec-3568-4216-bd2d-e2349fe65c02 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:58.963752 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104551cb-5761-419c-bf71-ea15ca37cf19 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:58.973220 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0d396-c83e-40af-8737-a3a09d83b600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:58.973978 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0d396-c83e-40af-8737-a3a09d83b600 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:58.974332 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0d396-c83e-40af-8737-a3a09d83b600 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:58.974658 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079041ec-3568-4216-bd2d-e2349fe65c02 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:58.974786 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0d396-c83e-40af-8737-a3a09d83b600 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:58.976171 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0d396-c83e-40af-8737-a3a09d83b600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:58.977263 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0d396-c83e-40af-8737-a3a09d83b600 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:58.980298 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160f18e-0bfd-43c8-bf26-86b0abec6ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:58.981360 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160f18e-0bfd-43c8-bf26-86b0abec6ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:58.981738 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160f18e-0bfd-43c8-bf26-86b0abec6ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:58.982081 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160f18e-0bfd-43c8-bf26-86b0abec6ecd admin admin] PATH_INFO: `/v3/projects/908d7786d5844cb085daf849e887df73/users/8ebf3bf6427b46bcad98b495777e1427/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:58.990509 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1304/2608] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:08:58 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:08:58.991664 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0d396-c83e-40af-8737-a3a09d83b600 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:58.995024 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f4e0d396-c83e-40af-8737-a3a09d83b600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:58.999009 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160f18e-0bfd-43c8-bf26-86b0abec6ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=908d7786d5844cb085daf849e887df73, user_id=8ebf3bf6427b46bcad98b495777e1427, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:59.002176 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160f18e-0bfd-43c8-bf26-86b0abec6ecd admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:59.020111 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1305/2609] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:58 2021] PUT /identity/v3/projects/908d7786d5844cb085daf849e887df73/users/8ebf3bf6427b46bcad98b495777e1427/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:08:59.022892 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160f18e-0bfd-43c8-bf26-86b0abec6ecd admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:59.081009 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0d396-c83e-40af-8737-a3a09d83b600 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:59.141660 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160f18e-0bfd-43c8-bf26-86b0abec6ecd admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:59.147451 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078b376-73ef-45f6-b8c1-13f4adede484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:59.147746 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b30c16-ebab-4c2a-8444-550685f96c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:59.148945 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b30c16-ebab-4c2a-8444-550685f96c9c service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:59.149230 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b30c16-ebab-4c2a-8444-550685f96c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:59.149360 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078b376-73ef-45f6-b8c1-13f4adede484 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:59.149548 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b30c16-ebab-4c2a-8444-550685f96c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:59.149655 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078b376-73ef-45f6-b8c1-13f4adede484 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:59.149824 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078b376-73ef-45f6-b8c1-13f4adede484 admin admin] PATH_INFO: `/v3/projects/32a4160101984f6c99bd7d3628e53b86/users/31bd1451245a4efe8e52973c7d35e607/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:59.152648 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a8b30c16-ebab-4c2a-8444-550685f96c9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:59.166152 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078b376-73ef-45f6-b8c1-13f4adede484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a4160101984f6c99bd7d3628e53b86, user_id=31bd1451245a4efe8e52973c7d35e607, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:59.168828 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078b376-73ef-45f6-b8c1-13f4adede484 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:59.186933 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1306/2610] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:08:59 2021] PUT /identity/v3/projects/32a4160101984f6c99bd7d3628e53b86/users/31bd1451245a4efe8e52973c7d35e607/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:08:59.188489 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9da9f-a715-4e54-8832-5119e1efbe31 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:59.188702 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9da9f-a715-4e54-8832-5119e1efbe31 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:59.188971 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9da9f-a715-4e54-8832-5119e1efbe31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:59.222935 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-5cd9da9f-a715-4e54-8832-5119e1efbe31 None None] MFA Rules not processed for user `8ebf3bf6427b46bcad98b495777e1427`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:59.224179 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-5cd9da9f-a715-4e54-8832-5119e1efbe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:59.231291 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b30c16-ebab-4c2a-8444-550685f96c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:59.233170 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b30c16-ebab-4c2a-8444-550685f96c9c service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:59.246572 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1305/2611] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:58 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:59.248479 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f6533-8965-4d3c-97b0-e0fdc4328c3f None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:59.248871 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f6533-8965-4d3c-97b0-e0fdc4328c3f None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:59.249457 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f6533-8965-4d3c-97b0-e0fdc4328c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:59.278354 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-f34f6533-8965-4d3c-97b0-e0fdc4328c3f None None] MFA Rules not processed for user `31bd1451245a4efe8e52973c7d35e607`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:08:59.279746 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f34f6533-8965-4d3c-97b0-e0fdc4328c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:59.321015 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1307/2612] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:59 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:59.322293 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9da9f-a715-4e54-8832-5119e1efbe31 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:59.326603 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-5cd9da9f-a715-4e54-8832-5119e1efbe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:59.376966 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1306/2613] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:08:59 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:08:59.378204 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f6533-8965-4d3c-97b0-e0fdc4328c3f None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:59.379729 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f34f6533-8965-4d3c-97b0-e0fdc4328c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:59.419441 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9da9f-a715-4e54-8832-5119e1efbe31 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:59.426340 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e5c40-0931-4dd5-9e3b-072c57c83bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:59.427318 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e5c40-0931-4dd5-9e3b-072c57c83bbe service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:59.427566 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e5c40-0931-4dd5-9e3b-072c57c83bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:59.427960 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e5c40-0931-4dd5-9e3b-072c57c83bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:59.430003 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-e84e5c40-0931-4dd5-9e3b-072c57c83bbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:59.458435 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f6533-8965-4d3c-97b0-e0fdc4328c3f None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:59.462924 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05cf37-2c75-4acf-bd61-15b5338c9b12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:59.463612 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05cf37-2c75-4acf-bd61-15b5338c9b12 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:59.463898 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05cf37-2c75-4acf-bd61-15b5338c9b12 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:59.464173 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05cf37-2c75-4acf-bd61-15b5338c9b12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:59.485224 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05cf37-2c75-4acf-bd61-15b5338c9b12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:59.486826 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05cf37-2c75-4acf-bd61-15b5338c9b12 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:59.498895 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1307/2614] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:59 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:59.499898 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05cf37-2c75-4acf-bd61-15b5338c9b12 service cinder] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:08:59.501390 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-fb05cf37-2c75-4acf-bd61-15b5338c9b12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:08:59.515088 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05cf37-2c75-4acf-bd61-15b5338c9b12 service cinder] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:08:59.522627 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1872a-8cdf-4012-bccc-d2222ccf33f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:08:59.523337 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1872a-8cdf-4012-bccc-d2222ccf33f7 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:08:59.523985 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1872a-8cdf-4012-bccc-d2222ccf33f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:08:59.524268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1872a-8cdf-4012-bccc-d2222ccf33f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:08:59.531772 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e5c40-0931-4dd5-9e3b-072c57c83bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:59.536125 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e5c40-0931-4dd5-9e3b-072c57c83bbe service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:59.536543 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1872a-8cdf-4012-bccc-d2222ccf33f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:08:59.538072 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1872a-8cdf-4012-bccc-d2222ccf33f7 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:08:59.549150 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1308/2615] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:59 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:08:59.574181 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1308/2616] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:08:59 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:09:00.078333 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2080b1-43f8-483a-9244-1ed3fede9af3 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:00.078905 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2080b1-43f8-483a-9244-1ed3fede9af3 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:00.079352 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2080b1-43f8-483a-9244-1ed3fede9af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:00.108012 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-3c2080b1-43f8-483a-9244-1ed3fede9af3 None None] MFA Rules not processed for user `562353a14c284dcda0f7fdba85a418ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:09:00.108012 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-3c2080b1-43f8-483a-9244-1ed3fede9af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:00.187397 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1309/2617] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:09:00 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:09:01.076761 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e5c40-0931-4dd5-9e3b-072c57c83bbe service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:01.090239 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e5c40-0931-4dd5-9e3b-072c57c83bbe service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:01.093984 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc89ca-fd58-4de2-9fc5-a2b244af603f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:01.094625 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc89ca-fd58-4de2-9fc5-a2b244af603f service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:01.094910 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc89ca-fd58-4de2-9fc5-a2b244af603f service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:01.095187 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc89ca-fd58-4de2-9fc5-a2b244af603f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:01.097038 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c3dc89ca-fd58-4de2-9fc5-a2b244af603f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:01.107021 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc89ca-fd58-4de2-9fc5-a2b244af603f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:01.108713 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc89ca-fd58-4de2-9fc5-a2b244af603f service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:01.121752 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1309/2618] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:09:01 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:09:07.860757 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2080b1-43f8-483a-9244-1ed3fede9af3 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:07.975976 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2080b1-43f8-483a-9244-1ed3fede9af3 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:07.981236 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1b6f8-036f-44bd-a0d5-77bd429376cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:07.982310 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1b6f8-036f-44bd-a0d5-77bd429376cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:07.982689 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1b6f8-036f-44bd-a0d5-77bd429376cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:07.983064 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1b6f8-036f-44bd-a0d5-77bd429376cb admin admin] PATH_INFO: `/v3/users/31bd1451245a4efe8e52973c7d35e607` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:07.984439 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1b6f8-036f-44bd-a0d5-77bd429376cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=31bd1451245a4efe8e52973c7d35e607)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:07.986520 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1b6f8-036f-44bd-a0d5-77bd429376cb admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:08.045206 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b7f1b6f8-036f-44bd-a0d5-77bd429376cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31bd1451245a4efe8e52973c7d35e607'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:08.061840 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b7f1b6f8-036f-44bd-a0d5-77bd429376cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31bd1451245a4efe8e52973c7d35e607'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:08.062576 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b7f1b6f8-036f-44bd-a0d5-77bd429376cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31bd1451245a4efe8e52973c7d35e607'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:08.069886 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b7f1b6f8-036f-44bd-a0d5-77bd429376cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31bd1451245a4efe8e52973c7d35e607'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:08.077270 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b7f1b6f8-036f-44bd-a0d5-77bd429376cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31bd1451245a4efe8e52973c7d35e607'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:08.083523 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1310/2619] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:09:07 2021] DELETE /identity/v3/users/31bd1451245a4efe8e52973c7d35e607 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:09:08.087928 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073e305-d092-4fbb-bb70-e7fc64564aac None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:08.088391 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073e305-d092-4fbb-bb70-e7fc64564aac None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:08.088605 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073e305-d092-4fbb-bb70-e7fc64564aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:08.107137 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-4073e305-d092-4fbb-bb70-e7fc64564aac None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:09:08.108298 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-4073e305-d092-4fbb-bb70-e7fc64564aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:08.168482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1310/2620] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:09:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:09:08.180789 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1b6f8-036f-44bd-a0d5-77bd429376cb admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:08.182180 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b7f1b6f8-036f-44bd-a0d5-77bd429376cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:08.239268 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1b6f8-036f-44bd-a0d5-77bd429376cb admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:08.242936 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bc128-86c2-4e99-8d44-d14b2bee4f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:08.243600 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bc128-86c2-4e99-8d44-d14b2bee4f5f service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:08.243882 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bc128-86c2-4e99-8d44-d14b2bee4f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:08.244152 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bc128-86c2-4e99-8d44-d14b2bee4f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:08.253974 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bc128-86c2-4e99-8d44-d14b2bee4f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:08.255449 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bc128-86c2-4e99-8d44-d14b2bee4f5f service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:08.265691 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1311/2621] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:09:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:09:08.684477 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073e305-d092-4fbb-bb70-e7fc64564aac None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:08.686145 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-4073e305-d092-4fbb-bb70-e7fc64564aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:08.716845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073e305-d092-4fbb-bb70-e7fc64564aac None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:08.716845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b135369-a7fb-4caf-9687-9570d00bff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:08.716845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b135369-a7fb-4caf-9687-9570d00bff40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:08.716845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b135369-a7fb-4caf-9687-9570d00bff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:08.717640 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b135369-a7fb-4caf-9687-9570d00bff40 admin admin] PATH_INFO: `/v3/projects/32a4160101984f6c99bd7d3628e53b86` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:08.717640 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b135369-a7fb-4caf-9687-9570d00bff40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a4160101984f6c99bd7d3628e53b86)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:08.717640 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b135369-a7fb-4caf-9687-9570d00bff40 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:08.763512 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8b135369-a7fb-4caf-9687-9570d00bff40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a4160101984f6c99bd7d3628e53b86', 'request_id': 'req-8b135369-a7fb-4caf-9687-9570d00bff40'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:08.770091 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8b135369-a7fb-4caf-9687-9570d00bff40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a4160101984f6c99bd7d3628e53b86', 'request_id': 'req-8b135369-a7fb-4caf-9687-9570d00bff40'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:08.775515 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8b135369-a7fb-4caf-9687-9570d00bff40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a4160101984f6c99bd7d3628e53b86', 'request_id': 'req-8b135369-a7fb-4caf-9687-9570d00bff40'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:08.788471 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8b135369-a7fb-4caf-9687-9570d00bff40 admin admin] The token cache is being invalidate because project 32a4160101984f6c99bd7d3628e53b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:09:08.788761 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8b135369-a7fb-4caf-9687-9570d00bff40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:08.789383 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8b135369-a7fb-4caf-9687-9570d00bff40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:08.791156 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1311/2622] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:09:08 2021] DELETE /identity/v3/projects/32a4160101984f6c99bd7d3628e53b86 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:09:08.796788 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70f428-6678-482d-ba7c-595beb7269d0 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:08.797080 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70f428-6678-482d-ba7c-595beb7269d0 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:08.797358 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70f428-6678-482d-ba7c-595beb7269d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:08.817944 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-de70f428-6678-482d-ba7c-595beb7269d0 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:09:08.819408 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-de70f428-6678-482d-ba7c-595beb7269d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:08.878510 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1312/2623] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:09:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:09:08.886404 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fec5a5-9a60-437b-8ba7-11e60edda232 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:08.886766 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fec5a5-9a60-437b-8ba7-11e60edda232 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:08.887119 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fec5a5-9a60-437b-8ba7-11e60edda232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:08.906453 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-a7fec5a5-9a60-437b-8ba7-11e60edda232 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:09:08.907626 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a7fec5a5-9a60-437b-8ba7-11e60edda232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:08.916282 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1312/2624] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:09:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:09:08.920724 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70f428-6678-482d-ba7c-595beb7269d0 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:08.931761 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70f428-6678-482d-ba7c-595beb7269d0 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:08.936577 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffaf847-e69e-46b5-854e-df6d42a7b45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:08.937302 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffaf847-e69e-46b5-854e-df6d42a7b45f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:08.937590 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffaf847-e69e-46b5-854e-df6d42a7b45f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:08.937860 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffaf847-e69e-46b5-854e-df6d42a7b45f admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:08.938580 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffaf847-e69e-46b5-854e-df6d42a7b45f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:09:08.938883 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffaf847-e69e-46b5-854e-df6d42a7b45f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:08.940906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffaf847-e69e-46b5-854e-df6d42a7b45f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:08.957287 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1313/2625] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:09:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:09:08.958792 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fec5a5-9a60-437b-8ba7-11e60edda232 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:08.968574 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fec5a5-9a60-437b-8ba7-11e60edda232 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:08.974307 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daee1eb-558f-40ec-8c87-1e86cc8c904f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:08.975040 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daee1eb-558f-40ec-8c87-1e86cc8c904f admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:08.975319 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daee1eb-558f-40ec-8c87-1e86cc8c904f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:08.975631 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daee1eb-558f-40ec-8c87-1e86cc8c904f admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:08.976330 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daee1eb-558f-40ec-8c87-1e86cc8c904f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:08.978236 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daee1eb-558f-40ec-8c87-1e86cc8c904f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:09.009138 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1313/2626] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:09:08 2021] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:09:09.010639 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffaf847-e69e-46b5-854e-df6d42a7b45f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:09.021201 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffaf847-e69e-46b5-854e-df6d42a7b45f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:09.078461 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44d723-a48c-4738-b1d3-cd1c5b6e6e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:09.079125 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44d723-a48c-4738-b1d3-cd1c5b6e6e9e admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:09.079433 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44d723-a48c-4738-b1d3-cd1c5b6e6e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:09.079708 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44d723-a48c-4738-b1d3-cd1c5b6e6e9e admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:09.080936 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44d723-a48c-4738-b1d3-cd1c5b6e6e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:09.083018 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44d723-a48c-4738-b1d3-cd1c5b6e6e9e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:09.105210 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1314/2627] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:09:09 2021] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:09:09.109073 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daee1eb-558f-40ec-8c87-1e86cc8c904f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:09.119871 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daee1eb-558f-40ec-8c87-1e86cc8c904f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:09.124720 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c92de-eed2-4532-9dee-9530aceeb09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:09.125388 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c92de-eed2-4532-9dee-9530aceeb09b admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:09.125673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c92de-eed2-4532-9dee-9530aceeb09b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:09.125976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c92de-eed2-4532-9dee-9530aceeb09b admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:09.126697 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c92de-eed2-4532-9dee-9530aceeb09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:09.128343 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c92de-eed2-4532-9dee-9530aceeb09b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:09.142080 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1314/2628] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:09:09 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:09:09.144549 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44d723-a48c-4738-b1d3-cd1c5b6e6e9e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:09.154159 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44d723-a48c-4738-b1d3-cd1c5b6e6e9e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:09.159948 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bd4a6-0074-4fd0-922d-447f6a9b559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:09.160546 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bd4a6-0074-4fd0-922d-447f6a9b559d admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:09.160824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bd4a6-0074-4fd0-922d-447f6a9b559d admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:09.161094 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bd4a6-0074-4fd0-922d-447f6a9b559d admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:09.161800 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bd4a6-0074-4fd0-922d-447f6a9b559d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:09.167684 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bd4a6-0074-4fd0-922d-447f6a9b559d admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:09.178751 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1315/2629] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:09:09 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:09:09.182851 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c92de-eed2-4532-9dee-9530aceeb09b admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:09.193487 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c92de-eed2-4532-9dee-9530aceeb09b admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:09.197998 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180a1d5-3c1f-459d-8194-d77915173a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:09.198861 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180a1d5-3c1f-459d-8194-d77915173a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:09.199133 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180a1d5-3c1f-459d-8194-d77915173a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:09.199424 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180a1d5-3c1f-459d-8194-d77915173a9c admin admin] PATH_INFO: `/v3/projects/db8b795cc44f4a168e4a0dffc04ab0b9/users/1ecaf31185424e6aadac803e619b4c4c/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:09.218526 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180a1d5-3c1f-459d-8194-d77915173a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8b795cc44f4a168e4a0dffc04ab0b9, user_id=1ecaf31185424e6aadac803e619b4c4c, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:09.221257 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180a1d5-3c1f-459d-8194-d77915173a9c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:09.237762 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1315/2630] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:09:09 2021] PUT /identity/v3/projects/db8b795cc44f4a168e4a0dffc04ab0b9/users/1ecaf31185424e6aadac803e619b4c4c/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:09:09.240475 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73baa483-34b7-42cc-bf47-2f78aa6f595b None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:09.240772 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73baa483-34b7-42cc-bf47-2f78aa6f595b None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:09.241047 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73baa483-34b7-42cc-bf47-2f78aa6f595b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:09.259514 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-73baa483-34b7-42cc-bf47-2f78aa6f595b None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:09:09.260709 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-73baa483-34b7-42cc-bf47-2f78aa6f595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:09.318904 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1316/2631] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:09:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:09:09.328983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180a1d5-3c1f-459d-8194-d77915173a9c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:09.331074 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0180a1d5-3c1f-459d-8194-d77915173a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:09.389174 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180a1d5-3c1f-459d-8194-d77915173a9c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:09.393613 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1c54a-9aaa-4441-bbcf-880871a9171a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:09.394545 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1c54a-9aaa-4441-bbcf-880871a9171a service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:09.394833 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1c54a-9aaa-4441-bbcf-880871a9171a service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:09.395097 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1c54a-9aaa-4441-bbcf-880871a9171a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:09.404535 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1c54a-9aaa-4441-bbcf-880871a9171a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:09.405961 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1c54a-9aaa-4441-bbcf-880871a9171a service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:09.416764 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1316/2632] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:09:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:09:09.666458 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a5b1b-4336-47af-a581-ea9d227708cc None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:09.667008 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a5b1b-4336-47af-a581-ea9d227708cc None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:09.667223 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a5b1b-4336-47af-a581-ea9d227708cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:09.692754 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-b68a5b1b-4336-47af-a581-ea9d227708cc None None] MFA Rules not processed for user `b1918e2aa8f24655875480ef52df324d`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:09:09.694413 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b68a5b1b-4336-47af-a581-ea9d227708cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:09.783398 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1317/2633] 10.222.0.39 () {58 vars in 1010 bytes} [Tue Aug 31 03:09:09 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:09:09.826958 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1c54a-9aaa-4441-bbcf-880871a9171a service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:09.829650 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d7c1c54a-9aaa-4441-bbcf-880871a9171a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:09.977733 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1c54a-9aaa-4441-bbcf-880871a9171a service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:09.984477 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aed949-b7e7-4dd2-b13a-fdb0ff81c343 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ed84d2e3ce4c85b552732f3294aac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:09.985245 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aed949-b7e7-4dd2-b13a-fdb0ff81c343 service swift] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:09.985597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aed949-b7e7-4dd2-b13a-fdb0ff81c343 service swift] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:09.985943 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aed949-b7e7-4dd2-b13a-fdb0ff81c343 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:09.995581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aed949-b7e7-4dd2-b13a-fdb0ff81c343 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:09.997168 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aed949-b7e7-4dd2-b13a-fdb0ff81c343 service swift] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:10.007386 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1317/2634] 10.222.0.39 () {60 vars in 1385 bytes} [Tue Aug 31 03:09:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 03:09:10.693488 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb25ca-c6b7-4fc2-9ae6-32f90a002c7d None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:10.693993 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb25ca-c6b7-4fc2-9ae6-32f90a002c7d None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:10.694080 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb25ca-c6b7-4fc2-9ae6-32f90a002c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:10.713856 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-afeb25ca-c6b7-4fc2-9ae6-32f90a002c7d None None] MFA Rules not processed for user `b1918e2aa8f24655875480ef52df324d`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:09:10.714977 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-afeb25ca-c6b7-4fc2-9ae6-32f90a002c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:10.722583 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1318/2635] 10.222.0.39 () {58 vars in 1010 bytes} [Tue Aug 31 03:09:10 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:09:10.738303 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aed949-b7e7-4dd2-b13a-fdb0ff81c343 service swift] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:10.749354 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aed949-b7e7-4dd2-b13a-fdb0ff81c343 service swift] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:10.755023 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac918a-f9b3-4335-ac07-ace202673103 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ed84d2e3ce4c85b552732f3294aac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:10.755833 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac918a-f9b3-4335-ac07-ace202673103 service swift] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:10.756120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac918a-f9b3-4335-ac07-ace202673103 service swift] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:10.756396 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac918a-f9b3-4335-ac07-ace202673103 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:10.765535 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac918a-f9b3-4335-ac07-ace202673103 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:10.767134 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac918a-f9b3-4335-ac07-ace202673103 service swift] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:10.787671 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1318/2636] 10.222.0.39 () {60 vars in 1385 bytes} [Tue Aug 31 03:09:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 03:09:11.234530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df3cb8-7e5f-40a9-b18e-ec9635107d9c None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:11.234826 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df3cb8-7e5f-40a9-b18e-ec9635107d9c None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:11.235104 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df3cb8-7e5f-40a9-b18e-ec9635107d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:11.265895 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-87df3cb8-7e5f-40a9-b18e-ec9635107d9c None None] MFA Rules not processed for user `b1918e2aa8f24655875480ef52df324d`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:09:11.267110 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-87df3cb8-7e5f-40a9-b18e-ec9635107d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:11.276021 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1319/2637] 10.222.0.39 () {58 vars in 968 bytes} [Tue Aug 31 03:09:11 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:09:11.289128 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac918a-f9b3-4335-ac07-ace202673103 service swift] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:11.302596 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac918a-f9b3-4335-ac07-ace202673103 service swift] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:11.313652 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499af26-abab-4b68-afd5-4673c478ba44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ed84d2e3ce4c85b552732f3294aac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:11.314609 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499af26-abab-4b68-afd5-4673c478ba44 service swift] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:11.315462 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499af26-abab-4b68-afd5-4673c478ba44 service swift] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:11.315768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499af26-abab-4b68-afd5-4673c478ba44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:11.327685 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499af26-abab-4b68-afd5-4673c478ba44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:11.329266 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499af26-abab-4b68-afd5-4673c478ba44 service swift] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:11.338892 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1319/2638] 10.222.0.39 () {60 vars in 1385 bytes} [Tue Aug 31 03:09:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 03:09:13.174471 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df3cb8-7e5f-40a9-b18e-ec9635107d9c None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:13.185046 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df3cb8-7e5f-40a9-b18e-ec9635107d9c None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:13.189060 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b010b92-1030-4666-921c-7cac0ed0cdcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:13.190294 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b010b92-1030-4666-921c-7cac0ed0cdcc service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:13.190802 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b010b92-1030-4666-921c-7cac0ed0cdcc service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:13.191132 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b010b92-1030-4666-921c-7cac0ed0cdcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:13.193338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-2b010b92-1030-4666-921c-7cac0ed0cdcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:13.203883 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b010b92-1030-4666-921c-7cac0ed0cdcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:13.205927 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b010b92-1030-4666-921c-7cac0ed0cdcc service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:13.215792 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1320/2639] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:09:13 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:09:13.443608 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499af26-abab-4b68-afd5-4673c478ba44 service swift] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:13.446087 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-6499af26-abab-4b68-afd5-4673c478ba44 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:13.462050 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499af26-abab-4b68-afd5-4673c478ba44 service swift] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:13.468861 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d2477-fef5-4eeb-843a-5ccc7f61f0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:13.470061 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d2477-fef5-4eeb-843a-5ccc7f61f0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:13.470548 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d2477-fef5-4eeb-843a-5ccc7f61f0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:13.471772 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d2477-fef5-4eeb-843a-5ccc7f61f0b2 admin admin] PATH_INFO: `/v3/users/8ebf3bf6427b46bcad98b495777e1427` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:13.473820 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d2477-fef5-4eeb-843a-5ccc7f61f0b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ebf3bf6427b46bcad98b495777e1427)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:13.476422 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d2477-fef5-4eeb-843a-5ccc7f61f0b2 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:13.538856 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-257d2477-fef5-4eeb-843a-5ccc7f61f0b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ebf3bf6427b46bcad98b495777e1427'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:13.539849 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-257d2477-fef5-4eeb-843a-5ccc7f61f0b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ebf3bf6427b46bcad98b495777e1427'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:13.540660 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-257d2477-fef5-4eeb-843a-5ccc7f61f0b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ebf3bf6427b46bcad98b495777e1427'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:13.573748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-257d2477-fef5-4eeb-843a-5ccc7f61f0b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ebf3bf6427b46bcad98b495777e1427'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:13.590232 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-257d2477-fef5-4eeb-843a-5ccc7f61f0b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ebf3bf6427b46bcad98b495777e1427'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:13.618277 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1320/2640] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:09:13 2021] DELETE /identity/v3/users/8ebf3bf6427b46bcad98b495777e1427 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:09:13.622956 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa7f6b-b459-417a-9d82-853797108b50 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:13.623243 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa7f6b-b459-417a-9d82-853797108b50 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:13.623564 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa7f6b-b459-417a-9d82-853797108b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:13.651844 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-26aa7f6b-b459-417a-9d82-853797108b50 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:09:13.653419 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-26aa7f6b-b459-417a-9d82-853797108b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:13.771158 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1321/2641] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:09:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:09:13.787577 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d2477-fef5-4eeb-843a-5ccc7f61f0b2 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:13.789242 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-257d2477-fef5-4eeb-843a-5ccc7f61f0b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:13.840820 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa7f6b-b459-417a-9d82-853797108b50 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:13.842722 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-26aa7f6b-b459-417a-9d82-853797108b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:13.861300 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa7f6b-b459-417a-9d82-853797108b50 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:13.868168 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f59bba-2f79-471d-bea1-e408a1ccb048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:13.869894 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f59bba-2f79-471d-bea1-e408a1ccb048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:13.870442 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f59bba-2f79-471d-bea1-e408a1ccb048 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:13.871012 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f59bba-2f79-471d-bea1-e408a1ccb048 admin admin] PATH_INFO: `/v3/users/4942dd1502a94dc2acdf8906c2263d17` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:13.874030 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f59bba-2f79-471d-bea1-e408a1ccb048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4942dd1502a94dc2acdf8906c2263d17)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:13.878475 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f59bba-2f79-471d-bea1-e408a1ccb048 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:13.932139 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d2477-fef5-4eeb-843a-5ccc7f61f0b2 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:13.942783 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213946d-9397-414b-9e73-38713cdeae37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:13.943470 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213946d-9397-414b-9e73-38713cdeae37 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:13.943964 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213946d-9397-414b-9e73-38713cdeae37 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:13.944253 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213946d-9397-414b-9e73-38713cdeae37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:13.961992 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213946d-9397-414b-9e73-38713cdeae37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:13.963468 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213946d-9397-414b-9e73-38713cdeae37 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:13.975503 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1321/2642] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:09:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:09:13.978727 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-29f59bba-2f79-471d-bea1-e408a1ccb048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4942dd1502a94dc2acdf8906c2263d17'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:13.994884 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-29f59bba-2f79-471d-bea1-e408a1ccb048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4942dd1502a94dc2acdf8906c2263d17'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:13.995906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-29f59bba-2f79-471d-bea1-e408a1ccb048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4942dd1502a94dc2acdf8906c2263d17'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:14.009208 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-29f59bba-2f79-471d-bea1-e408a1ccb048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4942dd1502a94dc2acdf8906c2263d17'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:14.018924 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-29f59bba-2f79-471d-bea1-e408a1ccb048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4942dd1502a94dc2acdf8906c2263d17'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:14.025418 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1322/2643] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:09:13 2021] DELETE /identity/v3/users/4942dd1502a94dc2acdf8906c2263d17 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:09:14.029897 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038fd08-2cdd-4123-96b2-cef690e4b43b None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:14.030189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038fd08-2cdd-4123-96b2-cef690e4b43b None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:14.030469 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038fd08-2cdd-4123-96b2-cef690e4b43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:14.053051 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-9038fd08-2cdd-4123-96b2-cef690e4b43b None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:09:14.054444 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-9038fd08-2cdd-4123-96b2-cef690e4b43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:14.157168 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1322/2644] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:09:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:09:14.171749 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f59bba-2f79-471d-bea1-e408a1ccb048 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:14.173216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-29f59bba-2f79-471d-bea1-e408a1ccb048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:14.256375 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f59bba-2f79-471d-bea1-e408a1ccb048 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:14.261983 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629ba0b-c3f2-4d97-95a6-c09869ca35b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:14.263014 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629ba0b-c3f2-4d97-95a6-c09869ca35b4 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:14.264361 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629ba0b-c3f2-4d97-95a6-c09869ca35b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:14.265250 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629ba0b-c3f2-4d97-95a6-c09869ca35b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:14.296604 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629ba0b-c3f2-4d97-95a6-c09869ca35b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:14.298160 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629ba0b-c3f2-4d97-95a6-c09869ca35b4 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:14.331915 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1323/2645] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:09:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:09:14.479041 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb6446-83ed-417b-a767-d8acc5234aec None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:14.479530 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb6446-83ed-417b-a767-d8acc5234aec None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:14.479859 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb6446-83ed-417b-a767-d8acc5234aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:14.517210 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-6ceb6446-83ed-417b-a767-d8acc5234aec None None] MFA Rules not processed for user `1ecaf31185424e6aadac803e619b4c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:09:14.519435 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-6ceb6446-83ed-417b-a767-d8acc5234aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:14.563090 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629ba0b-c3f2-4d97-95a6-c09869ca35b4 service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:14.565570 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a629ba0b-c3f2-4d97-95a6-c09869ca35b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:14.583623 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629ba0b-c3f2-4d97-95a6-c09869ca35b4 service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:14.597295 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ecd41-1fa1-4407-80eb-09719d705b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:14.598640 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ecd41-1fa1-4407-80eb-09719d705b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:14.599259 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ecd41-1fa1-4407-80eb-09719d705b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:14.599732 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ecd41-1fa1-4407-80eb-09719d705b95 admin admin] PATH_INFO: `/v3/projects/9f05f60fdf724db6b67661af1a59e887` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:14.601272 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ecd41-1fa1-4407-80eb-09719d705b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f05f60fdf724db6b67661af1a59e887)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:14.603378 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ecd41-1fa1-4407-80eb-09719d705b95 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:14.655618 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1323/2646] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:09:14 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:09:14.656981 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb6446-83ed-417b-a767-d8acc5234aec None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:14.659065 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-6ceb6446-83ed-417b-a767-d8acc5234aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:14.665057 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4a4ecd41-1fa1-4407-80eb-09719d705b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f05f60fdf724db6b67661af1a59e887', 'request_id': 'req-4a4ecd41-1fa1-4407-80eb-09719d705b95'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:14.670427 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4a4ecd41-1fa1-4407-80eb-09719d705b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f05f60fdf724db6b67661af1a59e887', 'request_id': 'req-4a4ecd41-1fa1-4407-80eb-09719d705b95'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:14.672743 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb6446-83ed-417b-a767-d8acc5234aec None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:14.678716 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4a4ecd41-1fa1-4407-80eb-09719d705b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f05f60fdf724db6b67661af1a59e887', 'request_id': 'req-4a4ecd41-1fa1-4407-80eb-09719d705b95'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:14.694049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4a4ecd41-1fa1-4407-80eb-09719d705b95 admin admin] The token cache is being invalidate because project 9f05f60fdf724db6b67661af1a59e887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:09:14.694435 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4a4ecd41-1fa1-4407-80eb-09719d705b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:14.695205 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4a4ecd41-1fa1-4407-80eb-09719d705b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:14.699414 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1324/2647] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:09:14 2021] DELETE /identity/v3/projects/9f05f60fdf724db6b67661af1a59e887 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:09:14.699414 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ecd41-1fa1-4407-80eb-09719d705b95 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:14.699414 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-4a4ecd41-1fa1-4407-80eb-09719d705b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:14.747408 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54975c-7d07-43b3-84e1-187b08430dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:14.748443 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54975c-7d07-43b3-84e1-187b08430dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:14.748982 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54975c-7d07-43b3-84e1-187b08430dec admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:14.749488 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54975c-7d07-43b3-84e1-187b08430dec admin admin] PATH_INFO: `/v3/projects/908d7786d5844cb085daf849e887df73` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:14.751275 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54975c-7d07-43b3-84e1-187b08430dec admin admin] RBAC: Authorizing `identity:delete_project(project_id=908d7786d5844cb085daf849e887df73)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:14.754059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54975c-7d07-43b3-84e1-187b08430dec admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:14.856244 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ecd41-1fa1-4407-80eb-09719d705b95 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:14.878623 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-0a54975c-7d07-43b3-84e1-187b08430dec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908d7786d5844cb085daf849e887df73', 'request_id': 'req-0a54975c-7d07-43b3-84e1-187b08430dec'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:14.895245 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-0a54975c-7d07-43b3-84e1-187b08430dec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908d7786d5844cb085daf849e887df73', 'request_id': 'req-0a54975c-7d07-43b3-84e1-187b08430dec'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:14.901866 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-0a54975c-7d07-43b3-84e1-187b08430dec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908d7786d5844cb085daf849e887df73', 'request_id': 'req-0a54975c-7d07-43b3-84e1-187b08430dec'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:14.919266 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-0a54975c-7d07-43b3-84e1-187b08430dec admin admin] The token cache is being invalidate because project 908d7786d5844cb085daf849e887df73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:09:14.919589 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-0a54975c-7d07-43b3-84e1-187b08430dec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:14.920287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-0a54975c-7d07-43b3-84e1-187b08430dec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:09:14.922456 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1324/2648] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:09:14 2021] DELETE /identity/v3/projects/908d7786d5844cb085daf849e887df73 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:09:14.951231 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b3b6f-0e95-4c95-b04d-2981f927acb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:14.952255 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b3b6f-0e95-4c95-b04d-2981f927acb6 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:14.952624 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b3b6f-0e95-4c95-b04d-2981f927acb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:14.952972 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b3b6f-0e95-4c95-b04d-2981f927acb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:14.953671 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b3b6f-0e95-4c95-b04d-2981f927acb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:14.963411 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b3b6f-0e95-4c95-b04d-2981f927acb6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:14.995480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1325/2649] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:09:14 2021] POST /identity/v3/projects => generated 385 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:09:15.000123 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54975c-7d07-43b3-84e1-187b08430dec admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:15.002923 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0a54975c-7d07-43b3-84e1-187b08430dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:15.032116 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54975c-7d07-43b3-84e1-187b08430dec admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:15.154015 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125ae51-12d9-4b55-a025-7a2009b8cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:15.154695 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125ae51-12d9-4b55-a025-7a2009b8cfa0 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:15.155111 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125ae51-12d9-4b55-a025-7a2009b8cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:15.155225 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125ae51-12d9-4b55-a025-7a2009b8cfa0 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:15.155953 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125ae51-12d9-4b55-a025-7a2009b8cfa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:15.157925 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125ae51-12d9-4b55-a025-7a2009b8cfa0 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:15.183715 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1325/2650] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:09:14 2021] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:09:15.188171 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b3b6f-0e95-4c95-b04d-2981f927acb6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:15.200767 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b3b6f-0e95-4c95-b04d-2981f927acb6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:15.206514 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0a14b-6736-4b22-a964-50322b18d805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:15.207510 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0a14b-6736-4b22-a964-50322b18d805 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:15.207802 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0a14b-6736-4b22-a964-50322b18d805 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:15.208078 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0a14b-6736-4b22-a964-50322b18d805 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:15.208810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0a14b-6736-4b22-a964-50322b18d805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:15.210425 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0a14b-6736-4b22-a964-50322b18d805 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:15.222601 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1326/2651] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:09:15 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:09:15.226947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125ae51-12d9-4b55-a025-7a2009b8cfa0 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:15.238724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125ae51-12d9-4b55-a025-7a2009b8cfa0 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:15.244767 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d7546-c2b9-46eb-b0ed-362afebe7288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:15.245571 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d7546-c2b9-46eb-b0ed-362afebe7288 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:15.246687 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d7546-c2b9-46eb-b0ed-362afebe7288 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:15.246884 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d7546-c2b9-46eb-b0ed-362afebe7288 admin admin] PATH_INFO: `/v3/projects/33df774dcc804d46bad8867902bd09ca/users/670abe069f5540c599c48e2e1805d240/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:15.265602 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d7546-c2b9-46eb-b0ed-362afebe7288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33df774dcc804d46bad8867902bd09ca, user_id=670abe069f5540c599c48e2e1805d240, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:15.268505 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d7546-c2b9-46eb-b0ed-362afebe7288 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:15.284762 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1326/2652] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:09:15 2021] PUT /identity/v3/projects/33df774dcc804d46bad8867902bd09ca/users/670abe069f5540c599c48e2e1805d240/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:09:15.288466 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0a14b-6736-4b22-a964-50322b18d805 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:15.298395 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0a14b-6736-4b22-a964-50322b18d805 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:15.380793 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fd6d5-7e93-4910-80f0-569d8e108126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:15.381994 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fd6d5-7e93-4910-80f0-569d8e108126 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:15.382342 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fd6d5-7e93-4910-80f0-569d8e108126 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:15.382686 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fd6d5-7e93-4910-80f0-569d8e108126 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:15.383535 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fd6d5-7e93-4910-80f0-569d8e108126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:15.385232 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fd6d5-7e93-4910-80f0-569d8e108126 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:15.397296 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1327/2653] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:09:15 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:09:15.401457 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d7546-c2b9-46eb-b0ed-362afebe7288 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:15.420454 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d7546-c2b9-46eb-b0ed-362afebe7288 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:15.431526 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3588c-89fa-45de-aebf-51fbc16ce03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:15.432586 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3588c-89fa-45de-aebf-51fbc16ce03f admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:15.432878 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3588c-89fa-45de-aebf-51fbc16ce03f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:15.433156 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3588c-89fa-45de-aebf-51fbc16ce03f admin admin] PATH_INFO: `/v3/projects/33df774dcc804d46bad8867902bd09ca/users/670abe069f5540c599c48e2e1805d240/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:15.435762 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3588c-89fa-45de-aebf-51fbc16ce03f admin admin] RBAC: Authorizing `identity:create_grant(project_id=33df774dcc804d46bad8867902bd09ca, user_id=670abe069f5540c599c48e2e1805d240, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:15.438175 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3588c-89fa-45de-aebf-51fbc16ce03f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:15.452742 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1327/2654] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:09:15 2021] PUT /identity/v3/projects/33df774dcc804d46bad8867902bd09ca/users/670abe069f5540c599c48e2e1805d240/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:09:16.380982 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fd6d5-7e93-4910-80f0-569d8e108126 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:16.383904 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3588c-89fa-45de-aebf-51fbc16ce03f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:16.385389 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-1f1fd6d5-7e93-4910-80f0-569d8e108126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:16.386340 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d1c3588c-89fa-45de-aebf-51fbc16ce03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:16.466938 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fd6d5-7e93-4910-80f0-569d8e108126 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:16.538354 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54aa3e6-58a7-437d-8558-a62b848c50d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:16.539351 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54aa3e6-58a7-437d-8558-a62b848c50d6 service nova] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:16.539877 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54aa3e6-58a7-437d-8558-a62b848c50d6 service nova] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:16.540398 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54aa3e6-58a7-437d-8558-a62b848c50d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:16.542428 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b54aa3e6-58a7-437d-8558-a62b848c50d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:16.567158 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3588c-89fa-45de-aebf-51fbc16ce03f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:16.583880 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1b748-8d8a-4ca0-88ac-cdfc09addbd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:16.584767 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1b748-8d8a-4ca0-88ac-cdfc09addbd5 service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:16.585021 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1b748-8d8a-4ca0-88ac-cdfc09addbd5 service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:16.585303 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1b748-8d8a-4ca0-88ac-cdfc09addbd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:16.587663 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-26c1b748-8d8a-4ca0-88ac-cdfc09addbd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:16.625859 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54aa3e6-58a7-437d-8558-a62b848c50d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:16.626843 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1b748-8d8a-4ca0-88ac-cdfc09addbd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:16.629103 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54aa3e6-58a7-437d-8558-a62b848c50d6 service nova] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:16.629250 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1b748-8d8a-4ca0-88ac-cdfc09addbd5 service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:16.640665 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1328/2655] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:09:16 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:09:16.656149 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1328/2656] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:09:16 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:09:20.304519 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87b66d-dbe9-4ecc-a7d0-be72cce4697d None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:20.305000 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87b66d-dbe9-4ecc-a7d0-be72cce4697d None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:20.305116 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87b66d-dbe9-4ecc-a7d0-be72cce4697d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:20.337875 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-5e87b66d-dbe9-4ecc-a7d0-be72cce4697d None None] MFA Rules not processed for user `670abe069f5540c599c48e2e1805d240`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:09:20.339185 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-5e87b66d-dbe9-4ecc-a7d0-be72cce4697d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:20.423208 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1329/2657] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:09:20 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:09:20.437852 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1b748-8d8a-4ca0-88ac-cdfc09addbd5 service nova] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:20.439280 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-26c1b748-8d8a-4ca0-88ac-cdfc09addbd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:20.495637 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1b748-8d8a-4ca0-88ac-cdfc09addbd5 service nova] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:20.499384 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f95d3-88d6-4f76-8efc-10202fad1388 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d763da11c58473c9c2cf981b02835f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:20.500034 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f95d3-88d6-4f76-8efc-10202fad1388 service glance] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:20.500320 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f95d3-88d6-4f76-8efc-10202fad1388 service glance] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:20.500597 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f95d3-88d6-4f76-8efc-10202fad1388 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:20.502919 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-519f95d3-88d6-4f76-8efc-10202fad1388 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:20.562027 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f95d3-88d6-4f76-8efc-10202fad1388 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:20.563499 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f95d3-88d6-4f76-8efc-10202fad1388 service glance] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:20.572948 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1329/2658] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:09:20 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:09:20.675105 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b25ec-dc56-4232-8429-e520f148c029 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:20.675412 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b25ec-dc56-4232-8429-e520f148c029 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:20.675716 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b25ec-dc56-4232-8429-e520f148c029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:20.694431 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-b08b25ec-dc56-4232-8429-e520f148c029 None None] MFA Rules not processed for user `b1918e2aa8f24655875480ef52df324d`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:09:20.695752 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b08b25ec-dc56-4232-8429-e520f148c029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:20.750506 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1330/2659] 10.222.0.39 () {58 vars in 1010 bytes} [Tue Aug 31 03:09:20 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:09:20.765359 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f95d3-88d6-4f76-8efc-10202fad1388 service glance] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:20.766822 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-519f95d3-88d6-4f76-8efc-10202fad1388 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:20.854378 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f95d3-88d6-4f76-8efc-10202fad1388 service glance] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:20.859275 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d948b58-70a4-415e-8750-4788a9ca6221 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ed84d2e3ce4c85b552732f3294aac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:20.859944 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d948b58-70a4-415e-8750-4788a9ca6221 service swift] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:20.860225 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d948b58-70a4-415e-8750-4788a9ca6221 service swift] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:20.860496 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d948b58-70a4-415e-8750-4788a9ca6221 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:20.870270 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d948b58-70a4-415e-8750-4788a9ca6221 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:20.871917 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d948b58-70a4-415e-8750-4788a9ca6221 service swift] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:20.880009 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1330/2660] 10.222.0.39 () {60 vars in 1385 bytes} [Tue Aug 31 03:09:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 03:09:29.507725 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b25ec-dc56-4232-8429-e520f148c029 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:29.525524 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b25ec-dc56-4232-8429-e520f148c029 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:29.534861 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e61a7-076e-4506-bc8f-caa8209b25c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:29.536273 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e61a7-076e-4506-bc8f-caa8209b25c5 service nova] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:29.536748 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e61a7-076e-4506-bc8f-caa8209b25c5 service nova] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:29.537259 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e61a7-076e-4506-bc8f-caa8209b25c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:29.540082 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-7e8e61a7-076e-4506-bc8f-caa8209b25c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:29.557443 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e61a7-076e-4506-bc8f-caa8209b25c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:29.559204 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e61a7-076e-4506-bc8f-caa8209b25c5 service nova] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:29.577132 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1331/2661] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:09:29 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:09:30.087012 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a35c40-7321-41a6-a9f2-e71ce7574bce None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:30.087502 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a35c40-7321-41a6-a9f2-e71ce7574bce None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:30.087672 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a35c40-7321-41a6-a9f2-e71ce7574bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:30.105621 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-76a35c40-7321-41a6-a9f2-e71ce7574bce None None] MFA Rules not processed for user `1ecaf31185424e6aadac803e619b4c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:09:30.106820 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-76a35c40-7321-41a6-a9f2-e71ce7574bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:30.120592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1331/2662] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:09:30 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:09:30.390156 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e61a7-076e-4506-bc8f-caa8209b25c5 service nova] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:30.391626 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-7e8e61a7-076e-4506-bc8f-caa8209b25c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:30.452466 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e61a7-076e-4506-bc8f-caa8209b25c5 service nova] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:30.458638 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b03fb-fbe7-4a09-870a-bee54aef5ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:30.459777 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b03fb-fbe7-4a09-870a-bee54aef5ced service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:30.460251 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b03fb-fbe7-4a09-870a-bee54aef5ced service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:30.460425 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b03fb-fbe7-4a09-870a-bee54aef5ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:30.467436 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-8e8b03fb-fbe7-4a09-870a-bee54aef5ced service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:30.482825 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b03fb-fbe7-4a09-870a-bee54aef5ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:30.484430 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b03fb-fbe7-4a09-870a-bee54aef5ced service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:30.493341 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1332/2663] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:09:30 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:09:30.805269 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8d8dd-543b-42d4-a126-1e48262b4588 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:30.805269 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8d8dd-543b-42d4-a126-1e48262b4588 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:30.805269 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8d8dd-543b-42d4-a126-1e48262b4588 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:30.806671 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1332/2664] 10.222.0.39 () {54 vars in 960 bytes} [Tue Aug 31 03:09:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:09:30.812958 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639176f-8bbe-4d6c-9e67-1611e1dd50eb None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:30.815565 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639176f-8bbe-4d6c-9e67-1611e1dd50eb None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:30.815751 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639176f-8bbe-4d6c-9e67-1611e1dd50eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:30.872374 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-8639176f-8bbe-4d6c-9e67-1611e1dd50eb None None] MFA Rules not processed for user `bbcf0359f8bc4f55be3307f235f8aac5`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:09:30.873568 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-8639176f-8bbe-4d6c-9e67-1611e1dd50eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:30.934443 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1333/2665] 10.222.0.39 () {58 vars in 1058 bytes} [Tue Aug 31 03:09:30 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:09:30.942613 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8d8dd-543b-42d4-a126-1e48262b4588 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:30.956289 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8d8dd-543b-42d4-a126-1e48262b4588 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:30.961226 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745b810-ab02-49ef-b8ab-3aa3aef44213 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcf0359f8bc4f55be3307f235f8aac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:30.961851 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745b810-ab02-49ef-b8ab-3aa3aef44213 service placement] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:30.962130 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745b810-ab02-49ef-b8ab-3aa3aef44213 service placement] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:30.962400 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745b810-ab02-49ef-b8ab-3aa3aef44213 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:30.964153 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d745b810-ab02-49ef-b8ab-3aa3aef44213 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:30.979319 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745b810-ab02-49ef-b8ab-3aa3aef44213 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:30.980926 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745b810-ab02-49ef-b8ab-3aa3aef44213 service placement] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:30.990933 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1333/2666] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:09:30 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:09:31.275805 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bbae0-917a-4dc8-a48b-4a2642490d12 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:31.276102 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bbae0-917a-4dc8-a48b-4a2642490d12 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:31.276385 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bbae0-917a-4dc8-a48b-4a2642490d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:31.294141 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-722bbae0-917a-4dc8-a48b-4a2642490d12 None None] MFA Rules not processed for user `863e1031965a4bba82d345acb07e5856`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:09:31.295453 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-722bbae0-917a-4dc8-a48b-4a2642490d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:31.350400 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1334/2667] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:09:31 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:09:32.280781 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ef2b2-00f9-4673-a984-f7e878eb005c None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:32.281301 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ef2b2-00f9-4673-a984-f7e878eb005c None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:32.281420 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ef2b2-00f9-4673-a984-f7e878eb005c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:32.302262 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-fe2ef2b2-00f9-4673-a984-f7e878eb005c None None] MFA Rules not processed for user `b1918e2aa8f24655875480ef52df324d`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:09:32.303493 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-fe2ef2b2-00f9-4673-a984-f7e878eb005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:32.320919 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1334/2668] 10.222.0.39 () {58 vars in 1010 bytes} [Tue Aug 31 03:09:32 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:09:32.335238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bbae0-917a-4dc8-a48b-4a2642490d12 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:32.350318 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bbae0-917a-4dc8-a48b-4a2642490d12 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:32.356606 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c7f0b-5817-472e-8b75-7adc0ad8b42f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ed84d2e3ce4c85b552732f3294aac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:32.357339 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c7f0b-5817-472e-8b75-7adc0ad8b42f service swift] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:32.357622 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c7f0b-5817-472e-8b75-7adc0ad8b42f service swift] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:32.358136 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c7f0b-5817-472e-8b75-7adc0ad8b42f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:32.367752 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c7f0b-5817-472e-8b75-7adc0ad8b42f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:32.369580 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c7f0b-5817-472e-8b75-7adc0ad8b42f service swift] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:32.378767 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1335/2669] 10.222.0.39 () {60 vars in 1385 bytes} [Tue Aug 31 03:09:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 03:09:48.814415 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ef2b2-00f9-4673-a984-f7e878eb005c None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:48.829312 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ef2b2-00f9-4673-a984-f7e878eb005c None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:48.835003 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d168f4-ff49-4583-91ab-c0315676f0af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:48.835689 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d168f4-ff49-4583-91ab-c0315676f0af service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:48.836170 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d168f4-ff49-4583-91ab-c0315676f0af service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:48.836860 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d168f4-ff49-4583-91ab-c0315676f0af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:48.838211 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f5d168f4-ff49-4583-91ab-c0315676f0af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:48.850637 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d168f4-ff49-4583-91ab-c0315676f0af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:48.852455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d168f4-ff49-4583-91ab-c0315676f0af service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:48.863210 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1335/2670] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:09:48 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:09:59.771579 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c7f0b-5817-472e-8b75-7adc0ad8b42f service swift] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:09:59.772980 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-7a5c7f0b-5817-472e-8b75-7adc0ad8b42f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:09:59.785024 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c7f0b-5817-472e-8b75-7adc0ad8b42f service swift] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:09:59.788791 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c394c8-7a32-48a7-9fca-b3d59a4dd03e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:09:59.789974 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c394c8-7a32-48a7-9fca-b3d59a4dd03e service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:09:59.790275 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c394c8-7a32-48a7-9fca-b3d59a4dd03e service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:09:59.790550 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c394c8-7a32-48a7-9fca-b3d59a4dd03e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:09:59.799464 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c394c8-7a32-48a7-9fca-b3d59a4dd03e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:09:59.800896 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c394c8-7a32-48a7-9fca-b3d59a4dd03e service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:09:59.810947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1336/2671] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:09:59 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:10:13.278040 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51017533-bfd1-463a-89d4-a25ab0794913 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:10:13.278560 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51017533-bfd1-463a-89d4-a25ab0794913 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:10:13.278560 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51017533-bfd1-463a-89d4-a25ab0794913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:10:13.296581 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-51017533-bfd1-463a-89d4-a25ab0794913 None None] MFA Rules not processed for user `b1918e2aa8f24655875480ef52df324d`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:10:13.297792 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-51017533-bfd1-463a-89d4-a25ab0794913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:10:13.304749 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1336/2672] 10.222.0.39 () {58 vars in 1010 bytes} [Tue Aug 31 03:10:13 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:10:13.327824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c394c8-7a32-48a7-9fca-b3d59a4dd03e service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:10:13.339584 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c394c8-7a32-48a7-9fca-b3d59a4dd03e service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:10:13.344859 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab329319-a713-4f9f-8f4e-168558642a3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ed84d2e3ce4c85b552732f3294aac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:10:13.345496 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab329319-a713-4f9f-8f4e-168558642a3c service swift] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:10:13.345779 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab329319-a713-4f9f-8f4e-168558642a3c service swift] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:10:13.346057 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab329319-a713-4f9f-8f4e-168558642a3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:10:13.354624 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab329319-a713-4f9f-8f4e-168558642a3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:10:13.356186 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab329319-a713-4f9f-8f4e-168558642a3c service swift] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:10:13.364177 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1337/2673] 10.222.0.39 () {60 vars in 1385 bytes} [Tue Aug 31 03:10:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 03:10:26.464865 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100e688-96cf-4240-9afc-f65aa62d08b6 None None] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:10:26.465504 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100e688-96cf-4240-9afc-f65aa62d08b6 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:10:26.465504 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100e688-96cf-4240-9afc-f65aa62d08b6 None None] PATH_INFO: `/` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:10:26.467211 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1337/2674] 10.222.0.39 () {54 vars in 921 bytes} [Tue Aug 31 03:10:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:10:26.473391 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a3588-875b-4b7c-b684-acff44591303 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:10:26.473902 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a3588-875b-4b7c-b684-acff44591303 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:10:26.474199 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a3588-875b-4b7c-b684-acff44591303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:10:26.492881 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-7f3a3588-875b-4b7c-b684-acff44591303 None None] MFA Rules not processed for user `a6bb852fc4394f88800ec9616cb65416`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:10:26.494859 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-7f3a3588-875b-4b7c-b684-acff44591303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:10:26.504341 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1338/2675] 10.222.0.39 () {58 vars in 1019 bytes} [Tue Aug 31 03:10:26 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:10:26.518056 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100e688-96cf-4240-9afc-f65aa62d08b6 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:10:26.529287 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100e688-96cf-4240-9afc-f65aa62d08b6 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:10:26.532786 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d0b09-d986-44d1-98fe-5bb456ac370b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d763da11c58473c9c2cf981b02835f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:10:26.533422 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d0b09-d986-44d1-98fe-5bb456ac370b service glance] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:10:26.533700 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d0b09-d986-44d1-98fe-5bb456ac370b service glance] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:10:26.533970 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d0b09-d986-44d1-98fe-5bb456ac370b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:10:26.544792 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d0b09-d986-44d1-98fe-5bb456ac370b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:10:26.546213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d0b09-d986-44d1-98fe-5bb456ac370b service glance] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:10:26.557286 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1338/2676] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:10:26 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:10:26.625703 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98429f82-0ab6-4c91-8d8f-d875c461b0b2 None None] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:10:26.625986 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98429f82-0ab6-4c91-8d8f-d875c461b0b2 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:10:26.626262 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98429f82-0ab6-4c91-8d8f-d875c461b0b2 None None] PATH_INFO: `/` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:10:26.628121 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1339/2677] 10.222.0.39 () {54 vars in 921 bytes} [Tue Aug 31 03:10:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 03:10:26.633545 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abbcea-3c1b-4970-8845-80e404c7c99f None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:10:26.633849 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abbcea-3c1b-4970-8845-80e404c7c99f None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:10:26.634120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abbcea-3c1b-4970-8845-80e404c7c99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:10:26.651795 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-43abbcea-3c1b-4970-8845-80e404c7c99f None None] MFA Rules not processed for user `18b73b8e7244410b8f701b2ab43c5979`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:10:26.652977 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-43abbcea-3c1b-4970-8845-80e404c7c99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:10:26.659265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1339/2678] 10.222.0.39 () {58 vars in 1019 bytes} [Tue Aug 31 03:10:26 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:10:26.671597 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98429f82-0ab6-4c91-8d8f-d875c461b0b2 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:10:26.682849 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98429f82-0ab6-4c91-8d8f-d875c461b0b2 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:10:26.686332 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c6821-4e19-431e-8a97-f3a6d47b4c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:10:26.686956 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c6821-4e19-431e-8a97-f3a6d47b4c9c service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:10:26.687241 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c6821-4e19-431e-8a97-f3a6d47b4c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:10:26.687544 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c6821-4e19-431e-8a97-f3a6d47b4c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:10:26.694561 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c6821-4e19-431e-8a97-f3a6d47b4c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:10:26.695998 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c6821-4e19-431e-8a97-f3a6d47b4c9c service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:10:26.703494 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1340/2679] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:10:26 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:10:28.208556 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130b356-9780-4969-9736-56f170df2685 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:10:28.209029 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130b356-9780-4969-9736-56f170df2685 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:10:28.209140 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130b356-9780-4969-9736-56f170df2685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:10:28.226576 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-f130b356-9780-4969-9736-56f170df2685 None None] MFA Rules not processed for user `b1918e2aa8f24655875480ef52df324d`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:10:28.228403 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f130b356-9780-4969-9736-56f170df2685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:10:28.235310 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1340/2680] 10.222.0.39 () {58 vars in 1010 bytes} [Tue Aug 31 03:10:28 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:10:28.248603 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c6821-4e19-431e-8a97-f3a6d47b4c9c service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:10:28.260945 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c6821-4e19-431e-8a97-f3a6d47b4c9c service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:10:28.265993 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5a10a-a763-44c8-a41e-34aaa208863c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ed84d2e3ce4c85b552732f3294aac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:10:28.266629 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5a10a-a763-44c8-a41e-34aaa208863c service swift] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:10:28.266914 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5a10a-a763-44c8-a41e-34aaa208863c service swift] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:10:28.267190 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5a10a-a763-44c8-a41e-34aaa208863c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:10:28.275408 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5a10a-a763-44c8-a41e-34aaa208863c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:10:28.277010 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5a10a-a763-44c8-a41e-34aaa208863c service swift] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:10:28.284861 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1341/2681] 10.222.0.39 () {60 vars in 1385 bytes} [Tue Aug 31 03:10:28 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 03:10:44.363005 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776c3e8-7c30-4712-8b4f-65e59e0f81cf None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:10:44.363591 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776c3e8-7c30-4712-8b4f-65e59e0f81cf None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:10:44.363591 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776c3e8-7c30-4712-8b4f-65e59e0f81cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:10:44.381384 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-3776c3e8-7c30-4712-8b4f-65e59e0f81cf None None] MFA Rules not processed for user `b1918e2aa8f24655875480ef52df324d`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:10:44.382574 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-3776c3e8-7c30-4712-8b4f-65e59e0f81cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:10:44.390476 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1341/2682] 10.222.0.39 () {58 vars in 968 bytes} [Tue Aug 31 03:10:44 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:10:44.402930 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5a10a-a763-44c8-a41e-34aaa208863c service swift] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:10:44.413395 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5a10a-a763-44c8-a41e-34aaa208863c service swift] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:10:44.419197 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8c56d-6e5a-42b5-b882-50af4b476313 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ed84d2e3ce4c85b552732f3294aac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:10:44.419900 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8c56d-6e5a-42b5-b882-50af4b476313 service swift] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:10:44.420224 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8c56d-6e5a-42b5-b882-50af4b476313 service swift] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:10:44.420530 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8c56d-6e5a-42b5-b882-50af4b476313 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:10:44.428851 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8c56d-6e5a-42b5-b882-50af4b476313 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:10:44.430433 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8c56d-6e5a-42b5-b882-50af4b476313 service swift] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:10:44.439646 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1342/2683] 10.222.0.39 () {60 vars in 1385 bytes} [Tue Aug 31 03:10:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 03:11:24.887016 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776c3e8-7c30-4712-8b4f-65e59e0f81cf None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:11:24.896311 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776c3e8-7c30-4712-8b4f-65e59e0f81cf None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:11:24.899885 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca0f2d-ec0e-4c82-84bd-e14e44d6f7b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:11:24.900757 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca0f2d-ec0e-4c82-84bd-e14e44d6f7b2 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:24.901045 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca0f2d-ec0e-4c82-84bd-e14e44d6f7b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:24.901324 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca0f2d-ec0e-4c82-84bd-e14e44d6f7b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:24.903082 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-3fca0f2d-ec0e-4c82-84bd-e14e44d6f7b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:11:24.962421 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca0f2d-ec0e-4c82-84bd-e14e44d6f7b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:11:24.963973 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca0f2d-ec0e-4c82-84bd-e14e44d6f7b2 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:11:24.973337 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1342/2684] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:11:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:11:28.263758 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8c56d-6e5a-42b5-b882-50af4b476313 service swift] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:11:28.265333 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-05e8c56d-6e5a-42b5-b882-50af4b476313 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:11:28.285173 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8c56d-6e5a-42b5-b882-50af4b476313 service swift] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:11:28.296185 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b0a7f-dba0-4310-90a7-2ef479084a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:11:28.296981 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b0a7f-dba0-4310-90a7-2ef479084a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:28.297272 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b0a7f-dba0-4310-90a7-2ef479084a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:28.297554 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b0a7f-dba0-4310-90a7-2ef479084a86 admin admin] PATH_INFO: `/v3/users/562353a14c284dcda0f7fdba85a418ef` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:28.298852 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b0a7f-dba0-4310-90a7-2ef479084a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=562353a14c284dcda0f7fdba85a418ef)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:11:28.300819 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b0a7f-dba0-4310-90a7-2ef479084a86 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:11:28.350233 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-910b0a7f-dba0-4310-90a7-2ef479084a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562353a14c284dcda0f7fdba85a418ef'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:28.361407 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-910b0a7f-dba0-4310-90a7-2ef479084a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562353a14c284dcda0f7fdba85a418ef'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:28.362068 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-910b0a7f-dba0-4310-90a7-2ef479084a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562353a14c284dcda0f7fdba85a418ef'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:28.369834 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-910b0a7f-dba0-4310-90a7-2ef479084a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562353a14c284dcda0f7fdba85a418ef'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:28.376490 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-910b0a7f-dba0-4310-90a7-2ef479084a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562353a14c284dcda0f7fdba85a418ef'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:28.382187 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1343/2685] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:11:28 2021] DELETE /identity/v3/users/562353a14c284dcda0f7fdba85a418ef => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:11:28.551867 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca0f2d-ec0e-4c82-84bd-e14e44d6f7b2 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:11:28.562620 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca0f2d-ec0e-4c82-84bd-e14e44d6f7b2 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:11:28.619440 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0571f4e-86d5-404c-bf5f-01d49a63099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:11:28.620302 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0571f4e-86d5-404c-bf5f-01d49a63099d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:28.620610 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0571f4e-86d5-404c-bf5f-01d49a63099d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:28.620885 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0571f4e-86d5-404c-bf5f-01d49a63099d admin admin] PATH_INFO: `/v3/projects/914e98e1b8e64dd6a3d50cf009c9a2af` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:28.622100 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0571f4e-86d5-404c-bf5f-01d49a63099d admin admin] RBAC: Authorizing `identity:delete_project(project_id=914e98e1b8e64dd6a3d50cf009c9a2af)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:11:28.624376 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0571f4e-86d5-404c-bf5f-01d49a63099d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:11:28.670106 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f0571f4e-86d5-404c-bf5f-01d49a63099d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914e98e1b8e64dd6a3d50cf009c9a2af', 'request_id': 'req-f0571f4e-86d5-404c-bf5f-01d49a63099d'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:28.676219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f0571f4e-86d5-404c-bf5f-01d49a63099d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914e98e1b8e64dd6a3d50cf009c9a2af', 'request_id': 'req-f0571f4e-86d5-404c-bf5f-01d49a63099d'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:28.682674 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f0571f4e-86d5-404c-bf5f-01d49a63099d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914e98e1b8e64dd6a3d50cf009c9a2af', 'request_id': 'req-f0571f4e-86d5-404c-bf5f-01d49a63099d'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:28.695191 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f0571f4e-86d5-404c-bf5f-01d49a63099d admin admin] The token cache is being invalidate because project 914e98e1b8e64dd6a3d50cf009c9a2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:11:28.695510 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f0571f4e-86d5-404c-bf5f-01d49a63099d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:28.696159 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-f0571f4e-86d5-404c-bf5f-01d49a63099d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:28.698847 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1343/2686] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:11:28 2021] DELETE /identity/v3/projects/914e98e1b8e64dd6a3d50cf009c9a2af => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:11:28.705570 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade7cdf-338a-4497-bef3-b5f29b6ef381 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:28.705859 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade7cdf-338a-4497-bef3-b5f29b6ef381 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:28.706137 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade7cdf-338a-4497-bef3-b5f29b6ef381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:28.732031 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-4ade7cdf-338a-4497-bef3-b5f29b6ef381 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:11:28.733158 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-4ade7cdf-338a-4497-bef3-b5f29b6ef381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:11:28.792574 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1344/2687] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:11:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:11:28.800323 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dcf45-0c19-4906-8070-35d9d3045092 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:28.800614 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dcf45-0c19-4906-8070-35d9d3045092 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:28.800897 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dcf45-0c19-4906-8070-35d9d3045092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:28.819816 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-7c1dcf45-0c19-4906-8070-35d9d3045092 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:11:28.821017 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-7c1dcf45-0c19-4906-8070-35d9d3045092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:11:28.828863 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1344/2688] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:11:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:11:28.833093 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade7cdf-338a-4497-bef3-b5f29b6ef381 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:11:28.842763 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade7cdf-338a-4497-bef3-b5f29b6ef381 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:11:28.847482 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20c533-77fc-4f9d-b0a3-7682dd1802ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:11:28.848157 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20c533-77fc-4f9d-b0a3-7682dd1802ae admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:28.848437 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20c533-77fc-4f9d-b0a3-7682dd1802ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:28.848709 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20c533-77fc-4f9d-b0a3-7682dd1802ae admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:28.849417 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20c533-77fc-4f9d-b0a3-7682dd1802ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:11:28.849718 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20c533-77fc-4f9d-b0a3-7682dd1802ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:11:28.851294 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20c533-77fc-4f9d-b0a3-7682dd1802ae admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:11:28.863072 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1345/2689] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:11:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:11:28.867189 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dcf45-0c19-4906-8070-35d9d3045092 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:11:28.876816 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dcf45-0c19-4906-8070-35d9d3045092 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:11:28.881465 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac956890-f109-4d64-a109-c0586c94817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:11:28.882104 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac956890-f109-4d64-a109-c0586c94817d admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:28.882388 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac956890-f109-4d64-a109-c0586c94817d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:28.882663 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac956890-f109-4d64-a109-c0586c94817d admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:28.883349 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac956890-f109-4d64-a109-c0586c94817d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:11:28.885543 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac956890-f109-4d64-a109-c0586c94817d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:11:28.919676 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1345/2690] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:11:28 2021] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:11:28.923736 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20c533-77fc-4f9d-b0a3-7682dd1802ae admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:11:28.933902 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20c533-77fc-4f9d-b0a3-7682dd1802ae admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:11:28.985950 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266eba7-9fd7-4641-9cc3-152e2098e1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:11:28.986537 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266eba7-9fd7-4641-9cc3-152e2098e1fe admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:28.986817 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266eba7-9fd7-4641-9cc3-152e2098e1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:28.987100 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266eba7-9fd7-4641-9cc3-152e2098e1fe admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:28.987784 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266eba7-9fd7-4641-9cc3-152e2098e1fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:11:28.989678 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266eba7-9fd7-4641-9cc3-152e2098e1fe admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:11:29.009885 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1346/2691] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:11:28 2021] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:11:29.014018 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac956890-f109-4d64-a109-c0586c94817d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:11:29.024131 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac956890-f109-4d64-a109-c0586c94817d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:11:29.028976 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68a06f-470d-4144-82ef-33912df0f0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:11:29.029626 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68a06f-470d-4144-82ef-33912df0f0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:29.029908 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68a06f-470d-4144-82ef-33912df0f0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:29.030183 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68a06f-470d-4144-82ef-33912df0f0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:29.030901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68a06f-470d-4144-82ef-33912df0f0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:11:29.032520 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68a06f-470d-4144-82ef-33912df0f0f8 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:11:29.042797 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1346/2692] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:11:29 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:11:29.046555 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266eba7-9fd7-4641-9cc3-152e2098e1fe admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:11:29.057060 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266eba7-9fd7-4641-9cc3-152e2098e1fe admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:11:29.061667 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42454c80-9537-4654-8880-cecb1a854f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:11:29.062314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42454c80-9537-4654-8880-cecb1a854f2b admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:29.062595 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42454c80-9537-4654-8880-cecb1a854f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:29.062870 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42454c80-9537-4654-8880-cecb1a854f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:29.063755 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42454c80-9537-4654-8880-cecb1a854f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:11:29.065600 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42454c80-9537-4654-8880-cecb1a854f2b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:11:29.076075 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1347/2693] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:11:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:11:29.080033 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68a06f-470d-4144-82ef-33912df0f0f8 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:11:29.090667 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68a06f-470d-4144-82ef-33912df0f0f8 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:11:29.095516 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bf718-1901-4e7e-8e99-8feed22e5230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:11:29.096416 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bf718-1901-4e7e-8e99-8feed22e5230 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:29.096693 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bf718-1901-4e7e-8e99-8feed22e5230 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:29.096955 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bf718-1901-4e7e-8e99-8feed22e5230 admin admin] PATH_INFO: `/v3/projects/fa73dfb9f2e94685a373532dd3bb57aa/users/2a5e98958b5349d98f1219f6f725279f/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:29.112836 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8bf718-1901-4e7e-8e99-8feed22e5230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa73dfb9f2e94685a373532dd3bb57aa, user_id=2a5e98958b5349d98f1219f6f725279f, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:11:29.115493 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8bf718-1901-4e7e-8e99-8feed22e5230 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:11:29.129336 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1347/2694] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:11:29 2021] PUT /identity/v3/projects/fa73dfb9f2e94685a373532dd3bb57aa/users/2a5e98958b5349d98f1219f6f725279f/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:11:29.135453 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208017e1-413e-47eb-bfc3-8b2c921a669d None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:29.135905 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208017e1-413e-47eb-bfc3-8b2c921a669d None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:29.136259 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208017e1-413e-47eb-bfc3-8b2c921a669d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:29.154615 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-208017e1-413e-47eb-bfc3-8b2c921a669d None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:11:29.155968 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-208017e1-413e-47eb-bfc3-8b2c921a669d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:11:29.214823 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1348/2695] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:11:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:11:29.224735 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bf718-1901-4e7e-8e99-8feed22e5230 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:11:29.226591 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-3a8bf718-1901-4e7e-8e99-8feed22e5230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:11:29.284696 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bf718-1901-4e7e-8e99-8feed22e5230 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:11:29.288494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b1d4a-99a3-4eb6-b0f7-c7a758318d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:11:29.289135 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b1d4a-99a3-4eb6-b0f7-c7a758318d14 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:29.289420 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b1d4a-99a3-4eb6-b0f7-c7a758318d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:29.289697 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b1d4a-99a3-4eb6-b0f7-c7a758318d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:29.299568 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b1d4a-99a3-4eb6-b0f7-c7a758318d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:11:29.300999 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b1d4a-99a3-4eb6-b0f7-c7a758318d14 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:11:29.310465 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1348/2696] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:11:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:11:34.757227 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a794bf4-e76c-4d11-8d82-a1aba640590f None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:34.757727 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a794bf4-e76c-4d11-8d82-a1aba640590f None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:34.757844 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a794bf4-e76c-4d11-8d82-a1aba640590f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:34.787089 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-1a794bf4-e76c-4d11-8d82-a1aba640590f None None] MFA Rules not processed for user `2a5e98958b5349d98f1219f6f725279f`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:11:34.788320 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-1a794bf4-e76c-4d11-8d82-a1aba640590f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:11:34.862217 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1349/2697] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:11:34 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:11:34.869747 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b1d4a-99a3-4eb6-b0f7-c7a758318d14 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:11:34.871965 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-9d7b1d4a-99a3-4eb6-b0f7-c7a758318d14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:11:34.958750 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b1d4a-99a3-4eb6-b0f7-c7a758318d14 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:11:34.964569 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878a6a1-ccb8-4884-a83b-a9021535d57f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:11:34.965219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878a6a1-ccb8-4884-a83b-a9021535d57f service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:34.965501 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878a6a1-ccb8-4884-a83b-a9021535d57f service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:34.965778 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878a6a1-ccb8-4884-a83b-a9021535d57f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:34.975181 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878a6a1-ccb8-4884-a83b-a9021535d57f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:11:34.976950 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878a6a1-ccb8-4884-a83b-a9021535d57f service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:11:34.987858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1349/2698] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:11:34 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:11:36.681721 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428a951-1071-4c25-b3f9-1c56787cacaa None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:36.682302 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428a951-1071-4c25-b3f9-1c56787cacaa None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:36.682302 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428a951-1071-4c25-b3f9-1c56787cacaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:36.701023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-8428a951-1071-4c25-b3f9-1c56787cacaa None None] MFA Rules not processed for user `2a5e98958b5349d98f1219f6f725279f`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:11:36.702434 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-8428a951-1071-4c25-b3f9-1c56787cacaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:11:36.709590 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1350/2699] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:11:36 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:11:37.387177 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878a6a1-ccb8-4884-a83b-a9021535d57f service nova] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:11:37.388626 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d878a6a1-ccb8-4884-a83b-a9021535d57f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:11:37.454073 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878a6a1-ccb8-4884-a83b-a9021535d57f service nova] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:11:37.458746 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50854fd1-2742-4461-a4ad-7da44fa0f541 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:11:37.459634 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50854fd1-2742-4461-a4ad-7da44fa0f541 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:37.459922 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50854fd1-2742-4461-a4ad-7da44fa0f541 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:37.460327 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50854fd1-2742-4461-a4ad-7da44fa0f541 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:37.462772 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-50854fd1-2742-4461-a4ad-7da44fa0f541 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:11:37.535269 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50854fd1-2742-4461-a4ad-7da44fa0f541 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:11:37.536811 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50854fd1-2742-4461-a4ad-7da44fa0f541 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:11:37.547673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1350/2700] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:11:37 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:11:41.873560 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e374b8-7682-4cc5-a455-d6ad4a7ba936 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:41.874464 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e374b8-7682-4cc5-a455-d6ad4a7ba936 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:41.874810 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e374b8-7682-4cc5-a455-d6ad4a7ba936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:41.894435 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-a6e374b8-7682-4cc5-a455-d6ad4a7ba936 None None] MFA Rules not processed for user `b1918e2aa8f24655875480ef52df324d`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:11:41.895742 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a6e374b8-7682-4cc5-a455-d6ad4a7ba936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:11:41.991967 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1351/2701] 10.222.0.39 () {58 vars in 968 bytes} [Tue Aug 31 03:11:41 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:11:42.020391 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50854fd1-2742-4461-a4ad-7da44fa0f541 service cinder] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:11:42.021846 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-50854fd1-2742-4461-a4ad-7da44fa0f541 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:11:42.110381 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50854fd1-2742-4461-a4ad-7da44fa0f541 service cinder] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:11:42.120524 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baf1ae-b1ec-4813-afe6-9dd5221f794f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55ed84d2e3ce4c85b552732f3294aac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:11:42.120524 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baf1ae-b1ec-4813-afe6-9dd5221f794f service swift] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:42.120524 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baf1ae-b1ec-4813-afe6-9dd5221f794f service swift] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:42.120524 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baf1ae-b1ec-4813-afe6-9dd5221f794f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:42.136705 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7baf1ae-b1ec-4813-afe6-9dd5221f794f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:11:42.138504 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7baf1ae-b1ec-4813-afe6-9dd5221f794f service swift] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:11:42.147538 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1351/2702] 10.222.0.39 () {60 vars in 1385 bytes} [Tue Aug 31 03:11:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 03:11:44.510420 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0c9a5-b0e6-4706-9b03-7a3cf2453a54 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:44.510959 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0c9a5-b0e6-4706-9b03-7a3cf2453a54 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:44.510959 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0c9a5-b0e6-4706-9b03-7a3cf2453a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:44.529095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-8bf0c9a5-b0e6-4706-9b03-7a3cf2453a54 None None] MFA Rules not processed for user `863e1031965a4bba82d345acb07e5856`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:11:44.530499 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-8bf0c9a5-b0e6-4706-9b03-7a3cf2453a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:11:44.539448 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1352/2703] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:11:44 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:11:49.846496 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baf1ae-b1ec-4813-afe6-9dd5221f794f service swift] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:11:49.846496 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f7baf1ae-b1ec-4813-afe6-9dd5221f794f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:11:49.863819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baf1ae-b1ec-4813-afe6-9dd5221f794f service swift] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:11:49.869010 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e56e22-832e-4c1b-8b68-2ae945d2a7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:11:49.870000 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e56e22-832e-4c1b-8b68-2ae945d2a7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:49.870288 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e56e22-832e-4c1b-8b68-2ae945d2a7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:49.870647 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e56e22-832e-4c1b-8b68-2ae945d2a7e7 admin admin] PATH_INFO: `/v3/users/1ecaf31185424e6aadac803e619b4c4c` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:49.871858 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e56e22-832e-4c1b-8b68-2ae945d2a7e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ecaf31185424e6aadac803e619b4c4c)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:11:49.873785 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e56e22-832e-4c1b-8b68-2ae945d2a7e7 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:11:49.925291 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-52e56e22-832e-4c1b-8b68-2ae945d2a7e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ecaf31185424e6aadac803e619b4c4c'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:49.925947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-52e56e22-832e-4c1b-8b68-2ae945d2a7e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ecaf31185424e6aadac803e619b4c4c'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:49.926559 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-52e56e22-832e-4c1b-8b68-2ae945d2a7e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ecaf31185424e6aadac803e619b4c4c'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:49.938874 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-52e56e22-832e-4c1b-8b68-2ae945d2a7e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ecaf31185424e6aadac803e619b4c4c'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:49.946150 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-52e56e22-832e-4c1b-8b68-2ae945d2a7e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ecaf31185424e6aadac803e619b4c4c'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:49.958293 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1352/2704] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:11:49 2021] DELETE /identity/v3/users/1ecaf31185424e6aadac803e619b4c4c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:11:50.206066 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0c9a5-b0e6-4706-9b03-7a3cf2453a54 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:11:50.218238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0c9a5-b0e6-4706-9b03-7a3cf2453a54 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:11:50.279511 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd186bf-7d4d-4960-8f84-c465e8fd7c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:11:50.280370 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd186bf-7d4d-4960-8f84-c465e8fd7c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:50.280652 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd186bf-7d4d-4960-8f84-c465e8fd7c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:50.280928 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd186bf-7d4d-4960-8f84-c465e8fd7c14 admin admin] PATH_INFO: `/v3/projects/db8b795cc44f4a168e4a0dffc04ab0b9` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:50.282109 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd186bf-7d4d-4960-8f84-c465e8fd7c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db8b795cc44f4a168e4a0dffc04ab0b9)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:11:50.284061 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd186bf-7d4d-4960-8f84-c465e8fd7c14 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:11:50.329378 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-dcd186bf-7d4d-4960-8f84-c465e8fd7c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db8b795cc44f4a168e4a0dffc04ab0b9', 'request_id': 'req-dcd186bf-7d4d-4960-8f84-c465e8fd7c14'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:50.334657 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-dcd186bf-7d4d-4960-8f84-c465e8fd7c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db8b795cc44f4a168e4a0dffc04ab0b9', 'request_id': 'req-dcd186bf-7d4d-4960-8f84-c465e8fd7c14'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:50.343009 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-dcd186bf-7d4d-4960-8f84-c465e8fd7c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db8b795cc44f4a168e4a0dffc04ab0b9', 'request_id': 'req-dcd186bf-7d4d-4960-8f84-c465e8fd7c14'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:50.354929 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-dcd186bf-7d4d-4960-8f84-c465e8fd7c14 admin admin] The token cache is being invalidate because project db8b795cc44f4a168e4a0dffc04ab0b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:11:50.355231 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-dcd186bf-7d4d-4960-8f84-c465e8fd7c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:50.355972 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-dcd186bf-7d4d-4960-8f84-c465e8fd7c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:50.357731 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1353/2705] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:11:50 2021] DELETE /identity/v3/projects/db8b795cc44f4a168e4a0dffc04ab0b9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:11:50.361471 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e56e22-832e-4c1b-8b68-2ae945d2a7e7 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:11:50.362884 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-52e56e22-832e-4c1b-8b68-2ae945d2a7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:11:50.375891 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e56e22-832e-4c1b-8b68-2ae945d2a7e7 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:11:50.437611 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02d02f-5828-4e00-b024-7bd23fd2c61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:11:50.438485 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02d02f-5828-4e00-b024-7bd23fd2c61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:50.438768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02d02f-5828-4e00-b024-7bd23fd2c61f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:50.439098 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02d02f-5828-4e00-b024-7bd23fd2c61f admin admin] PATH_INFO: `/v3/users/670abe069f5540c599c48e2e1805d240` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:50.440513 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02d02f-5828-4e00-b024-7bd23fd2c61f admin admin] RBAC: Authorizing `identity:delete_user(user_id=670abe069f5540c599c48e2e1805d240)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:11:50.442453 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02d02f-5828-4e00-b024-7bd23fd2c61f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:11:50.491245 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1d02d02f-5828-4e00-b024-7bd23fd2c61f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '670abe069f5540c599c48e2e1805d240'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:50.492122 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1d02d02f-5828-4e00-b024-7bd23fd2c61f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '670abe069f5540c599c48e2e1805d240'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:50.492760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1d02d02f-5828-4e00-b024-7bd23fd2c61f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '670abe069f5540c599c48e2e1805d240'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:50.509883 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1d02d02f-5828-4e00-b024-7bd23fd2c61f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '670abe069f5540c599c48e2e1805d240'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:50.516619 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-1d02d02f-5828-4e00-b024-7bd23fd2c61f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '670abe069f5540c599c48e2e1805d240'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:50.530382 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1353/2706] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:11:50 2021] DELETE /identity/v3/users/670abe069f5540c599c48e2e1805d240 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:11:50.710483 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd186bf-7d4d-4960-8f84-c465e8fd7c14 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:11:50.712020 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-dcd186bf-7d4d-4960-8f84-c465e8fd7c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:11:50.725914 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd186bf-7d4d-4960-8f84-c465e8fd7c14 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:11:50.785474 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb2047-0320-400b-9516-edb976a14023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:11:50.786335 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2047-0320-400b-9516-edb976a14023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:11:50.786614 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2047-0320-400b-9516-edb976a14023 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:11:50.786889 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2047-0320-400b-9516-edb976a14023 admin admin] PATH_INFO: `/v3/projects/33df774dcc804d46bad8867902bd09ca` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:11:50.788120 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb2047-0320-400b-9516-edb976a14023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33df774dcc804d46bad8867902bd09ca)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:11:50.790061 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb2047-0320-400b-9516-edb976a14023 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:11:50.835674 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c4fb2047-0320-400b-9516-edb976a14023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33df774dcc804d46bad8867902bd09ca', 'request_id': 'req-c4fb2047-0320-400b-9516-edb976a14023'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:50.841705 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c4fb2047-0320-400b-9516-edb976a14023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33df774dcc804d46bad8867902bd09ca', 'request_id': 'req-c4fb2047-0320-400b-9516-edb976a14023'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:50.850809 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c4fb2047-0320-400b-9516-edb976a14023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33df774dcc804d46bad8867902bd09ca', 'request_id': 'req-c4fb2047-0320-400b-9516-edb976a14023'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:50.861777 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c4fb2047-0320-400b-9516-edb976a14023 admin admin] The token cache is being invalidate because project 33df774dcc804d46bad8867902bd09ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:11:50.862066 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c4fb2047-0320-400b-9516-edb976a14023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:50.862699 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-c4fb2047-0320-400b-9516-edb976a14023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:11:50.864271 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1354/2707] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:11:50 2021] DELETE /identity/v3/projects/33df774dcc804d46bad8867902bd09ca => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:12:14.841057 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02d02f-5828-4e00-b024-7bd23fd2c61f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:12:14.842455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1d02d02f-5828-4e00-b024-7bd23fd2c61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:12:14.908916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02d02f-5828-4e00-b024-7bd23fd2c61f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:12:14.963420 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e39254-5836-4586-a532-4f6b2ff66bfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcf0359f8bc4f55be3307f235f8aac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:12:14.964674 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e39254-5836-4586-a532-4f6b2ff66bfa service placement] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:12:14.964948 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e39254-5836-4586-a532-4f6b2ff66bfa service placement] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:12:14.965219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e39254-5836-4586-a532-4f6b2ff66bfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:12:14.966944 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-76e39254-5836-4586-a532-4f6b2ff66bfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:12:14.977488 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e39254-5836-4586-a532-4f6b2ff66bfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:12:14.979031 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e39254-5836-4586-a532-4f6b2ff66bfa service placement] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:12:14.989222 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1354/2708] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:12:14 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:12:48.509684 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb2047-0320-400b-9516-edb976a14023 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:12:48.511443 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-c4fb2047-0320-400b-9516-edb976a14023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:12:48.568261 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb2047-0320-400b-9516-edb976a14023 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:12:48.571916 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c545a2-9879-4311-8215-e5af3a73f40b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:12:48.572556 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c545a2-9879-4311-8215-e5af3a73f40b service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:12:48.572842 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c545a2-9879-4311-8215-e5af3a73f40b service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:12:48.573122 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c545a2-9879-4311-8215-e5af3a73f40b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:12:48.574929 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-64c545a2-9879-4311-8215-e5af3a73f40b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:12:48.636754 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c545a2-9879-4311-8215-e5af3a73f40b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:12:48.638682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c545a2-9879-4311-8215-e5af3a73f40b service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:12:48.648347 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1355/2709] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:12:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:12:52.563768 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e39254-5836-4586-a532-4f6b2ff66bfa service placement] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:12:52.565280 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-76e39254-5836-4586-a532-4f6b2ff66bfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:12:52.585509 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e39254-5836-4586-a532-4f6b2ff66bfa service placement] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:12:52.590057 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4811e0-fb81-4424-8f72-7aa7b6f5269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:12:52.590921 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4811e0-fb81-4424-8f72-7aa7b6f5269a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:12:52.591200 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4811e0-fb81-4424-8f72-7aa7b6f5269a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:12:52.591646 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4811e0-fb81-4424-8f72-7aa7b6f5269a admin admin] PATH_INFO: `/v3/users/b49460aabd874a378370c3ddc9cfa704` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:12:52.592832 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4811e0-fb81-4424-8f72-7aa7b6f5269a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b49460aabd874a378370c3ddc9cfa704)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:12:52.594726 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4811e0-fb81-4424-8f72-7aa7b6f5269a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:12:52.639992 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2d4811e0-fb81-4424-8f72-7aa7b6f5269a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b49460aabd874a378370c3ddc9cfa704'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:52.640573 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2d4811e0-fb81-4424-8f72-7aa7b6f5269a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b49460aabd874a378370c3ddc9cfa704'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:52.641187 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2d4811e0-fb81-4424-8f72-7aa7b6f5269a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b49460aabd874a378370c3ddc9cfa704'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:52.652377 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2d4811e0-fb81-4424-8f72-7aa7b6f5269a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b49460aabd874a378370c3ddc9cfa704'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:52.659052 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-2d4811e0-fb81-4424-8f72-7aa7b6f5269a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b49460aabd874a378370c3ddc9cfa704'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:52.671216 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1355/2710] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:12:52 2021] DELETE /identity/v3/users/b49460aabd874a378370c3ddc9cfa704 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:12:52.842374 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c545a2-9879-4311-8215-e5af3a73f40b service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:12:52.852331 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c545a2-9879-4311-8215-e5af3a73f40b service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:12:52.908272 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a856bd-e929-4257-bcab-4f17c2dffa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:12:52.909058 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a856bd-e929-4257-bcab-4f17c2dffa06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:12:52.909343 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a856bd-e929-4257-bcab-4f17c2dffa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:12:52.909617 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a856bd-e929-4257-bcab-4f17c2dffa06 admin admin] PATH_INFO: `/v3/projects/14b6381710ab43a399d108dbe1d67a1c` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:12:52.910786 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a856bd-e929-4257-bcab-4f17c2dffa06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14b6381710ab43a399d108dbe1d67a1c)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:12:52.912715 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a856bd-e929-4257-bcab-4f17c2dffa06 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:12:52.957579 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-a6a856bd-e929-4257-bcab-4f17c2dffa06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14b6381710ab43a399d108dbe1d67a1c', 'request_id': 'req-a6a856bd-e929-4257-bcab-4f17c2dffa06'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:52.962997 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-a6a856bd-e929-4257-bcab-4f17c2dffa06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14b6381710ab43a399d108dbe1d67a1c', 'request_id': 'req-a6a856bd-e929-4257-bcab-4f17c2dffa06'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:52.969982 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-a6a856bd-e929-4257-bcab-4f17c2dffa06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14b6381710ab43a399d108dbe1d67a1c', 'request_id': 'req-a6a856bd-e929-4257-bcab-4f17c2dffa06'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:52.980946 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-a6a856bd-e929-4257-bcab-4f17c2dffa06 admin admin] The token cache is being invalidate because project 14b6381710ab43a399d108dbe1d67a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:12:52.981253 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-a6a856bd-e929-4257-bcab-4f17c2dffa06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:52.981846 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-a6a856bd-e929-4257-bcab-4f17c2dffa06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:52.983381 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1356/2711] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:12:52 2021] DELETE /identity/v3/projects/14b6381710ab43a399d108dbe1d67a1c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:12:52.987541 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4811e0-fb81-4424-8f72-7aa7b6f5269a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:12:52.988918 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-2d4811e0-fb81-4424-8f72-7aa7b6f5269a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:12:53.002193 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4811e0-fb81-4424-8f72-7aa7b6f5269a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:12:53.055871 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31b612-540b-478b-a84a-231799bbe601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:12:53.056735 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31b612-540b-478b-a84a-231799bbe601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:12:53.057013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31b612-540b-478b-a84a-231799bbe601 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:12:53.057285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31b612-540b-478b-a84a-231799bbe601 admin admin] PATH_INFO: `/v3/users/e0f24343057c41a985280477785081bd` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:12:53.058433 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31b612-540b-478b-a84a-231799bbe601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f24343057c41a985280477785081bd)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:12:53.061283 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31b612-540b-478b-a84a-231799bbe601 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:12:53.104766 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-0c31b612-540b-478b-a84a-231799bbe601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f24343057c41a985280477785081bd'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:53.105450 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-0c31b612-540b-478b-a84a-231799bbe601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f24343057c41a985280477785081bd'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:53.106372 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-0c31b612-540b-478b-a84a-231799bbe601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f24343057c41a985280477785081bd'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:53.117538 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-0c31b612-540b-478b-a84a-231799bbe601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f24343057c41a985280477785081bd'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:53.124984 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-0c31b612-540b-478b-a84a-231799bbe601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f24343057c41a985280477785081bd'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:53.138187 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1356/2712] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:12:52 2021] DELETE /identity/v3/users/e0f24343057c41a985280477785081bd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:12:53.312772 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a856bd-e929-4257-bcab-4f17c2dffa06 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:12:53.314259 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a6a856bd-e929-4257-bcab-4f17c2dffa06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:12:53.327592 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a856bd-e929-4257-bcab-4f17c2dffa06 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:12:53.384421 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9ca89-2d21-4817-b976-0e60473dc27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:12:53.385525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9ca89-2d21-4817-b976-0e60473dc27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:12:53.385800 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9ca89-2d21-4817-b976-0e60473dc27e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:12:53.386072 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9ca89-2d21-4817-b976-0e60473dc27e admin admin] PATH_INFO: `/v3/projects/5dff8ce800d545b1bef70e9f100eb50a` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:12:53.387303 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9ca89-2d21-4817-b976-0e60473dc27e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dff8ce800d545b1bef70e9f100eb50a)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:12:53.389221 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9ca89-2d21-4817-b976-0e60473dc27e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:12:53.433113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-21e9ca89-2d21-4817-b976-0e60473dc27e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dff8ce800d545b1bef70e9f100eb50a', 'request_id': 'req-21e9ca89-2d21-4817-b976-0e60473dc27e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:53.438958 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-21e9ca89-2d21-4817-b976-0e60473dc27e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dff8ce800d545b1bef70e9f100eb50a', 'request_id': 'req-21e9ca89-2d21-4817-b976-0e60473dc27e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:53.446023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-21e9ca89-2d21-4817-b976-0e60473dc27e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dff8ce800d545b1bef70e9f100eb50a', 'request_id': 'req-21e9ca89-2d21-4817-b976-0e60473dc27e'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:53.456855 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-21e9ca89-2d21-4817-b976-0e60473dc27e admin admin] The token cache is being invalidate because project 5dff8ce800d545b1bef70e9f100eb50a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:12:53.457138 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-21e9ca89-2d21-4817-b976-0e60473dc27e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:53.457754 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-21e9ca89-2d21-4817-b976-0e60473dc27e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:12:53.459279 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1357/2713] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:12:53 2021] DELETE /identity/v3/projects/5dff8ce800d545b1bef70e9f100eb50a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:13:48.957834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31b612-540b-478b-a84a-231799bbe601 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:13:48.959241 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0c31b612-540b-478b-a84a-231799bbe601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:13:49.015041 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31b612-540b-478b-a84a-231799bbe601 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:13:49.061438 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3a3f2-84cc-4081-a72c-e3b9a89dec7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:13:49.062085 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3a3f2-84cc-4081-a72c-e3b9a89dec7a service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:13:49.062368 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3a3f2-84cc-4081-a72c-e3b9a89dec7a service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:13:49.062642 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3a3f2-84cc-4081-a72c-e3b9a89dec7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:13:49.064410 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-83f3a3f2-84cc-4081-a72c-e3b9a89dec7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:13:49.124311 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3a3f2-84cc-4081-a72c-e3b9a89dec7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:13:49.125745 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3a3f2-84cc-4081-a72c-e3b9a89dec7a service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:13:49.135223 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1357/2714] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:13:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:13:55.472112 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9ca89-2d21-4817-b976-0e60473dc27e admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:13:55.473624 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-21e9ca89-2d21-4817-b976-0e60473dc27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:13:55.487491 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9ca89-2d21-4817-b976-0e60473dc27e admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:13:55.492252 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd95415-46a4-44cb-b685-2d80224b5b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:13:55.493201 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd95415-46a4-44cb-b685-2d80224b5b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:13:55.493420 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd95415-46a4-44cb-b685-2d80224b5b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:13:55.493698 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd95415-46a4-44cb-b685-2d80224b5b2f admin admin] PATH_INFO: `/v3/users/863e1031965a4bba82d345acb07e5856` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:13:55.494901 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd95415-46a4-44cb-b685-2d80224b5b2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=863e1031965a4bba82d345acb07e5856)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:13:55.497401 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd95415-46a4-44cb-b685-2d80224b5b2f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:13:55.542037 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4cd95415-46a4-44cb-b685-2d80224b5b2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '863e1031965a4bba82d345acb07e5856'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:55.556570 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4cd95415-46a4-44cb-b685-2d80224b5b2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '863e1031965a4bba82d345acb07e5856'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:55.557251 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4cd95415-46a4-44cb-b685-2d80224b5b2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '863e1031965a4bba82d345acb07e5856'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:55.564388 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4cd95415-46a4-44cb-b685-2d80224b5b2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '863e1031965a4bba82d345acb07e5856'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:55.571472 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-4cd95415-46a4-44cb-b685-2d80224b5b2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '863e1031965a4bba82d345acb07e5856'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:55.577883 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1358/2715] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:13:55 2021] DELETE /identity/v3/users/863e1031965a4bba82d345acb07e5856 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:13:55.743305 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3a3f2-84cc-4081-a72c-e3b9a89dec7a service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:13:55.755311 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3a3f2-84cc-4081-a72c-e3b9a89dec7a service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:13:55.811205 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43721509-2eee-4ccd-8bcc-9ec8cae0e6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:13:55.812082 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43721509-2eee-4ccd-8bcc-9ec8cae0e6d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:13:55.812370 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43721509-2eee-4ccd-8bcc-9ec8cae0e6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:13:55.812646 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43721509-2eee-4ccd-8bcc-9ec8cae0e6d6 admin admin] PATH_INFO: `/v3/projects/1cb7442f56da4ed08bd964a5cd5af18f` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:13:55.813811 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43721509-2eee-4ccd-8bcc-9ec8cae0e6d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb7442f56da4ed08bd964a5cd5af18f)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:13:55.815748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43721509-2eee-4ccd-8bcc-9ec8cae0e6d6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:13:55.859943 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-43721509-2eee-4ccd-8bcc-9ec8cae0e6d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb7442f56da4ed08bd964a5cd5af18f', 'request_id': 'req-43721509-2eee-4ccd-8bcc-9ec8cae0e6d6'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:55.865653 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-43721509-2eee-4ccd-8bcc-9ec8cae0e6d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb7442f56da4ed08bd964a5cd5af18f', 'request_id': 'req-43721509-2eee-4ccd-8bcc-9ec8cae0e6d6'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:55.870886 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-43721509-2eee-4ccd-8bcc-9ec8cae0e6d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb7442f56da4ed08bd964a5cd5af18f', 'request_id': 'req-43721509-2eee-4ccd-8bcc-9ec8cae0e6d6'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:55.883143 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-43721509-2eee-4ccd-8bcc-9ec8cae0e6d6 admin admin] The token cache is being invalidate because project 1cb7442f56da4ed08bd964a5cd5af18f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:13:55.883447 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-43721509-2eee-4ccd-8bcc-9ec8cae0e6d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:55.884093 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-43721509-2eee-4ccd-8bcc-9ec8cae0e6d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:55.885592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1358/2716] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:13:55 2021] DELETE /identity/v3/projects/1cb7442f56da4ed08bd964a5cd5af18f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:13:55.890023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd95415-46a4-44cb-b685-2d80224b5b2f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:13:55.891426 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-4cd95415-46a4-44cb-b685-2d80224b5b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:13:55.904360 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd95415-46a4-44cb-b685-2d80224b5b2f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:13:55.960855 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017555f7-c160-407a-8593-f602c44b4bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:13:55.961756 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017555f7-c160-407a-8593-f602c44b4bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:13:55.962039 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017555f7-c160-407a-8593-f602c44b4bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:13:55.962315 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017555f7-c160-407a-8593-f602c44b4bd1 admin admin] PATH_INFO: `/v3/users/3262df9719f84bd39b7941076a3f527a` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:13:55.963552 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017555f7-c160-407a-8593-f602c44b4bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3262df9719f84bd39b7941076a3f527a)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:13:55.966012 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017555f7-c160-407a-8593-f602c44b4bd1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:13:56.012308 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-017555f7-c160-407a-8593-f602c44b4bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3262df9719f84bd39b7941076a3f527a'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:56.023784 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-017555f7-c160-407a-8593-f602c44b4bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3262df9719f84bd39b7941076a3f527a'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:56.024471 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-017555f7-c160-407a-8593-f602c44b4bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3262df9719f84bd39b7941076a3f527a'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:56.031918 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-017555f7-c160-407a-8593-f602c44b4bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3262df9719f84bd39b7941076a3f527a'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:56.038963 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-017555f7-c160-407a-8593-f602c44b4bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3262df9719f84bd39b7941076a3f527a'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:56.046448 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1359/2717] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:13:55 2021] DELETE /identity/v3/users/3262df9719f84bd39b7941076a3f527a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:13:56.214445 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43721509-2eee-4ccd-8bcc-9ec8cae0e6d6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:13:56.216945 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-43721509-2eee-4ccd-8bcc-9ec8cae0e6d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:13:56.229764 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43721509-2eee-4ccd-8bcc-9ec8cae0e6d6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:13:56.287285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d69cea-833a-4ee8-9c7e-88110f52f92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:13:56.288176 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d69cea-833a-4ee8-9c7e-88110f52f92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:13:56.288460 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d69cea-833a-4ee8-9c7e-88110f52f92a admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:13:56.288736 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d69cea-833a-4ee8-9c7e-88110f52f92a admin admin] PATH_INFO: `/v3/projects/94900671da2f46c8b89002501fb08336` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:13:56.289916 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d69cea-833a-4ee8-9c7e-88110f52f92a admin admin] RBAC: Authorizing `identity:delete_project(project_id=94900671da2f46c8b89002501fb08336)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:13:56.291863 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d69cea-833a-4ee8-9c7e-88110f52f92a admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:13:56.336292 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b7d69cea-833a-4ee8-9c7e-88110f52f92a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94900671da2f46c8b89002501fb08336', 'request_id': 'req-b7d69cea-833a-4ee8-9c7e-88110f52f92a'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:56.342771 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b7d69cea-833a-4ee8-9c7e-88110f52f92a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94900671da2f46c8b89002501fb08336', 'request_id': 'req-b7d69cea-833a-4ee8-9c7e-88110f52f92a'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:56.347989 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b7d69cea-833a-4ee8-9c7e-88110f52f92a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94900671da2f46c8b89002501fb08336', 'request_id': 'req-b7d69cea-833a-4ee8-9c7e-88110f52f92a'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:56.359665 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b7d69cea-833a-4ee8-9c7e-88110f52f92a admin admin] The token cache is being invalidate because project 94900671da2f46c8b89002501fb08336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:13:56.359954 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b7d69cea-833a-4ee8-9c7e-88110f52f92a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:56.360578 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b7d69cea-833a-4ee8-9c7e-88110f52f92a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:13:56.362087 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1359/2718] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:13:56 2021] DELETE /identity/v3/projects/94900671da2f46c8b89002501fb08336 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:14:16.514804 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017555f7-c160-407a-8593-f602c44b4bd1 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:14:16.516298 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-017555f7-c160-407a-8593-f602c44b4bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:14:16.577021 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017555f7-c160-407a-8593-f602c44b4bd1 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:14:16.616087 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d69cea-833a-4ee8-9c7e-88110f52f92a admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:14:16.617553 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b7d69cea-833a-4ee8-9c7e-88110f52f92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:14:16.626369 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fa8e1-a748-4686-87b4-843bd6581e9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:14:16.627029 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fa8e1-a748-4686-87b4-843bd6581e9d service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:14:16.627315 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fa8e1-a748-4686-87b4-843bd6581e9d service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:14:16.627613 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fa8e1-a748-4686-87b4-843bd6581e9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:14:16.629364 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ba8fa8e1-a748-4686-87b4-843bd6581e9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:14:16.639264 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fa8e1-a748-4686-87b4-843bd6581e9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:14:16.640957 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fa8e1-a748-4686-87b4-843bd6581e9d service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:14:16.650121 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1360/2719] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:14:16 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:14:16.679751 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d69cea-833a-4ee8-9c7e-88110f52f92a admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:14:16.683382 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80885ae-dcb1-4eda-9933-53234edc3acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:14:16.684031 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80885ae-dcb1-4eda-9933-53234edc3acf service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:14:16.684318 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80885ae-dcb1-4eda-9933-53234edc3acf service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:14:16.684596 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80885ae-dcb1-4eda-9933-53234edc3acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:14:16.686933 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d80885ae-dcb1-4eda-9933-53234edc3acf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:14:16.758762 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80885ae-dcb1-4eda-9933-53234edc3acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:14:16.760249 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80885ae-dcb1-4eda-9933-53234edc3acf service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:14:16.771814 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1360/2720] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:14:16 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:14:18.042269 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fa8e1-a748-4686-87b4-843bd6581e9d service neutron] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:14:18.043696 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-ba8fa8e1-a748-4686-87b4-843bd6581e9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:14:18.054227 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fa8e1-a748-4686-87b4-843bd6581e9d service neutron] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:14:18.057882 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a71f1-5892-43df-bbfa-c4d42b48e886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:14:18.058510 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a71f1-5892-43df-bbfa-c4d42b48e886 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:14:18.058789 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a71f1-5892-43df-bbfa-c4d42b48e886 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:14:18.059061 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a71f1-5892-43df-bbfa-c4d42b48e886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:14:18.060780 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-cd8a71f1-5892-43df-bbfa-c4d42b48e886 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:14:18.073959 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a71f1-5892-43df-bbfa-c4d42b48e886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:14:18.075486 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a71f1-5892-43df-bbfa-c4d42b48e886 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:14:18.086402 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1361/2721] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:14:18 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:14:19.361603 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80885ae-dcb1-4eda-9933-53234edc3acf service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:14:19.363974 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-d80885ae-dcb1-4eda-9933-53234edc3acf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:14:19.388380 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80885ae-dcb1-4eda-9933-53234edc3acf service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:14:19.397422 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8633f4-3bad-4547-a6c5-8e5ab944c611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:14:19.398496 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8633f4-3bad-4547-a6c5-8e5ab944c611 service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:14:19.398984 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8633f4-3bad-4547-a6c5-8e5ab944c611 service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:14:19.399497 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8633f4-3bad-4547-a6c5-8e5ab944c611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:14:19.402580 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-cc8633f4-3bad-4547-a6c5-8e5ab944c611 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:14:19.424673 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8633f4-3bad-4547-a6c5-8e5ab944c611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:14:19.427760 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8633f4-3bad-4547-a6c5-8e5ab944c611 service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:14:19.449309 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1361/2722] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:14:19 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:14:22.334159 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5936e-bc63-4e79-ad64-3c8eeb6925eb None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:14:22.334678 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5936e-bc63-4e79-ad64-3c8eeb6925eb None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:14:22.334779 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5936e-bc63-4e79-ad64-3c8eeb6925eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:14:22.352087 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-19d5936e-bc63-4e79-ad64-3c8eeb6925eb None None] MFA Rules not processed for user `2a5e98958b5349d98f1219f6f725279f`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:14:22.353280 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-19d5936e-bc63-4e79-ad64-3c8eeb6925eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:14:22.408690 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1362/2723] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:14:22 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:14:33.255543 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8633f4-3bad-4547-a6c5-8e5ab944c611 service nova] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:14:33.267653 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8633f4-3bad-4547-a6c5-8e5ab944c611 service nova] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:14:33.273578 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207d4aa-15a4-4ebd-aa94-6bdba3bbb747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:14:33.274297 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207d4aa-15a4-4ebd-aa94-6bdba3bbb747 service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:14:33.274647 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207d4aa-15a4-4ebd-aa94-6bdba3bbb747 service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:14:33.275000 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207d4aa-15a4-4ebd-aa94-6bdba3bbb747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:14:33.276921 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b207d4aa-15a4-4ebd-aa94-6bdba3bbb747 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:14:33.289778 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207d4aa-15a4-4ebd-aa94-6bdba3bbb747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:14:33.291504 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207d4aa-15a4-4ebd-aa94-6bdba3bbb747 service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:14:33.303182 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1362/2724] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:14:33 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:15:40.426526 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5936e-bc63-4e79-ad64-3c8eeb6925eb None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:40.428164 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-19d5936e-bc63-4e79-ad64-3c8eeb6925eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:15:40.496175 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5936e-bc63-4e79-ad64-3c8eeb6925eb None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:40.500786 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a858c3-1186-401d-9508-79bedbe3da00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:40.502394 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a858c3-1186-401d-9508-79bedbe3da00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:40.502672 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a858c3-1186-401d-9508-79bedbe3da00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:40.502943 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a858c3-1186-401d-9508-79bedbe3da00 admin admin] PATH_INFO: `/v3/users/2a5e98958b5349d98f1219f6f725279f` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:40.504147 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a858c3-1186-401d-9508-79bedbe3da00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a5e98958b5349d98f1219f6f725279f)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:40.506057 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a858c3-1186-401d-9508-79bedbe3da00 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:40.550522 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d4a858c3-1186-401d-9508-79bedbe3da00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a5e98958b5349d98f1219f6f725279f'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:40.561880 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d4a858c3-1186-401d-9508-79bedbe3da00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a5e98958b5349d98f1219f6f725279f'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:40.562545 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d4a858c3-1186-401d-9508-79bedbe3da00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a5e98958b5349d98f1219f6f725279f'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:40.569670 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d4a858c3-1186-401d-9508-79bedbe3da00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a5e98958b5349d98f1219f6f725279f'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:40.576717 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-d4a858c3-1186-401d-9508-79bedbe3da00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a5e98958b5349d98f1219f6f725279f'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:40.582646 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1363/2725] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:15:40 2021] DELETE /identity/v3/users/2a5e98958b5349d98f1219f6f725279f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:15:40.755462 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207d4aa-15a4-4ebd-aa94-6bdba3bbb747 service nova] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:40.768011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207d4aa-15a4-4ebd-aa94-6bdba3bbb747 service nova] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:40.822674 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68267b-e665-449f-b32e-d6718ded36a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:40.823550 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68267b-e665-449f-b32e-d6718ded36a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:40.823834 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68267b-e665-449f-b32e-d6718ded36a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:40.824317 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68267b-e665-449f-b32e-d6718ded36a9 admin admin] PATH_INFO: `/v3/projects/fa73dfb9f2e94685a373532dd3bb57aa` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:40.825289 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68267b-e665-449f-b32e-d6718ded36a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa73dfb9f2e94685a373532dd3bb57aa)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:40.827242 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68267b-e665-449f-b32e-d6718ded36a9 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:40.871434 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8b68267b-e665-449f-b32e-d6718ded36a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa73dfb9f2e94685a373532dd3bb57aa', 'request_id': 'req-8b68267b-e665-449f-b32e-d6718ded36a9'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:40.877559 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8b68267b-e665-449f-b32e-d6718ded36a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa73dfb9f2e94685a373532dd3bb57aa', 'request_id': 'req-8b68267b-e665-449f-b32e-d6718ded36a9'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:40.882788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8b68267b-e665-449f-b32e-d6718ded36a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa73dfb9f2e94685a373532dd3bb57aa', 'request_id': 'req-8b68267b-e665-449f-b32e-d6718ded36a9'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:40.895577 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8b68267b-e665-449f-b32e-d6718ded36a9 admin admin] The token cache is being invalidate because project fa73dfb9f2e94685a373532dd3bb57aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:15:40.895909 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8b68267b-e665-449f-b32e-d6718ded36a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:40.896530 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-8b68267b-e665-449f-b32e-d6718ded36a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:40.898039 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1363/2726] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:15:40 2021] DELETE /identity/v3/projects/fa73dfb9f2e94685a373532dd3bb57aa => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:15:40.904251 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728304a8-012e-43d4-a7ab-3520370f6254 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:40.904526 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728304a8-012e-43d4-a7ab-3520370f6254 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:40.904798 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728304a8-012e-43d4-a7ab-3520370f6254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:40.923768 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-728304a8-012e-43d4-a7ab-3520370f6254 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:15:40.925062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-728304a8-012e-43d4-a7ab-3520370f6254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:15:40.981439 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1364/2727] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:15:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:15:40.990554 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607cc14-f76a-4faf-a7f7-3fa0b17682e9 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:40.990848 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607cc14-f76a-4faf-a7f7-3fa0b17682e9 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:40.991127 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607cc14-f76a-4faf-a7f7-3fa0b17682e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:41.009172 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-0607cc14-f76a-4faf-a7f7-3fa0b17682e9 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:15:41.010363 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0607cc14-f76a-4faf-a7f7-3fa0b17682e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:15:41.018416 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1364/2728] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:15:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:15:41.022513 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728304a8-012e-43d4-a7ab-3520370f6254 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:41.031996 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728304a8-012e-43d4-a7ab-3520370f6254 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:41.037137 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ed587-f939-4377-9e6c-c66ecfd1be6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:41.037809 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ed587-f939-4377-9e6c-c66ecfd1be6f admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:41.038092 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ed587-f939-4377-9e6c-c66ecfd1be6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:41.038370 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ed587-f939-4377-9e6c-c66ecfd1be6f admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:41.039087 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ed587-f939-4377-9e6c-c66ecfd1be6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:15:41.039424 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ed587-f939-4377-9e6c-c66ecfd1be6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:41.041023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ed587-f939-4377-9e6c-c66ecfd1be6f admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:41.052880 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1365/2729] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:15:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:15:41.057012 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607cc14-f76a-4faf-a7f7-3fa0b17682e9 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:41.065837 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607cc14-f76a-4faf-a7f7-3fa0b17682e9 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:41.070465 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18623528-fbec-4e35-8b55-c5abca504e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:41.071099 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18623528-fbec-4e35-8b55-c5abca504e0d admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:41.071408 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18623528-fbec-4e35-8b55-c5abca504e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:41.071691 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18623528-fbec-4e35-8b55-c5abca504e0d admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:41.072362 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18623528-fbec-4e35-8b55-c5abca504e0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:41.074231 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18623528-fbec-4e35-8b55-c5abca504e0d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:41.098831 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1365/2730] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:15:41 2021] POST /identity/v3/projects => generated 385 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:15:41.102948 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ed587-f939-4377-9e6c-c66ecfd1be6f admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:41.113402 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ed587-f939-4377-9e6c-c66ecfd1be6f admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:41.167793 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c07cb2-e2f3-45e7-bcc0-31320e2c4d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:41.168461 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c07cb2-e2f3-45e7-bcc0-31320e2c4d7c admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:41.168745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c07cb2-e2f3-45e7-bcc0-31320e2c4d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:41.169018 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c07cb2-e2f3-45e7-bcc0-31320e2c4d7c admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:41.169690 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c07cb2-e2f3-45e7-bcc0-31320e2c4d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:41.171623 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c07cb2-e2f3-45e7-bcc0-31320e2c4d7c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:41.190898 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1366/2731] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:15:41 2021] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:15:41.194920 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18623528-fbec-4e35-8b55-c5abca504e0d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:41.205880 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18623528-fbec-4e35-8b55-c5abca504e0d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:41.210411 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44085322-8b35-4361-b155-ec37de9aed65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:41.211051 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085322-8b35-4361-b155-ec37de9aed65 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:41.211331 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085322-8b35-4361-b155-ec37de9aed65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:41.211631 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085322-8b35-4361-b155-ec37de9aed65 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:41.212339 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44085322-8b35-4361-b155-ec37de9aed65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:41.213901 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44085322-8b35-4361-b155-ec37de9aed65 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:41.224840 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1366/2732] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:15:41 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:15:41.228573 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c07cb2-e2f3-45e7-bcc0-31320e2c4d7c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:41.238911 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c07cb2-e2f3-45e7-bcc0-31320e2c4d7c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:41.243866 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344348d1-ac09-49b0-b2dc-17d9dff73cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:41.244523 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344348d1-ac09-49b0-b2dc-17d9dff73cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:41.244806 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344348d1-ac09-49b0-b2dc-17d9dff73cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:41.245083 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344348d1-ac09-49b0-b2dc-17d9dff73cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:41.245797 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344348d1-ac09-49b0-b2dc-17d9dff73cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:41.247407 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344348d1-ac09-49b0-b2dc-17d9dff73cd1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:41.257073 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1367/2733] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:15:41 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:15:41.261074 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44085322-8b35-4361-b155-ec37de9aed65 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:41.271676 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44085322-8b35-4361-b155-ec37de9aed65 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:41.276268 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144001fc-e494-43b9-b973-4879c5203799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:41.277127 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144001fc-e494-43b9-b973-4879c5203799 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:41.277405 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144001fc-e494-43b9-b973-4879c5203799 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:41.277678 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144001fc-e494-43b9-b973-4879c5203799 admin admin] PATH_INFO: `/v3/projects/27d04019cf304c06af9067d803df5e3c/users/29458c54c28f4858962bb5a44483c1aa/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:41.292336 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144001fc-e494-43b9-b973-4879c5203799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d04019cf304c06af9067d803df5e3c, user_id=29458c54c28f4858962bb5a44483c1aa, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:41.294953 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144001fc-e494-43b9-b973-4879c5203799 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:41.307437 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1367/2734] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:15:41 2021] PUT /identity/v3/projects/27d04019cf304c06af9067d803df5e3c/users/29458c54c28f4858962bb5a44483c1aa/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:15:41.318441 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d9d49-6069-451a-b6f8-f896134544ad None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:41.318738 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d9d49-6069-451a-b6f8-f896134544ad None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:41.319019 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d9d49-6069-451a-b6f8-f896134544ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:41.346027 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-640d9d49-6069-451a-b6f8-f896134544ad None None] MFA Rules not processed for user `29458c54c28f4858962bb5a44483c1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:15:41.347232 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-640d9d49-6069-451a-b6f8-f896134544ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:15:41.409276 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1368/2735] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:15:41 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:15:41.420617 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144001fc-e494-43b9-b973-4879c5203799 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:41.422265 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-144001fc-e494-43b9-b973-4879c5203799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:15:41.492582 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144001fc-e494-43b9-b973-4879c5203799 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:41.498065 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc3f5b-e1f3-4593-8e72-67d557a04b1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6bb852fc4394f88800ec9616cb65416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:41.498780 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc3f5b-e1f3-4593-8e72-67d557a04b1d service nova] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:41.499062 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc3f5b-e1f3-4593-8e72-67d557a04b1d service nova] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:41.499337 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc3f5b-e1f3-4593-8e72-67d557a04b1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:41.507101 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc3f5b-e1f3-4593-8e72-67d557a04b1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:41.508685 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc3f5b-e1f3-4593-8e72-67d557a04b1d service nova] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:41.518435 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1368/2736] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:15:41 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:15:48.717619 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d9d49-6069-451a-b6f8-f896134544ad None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:48.776984 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d9d49-6069-451a-b6f8-f896134544ad None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:48.781546 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfdefb-92e8-4af5-8a90-11657485cc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:48.782403 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfdefb-92e8-4af5-8a90-11657485cc89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:48.782689 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfdefb-92e8-4af5-8a90-11657485cc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:48.782965 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfdefb-92e8-4af5-8a90-11657485cc89 admin admin] PATH_INFO: `/v3/users/29458c54c28f4858962bb5a44483c1aa` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:48.784770 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfdefb-92e8-4af5-8a90-11657485cc89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29458c54c28f4858962bb5a44483c1aa)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:48.786680 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfdefb-92e8-4af5-8a90-11657485cc89 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:48.828649 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b9bfdefb-92e8-4af5-8a90-11657485cc89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29458c54c28f4858962bb5a44483c1aa'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:48.840738 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b9bfdefb-92e8-4af5-8a90-11657485cc89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29458c54c28f4858962bb5a44483c1aa'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:48.841414 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b9bfdefb-92e8-4af5-8a90-11657485cc89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29458c54c28f4858962bb5a44483c1aa'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:48.848647 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b9bfdefb-92e8-4af5-8a90-11657485cc89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29458c54c28f4858962bb5a44483c1aa'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:48.855300 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-b9bfdefb-92e8-4af5-8a90-11657485cc89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29458c54c28f4858962bb5a44483c1aa'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:48.861021 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1369/2737] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:15:48 2021] DELETE /identity/v3/users/29458c54c28f4858962bb5a44483c1aa => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:15:48.865624 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215456f-6de2-4db1-b286-d5166a4cf42c None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:48.866116 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215456f-6de2-4db1-b286-d5166a4cf42c None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:48.866240 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215456f-6de2-4db1-b286-d5166a4cf42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:48.883330 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-0215456f-6de2-4db1-b286-d5166a4cf42c None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:15:48.884544 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0215456f-6de2-4db1-b286-d5166a4cf42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:15:48.941882 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1369/2738] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:15:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:15:48.954343 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfdefb-92e8-4af5-8a90-11657485cc89 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:48.956373 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-b9bfdefb-92e8-4af5-8a90-11657485cc89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:15:49.010022 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfdefb-92e8-4af5-8a90-11657485cc89 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:49.013879 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829f87a-6aa1-415a-b314-fe9e34470ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:49.014512 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829f87a-6aa1-415a-b314-fe9e34470ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:49.014790 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829f87a-6aa1-415a-b314-fe9e34470ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:49.015060 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829f87a-6aa1-415a-b314-fe9e34470ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:49.024670 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829f87a-6aa1-415a-b314-fe9e34470ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:49.026075 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829f87a-6aa1-415a-b314-fe9e34470ea5 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:49.035851 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1370/2739] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:15:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:15:49.313636 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215456f-6de2-4db1-b286-d5166a4cf42c None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:49.315608 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-0215456f-6de2-4db1-b286-d5166a4cf42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:15:49.327463 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215456f-6de2-4db1-b286-d5166a4cf42c None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:49.332874 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d281fd-2b9a-4c3d-88b6-3992efac597b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:49.333727 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d281fd-2b9a-4c3d-88b6-3992efac597b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:49.334009 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d281fd-2b9a-4c3d-88b6-3992efac597b admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:49.334285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d281fd-2b9a-4c3d-88b6-3992efac597b admin admin] PATH_INFO: `/v3/projects/27d04019cf304c06af9067d803df5e3c` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:49.335502 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d281fd-2b9a-4c3d-88b6-3992efac597b admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d04019cf304c06af9067d803df5e3c)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:49.337411 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d281fd-2b9a-4c3d-88b6-3992efac597b admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:49.382508 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-87d281fd-2b9a-4c3d-88b6-3992efac597b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d04019cf304c06af9067d803df5e3c', 'request_id': 'req-87d281fd-2b9a-4c3d-88b6-3992efac597b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:49.388582 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-87d281fd-2b9a-4c3d-88b6-3992efac597b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d04019cf304c06af9067d803df5e3c', 'request_id': 'req-87d281fd-2b9a-4c3d-88b6-3992efac597b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:49.394590 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-87d281fd-2b9a-4c3d-88b6-3992efac597b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d04019cf304c06af9067d803df5e3c', 'request_id': 'req-87d281fd-2b9a-4c3d-88b6-3992efac597b'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:49.406404 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-87d281fd-2b9a-4c3d-88b6-3992efac597b admin admin] The token cache is being invalidate because project 27d04019cf304c06af9067d803df5e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:15:49.406691 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-87d281fd-2b9a-4c3d-88b6-3992efac597b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:49.407310 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-87d281fd-2b9a-4c3d-88b6-3992efac597b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:49.409531 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1370/2740] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:15:49 2021] DELETE /identity/v3/projects/27d04019cf304c06af9067d803df5e3c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:15:49.415317 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255a268-2a05-4d23-89b1-59034b6108a9 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:49.415635 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255a268-2a05-4d23-89b1-59034b6108a9 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:49.415914 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255a268-2a05-4d23-89b1-59034b6108a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:49.433488 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-1255a268-2a05-4d23-89b1-59034b6108a9 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:15:49.434665 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-1255a268-2a05-4d23-89b1-59034b6108a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:15:49.490152 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1371/2741] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:15:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:15:49.498171 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78183b60-b004-4b77-a37d-abf4e4e17f38 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:49.498464 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78183b60-b004-4b77-a37d-abf4e4e17f38 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:49.498748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78183b60-b004-4b77-a37d-abf4e4e17f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:49.517947 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-78183b60-b004-4b77-a37d-abf4e4e17f38 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:15:49.519156 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-78183b60-b004-4b77-a37d-abf4e4e17f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:15:49.527090 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1371/2742] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:15:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:15:49.531405 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255a268-2a05-4d23-89b1-59034b6108a9 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:49.540909 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255a268-2a05-4d23-89b1-59034b6108a9 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:49.545558 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1c2d3-cd93-40c7-b056-71ceacfaea12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:49.546196 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1c2d3-cd93-40c7-b056-71ceacfaea12 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:49.546474 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1c2d3-cd93-40c7-b056-71ceacfaea12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:49.546743 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1c2d3-cd93-40c7-b056-71ceacfaea12 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:49.547495 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1c2d3-cd93-40c7-b056-71ceacfaea12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:15:49.547796 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1c2d3-cd93-40c7-b056-71ceacfaea12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:49.549987 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1c2d3-cd93-40c7-b056-71ceacfaea12 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:49.561034 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1372/2743] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:15:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:15:49.565927 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78183b60-b004-4b77-a37d-abf4e4e17f38 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:49.575158 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78183b60-b004-4b77-a37d-abf4e4e17f38 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:49.579815 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8be9c-f384-4e5a-8704-8166b2cce1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:49.580561 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8be9c-f384-4e5a-8704-8166b2cce1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:49.581003 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8be9c-f384-4e5a-8704-8166b2cce1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:49.581285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8be9c-f384-4e5a-8704-8166b2cce1f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:49.581969 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8be9c-f384-4e5a-8704-8166b2cce1f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:49.583892 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8be9c-f384-4e5a-8704-8166b2cce1f9 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:49.609759 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1372/2744] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:15:49 2021] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:15:49.614271 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1c2d3-cd93-40c7-b056-71ceacfaea12 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:49.624095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1c2d3-cd93-40c7-b056-71ceacfaea12 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:49.682145 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a09f9-2bf0-49ec-b25b-d1956b4e30a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:49.682811 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a09f9-2bf0-49ec-b25b-d1956b4e30a1 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:49.683090 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a09f9-2bf0-49ec-b25b-d1956b4e30a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:49.683381 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a09f9-2bf0-49ec-b25b-d1956b4e30a1 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:49.684062 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a09f9-2bf0-49ec-b25b-d1956b4e30a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:49.685955 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a09f9-2bf0-49ec-b25b-d1956b4e30a1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:49.705783 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1373/2745] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:15:49 2021] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:15:49.709561 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8be9c-f384-4e5a-8704-8166b2cce1f9 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:49.720049 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8be9c-f384-4e5a-8704-8166b2cce1f9 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:49.724851 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e323b99-d687-4c7b-8f06-3f3651181002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:49.725502 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e323b99-d687-4c7b-8f06-3f3651181002 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:49.725789 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e323b99-d687-4c7b-8f06-3f3651181002 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:49.726068 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e323b99-d687-4c7b-8f06-3f3651181002 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:49.726819 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e323b99-d687-4c7b-8f06-3f3651181002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:49.728472 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e323b99-d687-4c7b-8f06-3f3651181002 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:49.741170 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1373/2746] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:15:49 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:15:49.745200 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a09f9-2bf0-49ec-b25b-d1956b4e30a1 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:49.760498 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a09f9-2bf0-49ec-b25b-d1956b4e30a1 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:49.765398 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeac0c-3b8f-4166-be41-f62802e5a10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:49.766048 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeac0c-3b8f-4166-be41-f62802e5a10e admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:49.766328 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeac0c-3b8f-4166-be41-f62802e5a10e admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:49.766600 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeac0c-3b8f-4166-be41-f62802e5a10e admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:49.767310 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffeac0c-3b8f-4166-be41-f62802e5a10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:49.769409 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffeac0c-3b8f-4166-be41-f62802e5a10e admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:49.778954 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1374/2747] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:15:49 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:15:49.783119 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e323b99-d687-4c7b-8f06-3f3651181002 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:49.793377 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e323b99-d687-4c7b-8f06-3f3651181002 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:49.798011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9426a3d-18d0-415a-8c45-298cb82be042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:49.799579 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9426a3d-18d0-415a-8c45-298cb82be042 admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:49.800046 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9426a3d-18d0-415a-8c45-298cb82be042 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:49.800246 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9426a3d-18d0-415a-8c45-298cb82be042 admin admin] PATH_INFO: `/v3/projects/8deb0fd6b71c4b0ebb3e98866d772302/users/b16a2ac23129411a93fcc06c0e6096f4/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:49.814183 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9426a3d-18d0-415a-8c45-298cb82be042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8deb0fd6b71c4b0ebb3e98866d772302, user_id=b16a2ac23129411a93fcc06c0e6096f4, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:49.816996 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9426a3d-18d0-415a-8c45-298cb82be042 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:49.829081 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1374/2748] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:15:49 2021] PUT /identity/v3/projects/8deb0fd6b71c4b0ebb3e98866d772302/users/b16a2ac23129411a93fcc06c0e6096f4/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:15:49.839329 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440accfe-b169-4db8-9331-beae50f44d96 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:49.839676 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440accfe-b169-4db8-9331-beae50f44d96 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:49.839959 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440accfe-b169-4db8-9331-beae50f44d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:49.866504 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-440accfe-b169-4db8-9331-beae50f44d96 None None] MFA Rules not processed for user `b16a2ac23129411a93fcc06c0e6096f4`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:15:49.867748 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-440accfe-b169-4db8-9331-beae50f44d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:15:49.929218 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1375/2749] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:15:49 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:15:49.938887 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9426a3d-18d0-415a-8c45-298cb82be042 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:49.940578 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a9426a3d-18d0-415a-8c45-298cb82be042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:15:49.999941 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9426a3d-18d0-415a-8c45-298cb82be042 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:50.003844 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3d3fd-988f-4461-85e4-15ec73c7ba9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:50.004494 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3d3fd-988f-4461-85e4-15ec73c7ba9d service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:50.004785 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3d3fd-988f-4461-85e4-15ec73c7ba9d service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:50.005056 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3d3fd-988f-4461-85e4-15ec73c7ba9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:50.013872 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3d3fd-988f-4461-85e4-15ec73c7ba9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:50.015289 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3d3fd-988f-4461-85e4-15ec73c7ba9d service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:50.023932 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1375/2750] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:15:49 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:15:58.279703 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440accfe-b169-4db8-9331-beae50f44d96 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:58.338541 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440accfe-b169-4db8-9331-beae50f44d96 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:58.343041 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5c260-1a06-4cda-ab13-452d5a8861c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:58.343934 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c260-1a06-4cda-ab13-452d5a8861c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:58.344216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c260-1a06-4cda-ab13-452d5a8861c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:58.344485 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c260-1a06-4cda-ab13-452d5a8861c7 admin admin] PATH_INFO: `/v3/users/b16a2ac23129411a93fcc06c0e6096f4` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:58.345669 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5c260-1a06-4cda-ab13-452d5a8861c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16a2ac23129411a93fcc06c0e6096f4)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:58.348984 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5c260-1a06-4cda-ab13-452d5a8861c7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:58.392148 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-e2d5c260-1a06-4cda-ab13-452d5a8861c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16a2ac23129411a93fcc06c0e6096f4'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:58.404009 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-e2d5c260-1a06-4cda-ab13-452d5a8861c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16a2ac23129411a93fcc06c0e6096f4'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:58.404664 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-e2d5c260-1a06-4cda-ab13-452d5a8861c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16a2ac23129411a93fcc06c0e6096f4'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:58.412670 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-e2d5c260-1a06-4cda-ab13-452d5a8861c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16a2ac23129411a93fcc06c0e6096f4'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:58.420137 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-e2d5c260-1a06-4cda-ab13-452d5a8861c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16a2ac23129411a93fcc06c0e6096f4'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:58.426488 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1376/2751] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:15:58 2021] DELETE /identity/v3/users/b16a2ac23129411a93fcc06c0e6096f4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:15:58.431043 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1072ea-91a1-4f0f-929a-3f728fe068c9 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:58.431553 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1072ea-91a1-4f0f-929a-3f728fe068c9 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:58.431651 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1072ea-91a1-4f0f-929a-3f728fe068c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:58.448633 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-bc1072ea-91a1-4f0f-929a-3f728fe068c9 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:15:58.449809 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-bc1072ea-91a1-4f0f-929a-3f728fe068c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:15:58.505719 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1376/2752] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:15:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:15:58.515836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5c260-1a06-4cda-ab13-452d5a8861c7 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:58.517176 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-e2d5c260-1a06-4cda-ab13-452d5a8861c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:15:58.574791 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5c260-1a06-4cda-ab13-452d5a8861c7 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:58.578404 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceaf387-f00b-4ba2-90d0-cdb3d4b7f728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:58.579038 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceaf387-f00b-4ba2-90d0-cdb3d4b7f728 service neutron] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:58.579314 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceaf387-f00b-4ba2-90d0-cdb3d4b7f728 service neutron] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:58.579612 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceaf387-f00b-4ba2-90d0-cdb3d4b7f728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:58.589419 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceaf387-f00b-4ba2-90d0-cdb3d4b7f728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:58.590844 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceaf387-f00b-4ba2-90d0-cdb3d4b7f728 service neutron] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:58.601300 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1377/2753] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:15:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:15:58.870528 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1072ea-91a1-4f0f-929a-3f728fe068c9 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:58.872070 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-bc1072ea-91a1-4f0f-929a-3f728fe068c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:15:58.885764 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1072ea-91a1-4f0f-929a-3f728fe068c9 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:58.890587 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc6c0b-337c-4179-b9a2-e2d0c43f2e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:58.891470 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6c0b-337c-4179-b9a2-e2d0c43f2e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:58.891754 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6c0b-337c-4179-b9a2-e2d0c43f2e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:58.892032 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6c0b-337c-4179-b9a2-e2d0c43f2e6f admin admin] PATH_INFO: `/v3/projects/8deb0fd6b71c4b0ebb3e98866d772302` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:58.893219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc6c0b-337c-4179-b9a2-e2d0c43f2e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8deb0fd6b71c4b0ebb3e98866d772302)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:58.895794 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc6c0b-337c-4179-b9a2-e2d0c43f2e6f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:58.941006 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e9bc6c0b-337c-4179-b9a2-e2d0c43f2e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8deb0fd6b71c4b0ebb3e98866d772302', 'request_id': 'req-e9bc6c0b-337c-4179-b9a2-e2d0c43f2e6f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:58.947270 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e9bc6c0b-337c-4179-b9a2-e2d0c43f2e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8deb0fd6b71c4b0ebb3e98866d772302', 'request_id': 'req-e9bc6c0b-337c-4179-b9a2-e2d0c43f2e6f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:58.952488 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e9bc6c0b-337c-4179-b9a2-e2d0c43f2e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8deb0fd6b71c4b0ebb3e98866d772302', 'request_id': 'req-e9bc6c0b-337c-4179-b9a2-e2d0c43f2e6f'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:58.965101 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e9bc6c0b-337c-4179-b9a2-e2d0c43f2e6f admin admin] The token cache is being invalidate because project 8deb0fd6b71c4b0ebb3e98866d772302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:15:58.965393 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e9bc6c0b-337c-4179-b9a2-e2d0c43f2e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:58.966008 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-e9bc6c0b-337c-4179-b9a2-e2d0c43f2e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:15:58.967529 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1377/2754] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:15:58 2021] DELETE /identity/v3/projects/8deb0fd6b71c4b0ebb3e98866d772302 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:15:58.973549 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c64a0-4677-4f3b-90af-d9fb8fea8383 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:58.973836 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c64a0-4677-4f3b-90af-d9fb8fea8383 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:58.974111 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c64a0-4677-4f3b-90af-d9fb8fea8383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:58.991421 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-a38c64a0-4677-4f3b-90af-d9fb8fea8383 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:15:58.992642 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-a38c64a0-4677-4f3b-90af-d9fb8fea8383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:15:59.049878 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1378/2755] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:15:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:15:59.059252 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f428417-ad15-48e1-bf10-0bef32027dec None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:59.059584 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f428417-ad15-48e1-bf10-0bef32027dec None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:59.059847 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f428417-ad15-48e1-bf10-0bef32027dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:59.078120 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-3f428417-ad15-48e1-bf10-0bef32027dec None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:15:59.079300 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-3f428417-ad15-48e1-bf10-0bef32027dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:15:59.087898 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1378/2756] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:15:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:15:59.092044 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c64a0-4677-4f3b-90af-d9fb8fea8383 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:59.101652 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c64a0-4677-4f3b-90af-d9fb8fea8383 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:59.107052 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5408cc7-b6f4-4820-96dc-80e1ca9fe361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:59.107052 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5408cc7-b6f4-4820-96dc-80e1ca9fe361 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:59.107304 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5408cc7-b6f4-4820-96dc-80e1ca9fe361 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:59.107508 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5408cc7-b6f4-4820-96dc-80e1ca9fe361 admin admin] PATH_INFO: `/v3/domains` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:59.108227 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5408cc7-b6f4-4820-96dc-80e1ca9fe361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:15:59.108531 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5408cc7-b6f4-4820-96dc-80e1ca9fe361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:59.110115 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5408cc7-b6f4-4820-96dc-80e1ca9fe361 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:59.122223 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1379/2757] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:15:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:15:59.126577 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f428417-ad15-48e1-bf10-0bef32027dec None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:59.136565 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f428417-ad15-48e1-bf10-0bef32027dec None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:59.141528 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bbdce-daba-4e5e-bf60-019243cf6827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:59.142176 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bbdce-daba-4e5e-bf60-019243cf6827 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:59.142457 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bbdce-daba-4e5e-bf60-019243cf6827 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:59.142732 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bbdce-daba-4e5e-bf60-019243cf6827 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:59.143466 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bbdce-daba-4e5e-bf60-019243cf6827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:59.145332 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bbdce-daba-4e5e-bf60-019243cf6827 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:59.169526 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1379/2758] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:15:59 2021] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:15:59.173492 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5408cc7-b6f4-4820-96dc-80e1ca9fe361 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:59.183747 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5408cc7-b6f4-4820-96dc-80e1ca9fe361 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:59.236862 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19336498-c9c5-46ca-bfa8-45a8d0d34700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:59.238045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19336498-c9c5-46ca-bfa8-45a8d0d34700 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:59.238322 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19336498-c9c5-46ca-bfa8-45a8d0d34700 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:59.238591 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19336498-c9c5-46ca-bfa8-45a8d0d34700 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:59.239301 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19336498-c9c5-46ca-bfa8-45a8d0d34700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:59.241223 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19336498-c9c5-46ca-bfa8-45a8d0d34700 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:59.260470 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1380/2759] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:15:59 2021] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:15:59.264877 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bbdce-daba-4e5e-bf60-019243cf6827 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:59.274904 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bbdce-daba-4e5e-bf60-019243cf6827 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:59.279493 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2777fd-6e2c-4e88-8483-7fc95f8dabe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:59.280143 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2777fd-6e2c-4e88-8483-7fc95f8dabe6 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:59.280423 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2777fd-6e2c-4e88-8483-7fc95f8dabe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:59.280694 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2777fd-6e2c-4e88-8483-7fc95f8dabe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:59.281407 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2777fd-6e2c-4e88-8483-7fc95f8dabe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:59.282979 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2777fd-6e2c-4e88-8483-7fc95f8dabe6 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:59.293289 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1380/2760] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:15:59 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:15:59.296983 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19336498-c9c5-46ca-bfa8-45a8d0d34700 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:59.307353 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19336498-c9c5-46ca-bfa8-45a8d0d34700 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:59.311952 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc798f2-304f-4776-9130-080f61df70ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:59.312597 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc798f2-304f-4776-9130-080f61df70ea admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:59.312879 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc798f2-304f-4776-9130-080f61df70ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:59.313154 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc798f2-304f-4776-9130-080f61df70ea admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:59.313867 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc798f2-304f-4776-9130-080f61df70ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:59.316115 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc798f2-304f-4776-9130-080f61df70ea admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:59.325596 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1381/2761] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:15:59 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:15:59.329474 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2777fd-6e2c-4e88-8483-7fc95f8dabe6 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:59.339216 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2777fd-6e2c-4e88-8483-7fc95f8dabe6 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:59.343867 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c4e07-69a1-40c0-9e10-a03c1ca66b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:59.344727 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c4e07-69a1-40c0-9e10-a03c1ca66b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:59.345013 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c4e07-69a1-40c0-9e10-a03c1ca66b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:59.345291 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c4e07-69a1-40c0-9e10-a03c1ca66b2f admin admin] PATH_INFO: `/v3/projects/dbbf54c438774401b9438000309eeed2/users/d30bab31efb84624b9b36a26089a4462/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:59.359817 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c4e07-69a1-40c0-9e10-a03c1ca66b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbbf54c438774401b9438000309eeed2, user_id=d30bab31efb84624b9b36a26089a4462, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:59.363020 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c4e07-69a1-40c0-9e10-a03c1ca66b2f admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:59.375720 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1381/2762] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:15:59 2021] PUT /identity/v3/projects/dbbf54c438774401b9438000309eeed2/users/d30bab31efb84624b9b36a26089a4462/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:15:59.386501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7794851-cb3c-4bdb-8076-11d2908cbbb6 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:59.386817 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7794851-cb3c-4bdb-8076-11d2908cbbb6 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:59.387095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7794851-cb3c-4bdb-8076-11d2908cbbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:59.413118 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-f7794851-cb3c-4bdb-8076-11d2908cbbb6 None None] MFA Rules not processed for user `d30bab31efb84624b9b36a26089a4462`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:15:59.414313 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f7794851-cb3c-4bdb-8076-11d2908cbbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:15:59.476720 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1382/2763] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:15:59 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:15:59.481124 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c4e07-69a1-40c0-9e10-a03c1ca66b2f admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:59.555046 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c4e07-69a1-40c0-9e10-a03c1ca66b2f admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:59.560253 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2b273-d5a7-4220-a280-68afd3c3fb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:59.561128 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2b273-d5a7-4220-a280-68afd3c3fb00 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:59.561543 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2b273-d5a7-4220-a280-68afd3c3fb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:59.561949 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2b273-d5a7-4220-a280-68afd3c3fb00 admin admin] PATH_INFO: `/v3/projects` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:59.562974 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2b273-d5a7-4220-a280-68afd3c3fb00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:59.566001 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2b273-d5a7-4220-a280-68afd3c3fb00 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:59.593476 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1382/2764] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:15:59 2021] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:15:59.598282 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7794851-cb3c-4bdb-8076-11d2908cbbb6 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:59.608796 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7794851-cb3c-4bdb-8076-11d2908cbbb6 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:59.663170 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb785a-e506-40cf-985b-df2a9d1c1922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:59.663855 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb785a-e506-40cf-985b-df2a9d1c1922 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:59.664248 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb785a-e506-40cf-985b-df2a9d1c1922 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:59.664529 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb785a-e506-40cf-985b-df2a9d1c1922 admin admin] PATH_INFO: `/v3/users` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:59.665206 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb785a-e506-40cf-985b-df2a9d1c1922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:59.667126 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb785a-e506-40cf-985b-df2a9d1c1922 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:59.685913 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1383/2765] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:15:59 2021] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:15:59.690096 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2b273-d5a7-4220-a280-68afd3c3fb00 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:59.700220 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2b273-d5a7-4220-a280-68afd3c3fb00 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:59.704741 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9708c7e-e6ee-46ed-b2a2-5301391fa8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:59.705412 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9708c7e-e6ee-46ed-b2a2-5301391fa8fc admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:59.705810 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9708c7e-e6ee-46ed-b2a2-5301391fa8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:59.706138 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9708c7e-e6ee-46ed-b2a2-5301391fa8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:59.707025 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9708c7e-e6ee-46ed-b2a2-5301391fa8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:59.708630 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9708c7e-e6ee-46ed-b2a2-5301391fa8fc admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:59.719290 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1383/2766] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:15:59 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:15:59.724045 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb785a-e506-40cf-985b-df2a9d1c1922 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:59.733670 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb785a-e506-40cf-985b-df2a9d1c1922 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:59.739052 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2e6ae-9e8c-4a76-942d-9e1e256ead66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:59.739947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2e6ae-9e8c-4a76-942d-9e1e256ead66 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:59.740228 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2e6ae-9e8c-4a76-942d-9e1e256ead66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:59.740501 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2e6ae-9e8c-4a76-942d-9e1e256ead66 admin admin] PATH_INFO: `/v3/projects/d60d86c2b5b44f8ca7840bdcc6595e29/users/c6688a66fa1c419fbb0d5825bb4bafac/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:59.754593 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2e6ae-9e8c-4a76-942d-9e1e256ead66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60d86c2b5b44f8ca7840bdcc6595e29, user_id=c6688a66fa1c419fbb0d5825bb4bafac, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:59.757361 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2e6ae-9e8c-4a76-942d-9e1e256ead66 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:59.770119 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1384/2767] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:15:59 2021] PUT /identity/v3/projects/d60d86c2b5b44f8ca7840bdcc6595e29/users/c6688a66fa1c419fbb0d5825bb4bafac/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:15:59.773968 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9708c7e-e6ee-46ed-b2a2-5301391fa8fc admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:59.783613 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9708c7e-e6ee-46ed-b2a2-5301391fa8fc admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:59.837408 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2b659-5534-4b14-bc3e-0ee9648e2e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:59.837983 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2b659-5534-4b14-bc3e-0ee9648e2e02 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:59.838264 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2b659-5534-4b14-bc3e-0ee9648e2e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:59.838534 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2b659-5534-4b14-bc3e-0ee9648e2e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:59.839240 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2b659-5534-4b14-bc3e-0ee9648e2e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:59.840845 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2b659-5534-4b14-bc3e-0ee9648e2e02 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:59.865310 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1384/2768] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:15:59 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:15:59.869309 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2e6ae-9e8c-4a76-942d-9e1e256ead66 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:15:59.880279 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2e6ae-9e8c-4a76-942d-9e1e256ead66 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:15:59.885981 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6d195-256b-456b-988d-d71097960321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:15:59.886860 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6d195-256b-456b-988d-d71097960321 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:59.887416 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6d195-256b-456b-988d-d71097960321 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:59.887702 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6d195-256b-456b-988d-d71097960321 admin admin] PATH_INFO: `/v3/projects/d60d86c2b5b44f8ca7840bdcc6595e29/users/c6688a66fa1c419fbb0d5825bb4bafac/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:59.889636 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6d195-256b-456b-988d-d71097960321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60d86c2b5b44f8ca7840bdcc6595e29, user_id=c6688a66fa1c419fbb0d5825bb4bafac, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:15:59.892449 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6d195-256b-456b-988d-d71097960321 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:15:59.903667 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1385/2769] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:15:59 2021] PUT /identity/v3/projects/d60d86c2b5b44f8ca7840bdcc6595e29/users/c6688a66fa1c419fbb0d5825bb4bafac/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:15:59.915930 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a815f-9ca3-40f8-9578-9706d522f824 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:15:59.916218 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a815f-9ca3-40f8-9578-9706d522f824 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:15:59.916495 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a815f-9ca3-40f8-9578-9706d522f824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:15:59.943427 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-406a815f-9ca3-40f8-9578-9706d522f824 None None] MFA Rules not processed for user `c6688a66fa1c419fbb0d5825bb4bafac`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:15:59.944615 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-406a815f-9ca3-40f8-9578-9706d522f824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:00.014111 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1385/2770] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:15:59 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:16:00.025263 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6d195-256b-456b-988d-d71097960321 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:00.026958 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-f3f6d195-256b-456b-988d-d71097960321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:00.083173 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6d195-256b-456b-988d-d71097960321 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:00.086892 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d9845-6626-40db-a1ba-e7e384b18ffd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:00.087608 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d9845-6626-40db-a1ba-e7e384b18ffd service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:00.087843 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d9845-6626-40db-a1ba-e7e384b18ffd service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:00.088119 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d9845-6626-40db-a1ba-e7e384b18ffd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:00.097548 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d9845-6626-40db-a1ba-e7e384b18ffd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:00.098967 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d9845-6626-40db-a1ba-e7e384b18ffd service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:00.108307 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1386/2771] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:16:00 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:16:00.357150 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a815f-9ca3-40f8-9578-9706d522f824 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:00.416921 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a815f-9ca3-40f8-9578-9706d522f824 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:00.421468 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9869232-6e3b-47f3-9c6f-2bd48082b9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:00.422325 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9869232-6e3b-47f3-9c6f-2bd48082b9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:00.422612 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9869232-6e3b-47f3-9c6f-2bd48082b9de admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:00.422888 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9869232-6e3b-47f3-9c6f-2bd48082b9de admin admin] PATH_INFO: `/v3/users/d30bab31efb84624b9b36a26089a4462` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:00.424080 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9869232-6e3b-47f3-9c6f-2bd48082b9de admin admin] RBAC: Authorizing `identity:delete_user(user_id=d30bab31efb84624b9b36a26089a4462)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:00.426250 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9869232-6e3b-47f3-9c6f-2bd48082b9de admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:00.470283 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a9869232-6e3b-47f3-9c6f-2bd48082b9de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd30bab31efb84624b9b36a26089a4462'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:00.470984 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a9869232-6e3b-47f3-9c6f-2bd48082b9de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd30bab31efb84624b9b36a26089a4462'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:00.471651 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a9869232-6e3b-47f3-9c6f-2bd48082b9de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd30bab31efb84624b9b36a26089a4462'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:00.482959 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a9869232-6e3b-47f3-9c6f-2bd48082b9de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd30bab31efb84624b9b36a26089a4462'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:00.490626 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-a9869232-6e3b-47f3-9c6f-2bd48082b9de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd30bab31efb84624b9b36a26089a4462'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:00.503156 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1386/2772] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:16:00 2021] DELETE /identity/v3/users/d30bab31efb84624b9b36a26089a4462 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:16:00.508109 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1db34-50bb-4a6f-9a4e-2218a15391fe None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:00.508866 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1db34-50bb-4a6f-9a4e-2218a15391fe None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:00.509038 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1db34-50bb-4a6f-9a4e-2218a15391fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:00.527031 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-82a1db34-50bb-4a6f-9a4e-2218a15391fe None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:16:00.528266 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-82a1db34-50bb-4a6f-9a4e-2218a15391fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:00.584290 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1387/2773] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:16:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:16:00.594060 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9869232-6e3b-47f3-9c6f-2bd48082b9de admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:00.595483 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-a9869232-6e3b-47f3-9c6f-2bd48082b9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:00.650599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9869232-6e3b-47f3-9c6f-2bd48082b9de admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:00.654180 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742577d-a59f-4553-9c27-f108eb28c402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:00.654815 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742577d-a59f-4553-9c27-f108eb28c402 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:00.655101 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742577d-a59f-4553-9c27-f108eb28c402 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:00.655401 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742577d-a59f-4553-9c27-f108eb28c402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:00.664196 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742577d-a59f-4553-9c27-f108eb28c402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:00.665614 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742577d-a59f-4553-9c27-f108eb28c402 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:00.675748 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1387/2774] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:16:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:16:00.948421 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1db34-50bb-4a6f-9a4e-2218a15391fe None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:00.949864 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-82a1db34-50bb-4a6f-9a4e-2218a15391fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:00.962358 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1db34-50bb-4a6f-9a4e-2218a15391fe None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:00.966937 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c868320-ed20-4e43-9107-25aa4e448e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:00.967840 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c868320-ed20-4e43-9107-25aa4e448e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:00.968119 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c868320-ed20-4e43-9107-25aa4e448e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:00.968392 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c868320-ed20-4e43-9107-25aa4e448e23 admin admin] PATH_INFO: `/v3/projects/dbbf54c438774401b9438000309eeed2` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:00.969562 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c868320-ed20-4e43-9107-25aa4e448e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbbf54c438774401b9438000309eeed2)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:00.972176 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c868320-ed20-4e43-9107-25aa4e448e23 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:01.017329 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5c868320-ed20-4e43-9107-25aa4e448e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbbf54c438774401b9438000309eeed2', 'request_id': 'req-5c868320-ed20-4e43-9107-25aa4e448e23'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:01.023257 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5c868320-ed20-4e43-9107-25aa4e448e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbbf54c438774401b9438000309eeed2', 'request_id': 'req-5c868320-ed20-4e43-9107-25aa4e448e23'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:01.030301 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5c868320-ed20-4e43-9107-25aa4e448e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbbf54c438774401b9438000309eeed2', 'request_id': 'req-5c868320-ed20-4e43-9107-25aa4e448e23'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:01.041340 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5c868320-ed20-4e43-9107-25aa4e448e23 admin admin] The token cache is being invalidate because project dbbf54c438774401b9438000309eeed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:16:01.041628 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5c868320-ed20-4e43-9107-25aa4e448e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:01.042251 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-5c868320-ed20-4e43-9107-25aa4e448e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:01.043824 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1388/2775] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:16:00 2021] DELETE /identity/v3/projects/dbbf54c438774401b9438000309eeed2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:16:01.048085 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742577d-a59f-4553-9c27-f108eb28c402 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:01.058295 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742577d-a59f-4553-9c27-f108eb28c402 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:01.112809 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf2e69-f408-460f-b63a-ad0a352678e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:01.113700 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf2e69-f408-460f-b63a-ad0a352678e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:01.113980 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf2e69-f408-460f-b63a-ad0a352678e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:01.114254 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf2e69-f408-460f-b63a-ad0a352678e5 admin admin] PATH_INFO: `/v3/users/c6688a66fa1c419fbb0d5825bb4bafac` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:01.115466 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf2e69-f408-460f-b63a-ad0a352678e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6688a66fa1c419fbb0d5825bb4bafac)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:01.117380 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf2e69-f408-460f-b63a-ad0a352678e5 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:01.161461 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-57bf2e69-f408-460f-b63a-ad0a352678e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6688a66fa1c419fbb0d5825bb4bafac'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:01.162113 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-57bf2e69-f408-460f-b63a-ad0a352678e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6688a66fa1c419fbb0d5825bb4bafac'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:01.162722 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-57bf2e69-f408-460f-b63a-ad0a352678e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6688a66fa1c419fbb0d5825bb4bafac'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:01.173787 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-57bf2e69-f408-460f-b63a-ad0a352678e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6688a66fa1c419fbb0d5825bb4bafac'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:01.180580 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-57bf2e69-f408-460f-b63a-ad0a352678e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6688a66fa1c419fbb0d5825bb4bafac'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:01.192695 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1388/2776] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:16:01 2021] DELETE /identity/v3/users/c6688a66fa1c419fbb0d5825bb4bafac => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:16:01.470042 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c868320-ed20-4e43-9107-25aa4e448e23 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:01.471801 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-5c868320-ed20-4e43-9107-25aa4e448e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:01.484897 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c868320-ed20-4e43-9107-25aa4e448e23 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:01.546745 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baba742-0574-4fe3-9857-b056c2cbf161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:01.547647 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baba742-0574-4fe3-9857-b056c2cbf161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:01.547932 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baba742-0574-4fe3-9857-b056c2cbf161 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:01.548208 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baba742-0574-4fe3-9857-b056c2cbf161 admin admin] PATH_INFO: `/v3/projects/d60d86c2b5b44f8ca7840bdcc6595e29` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:01.549930 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baba742-0574-4fe3-9857-b056c2cbf161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60d86c2b5b44f8ca7840bdcc6595e29)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:01.551991 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baba742-0574-4fe3-9857-b056c2cbf161 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:01.595676 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-3baba742-0574-4fe3-9857-b056c2cbf161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60d86c2b5b44f8ca7840bdcc6595e29', 'request_id': 'req-3baba742-0574-4fe3-9857-b056c2cbf161'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:01.601103 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-3baba742-0574-4fe3-9857-b056c2cbf161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60d86c2b5b44f8ca7840bdcc6595e29', 'request_id': 'req-3baba742-0574-4fe3-9857-b056c2cbf161'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:01.608659 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-3baba742-0574-4fe3-9857-b056c2cbf161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60d86c2b5b44f8ca7840bdcc6595e29', 'request_id': 'req-3baba742-0574-4fe3-9857-b056c2cbf161'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:01.620049 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-3baba742-0574-4fe3-9857-b056c2cbf161 admin admin] The token cache is being invalidate because project d60d86c2b5b44f8ca7840bdcc6595e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:16:01.620333 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-3baba742-0574-4fe3-9857-b056c2cbf161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:01.620958 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-3baba742-0574-4fe3-9857-b056c2cbf161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:01.622465 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1389/2777] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:16:01 2021] DELETE /identity/v3/projects/d60d86c2b5b44f8ca7840bdcc6595e29 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:16:01.629036 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433c82a-37bf-4b4f-ac34-70346302e4d9 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:01.629528 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433c82a-37bf-4b4f-ac34-70346302e4d9 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:01.629627 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433c82a-37bf-4b4f-ac34-70346302e4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:01.647607 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-7433c82a-37bf-4b4f-ac34-70346302e4d9 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:16:01.648799 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-7433c82a-37bf-4b4f-ac34-70346302e4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:01.706333 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1389/2778] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:16:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:16:01.714234 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1db6f0-7305-4db1-a7ed-b976f83242d4 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:01.714472 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1db6f0-7305-4db1-a7ed-b976f83242d4 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:01.714750 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1db6f0-7305-4db1-a7ed-b976f83242d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:01.733435 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-7c1db6f0-7305-4db1-a7ed-b976f83242d4 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:16:01.734638 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-7c1db6f0-7305-4db1-a7ed-b976f83242d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:01.743113 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1390/2779] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:16:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:16:01.747219 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433c82a-37bf-4b4f-ac34-70346302e4d9 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:01.757276 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433c82a-37bf-4b4f-ac34-70346302e4d9 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:01.761838 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451bcfb-40e9-419a-802c-0c18c2d7632c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:01.762744 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451bcfb-40e9-419a-802c-0c18c2d7632c admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:01.763023 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451bcfb-40e9-419a-802c-0c18c2d7632c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:01.763295 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451bcfb-40e9-419a-802c-0c18c2d7632c admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:01.764069 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451bcfb-40e9-419a-802c-0c18c2d7632c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:16:01.764374 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451bcfb-40e9-419a-802c-0c18c2d7632c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:01.765950 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451bcfb-40e9-419a-802c-0c18c2d7632c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:01.776987 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1390/2780] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:16:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 03:16:01.781071 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1db6f0-7305-4db1-a7ed-b976f83242d4 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:01.791065 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1db6f0-7305-4db1-a7ed-b976f83242d4 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:01.795742 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05284bb1-cdf4-4882-822c-5b80d4e5edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:01.796382 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05284bb1-cdf4-4882-822c-5b80d4e5edb0 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:01.796667 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05284bb1-cdf4-4882-822c-5b80d4e5edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:01.796944 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05284bb1-cdf4-4882-822c-5b80d4e5edb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:01.797619 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05284bb1-cdf4-4882-822c-5b80d4e5edb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:01.800168 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05284bb1-cdf4-4882-822c-5b80d4e5edb0 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:01.824434 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1391/2781] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:16:01 2021] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:16:01.828468 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451bcfb-40e9-419a-802c-0c18c2d7632c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:01.838468 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451bcfb-40e9-419a-802c-0c18c2d7632c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:01.891813 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e583497-5b63-46e5-bce1-dfdc6c834649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:01.892466 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e583497-5b63-46e5-bce1-dfdc6c834649 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:01.892749 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e583497-5b63-46e5-bce1-dfdc6c834649 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:01.893024 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e583497-5b63-46e5-bce1-dfdc6c834649 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:01.893938 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e583497-5b63-46e5-bce1-dfdc6c834649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:01.895883 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e583497-5b63-46e5-bce1-dfdc6c834649 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:01.915001 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1391/2782] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:16:01 2021] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:16:01.918990 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05284bb1-cdf4-4882-822c-5b80d4e5edb0 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:01.929726 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05284bb1-cdf4-4882-822c-5b80d4e5edb0 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:01.934282 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3e3af-cbc1-4f7e-92db-d925493c1b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:01.934933 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3e3af-cbc1-4f7e-92db-d925493c1b1c admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:01.935216 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3e3af-cbc1-4f7e-92db-d925493c1b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:01.935523 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3e3af-cbc1-4f7e-92db-d925493c1b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:01.936238 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3e3af-cbc1-4f7e-92db-d925493c1b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:01.937817 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3e3af-cbc1-4f7e-92db-d925493c1b1c admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:01.947848 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1392/2783] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:16:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:16:01.951565 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e583497-5b63-46e5-bce1-dfdc6c834649 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:01.961601 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e583497-5b63-46e5-bce1-dfdc6c834649 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:01.966482 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3c5c9-25a0-4939-afa6-657610d54b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:01.967077 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3c5c9-25a0-4939-afa6-657610d54b2c admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:01.967382 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3c5c9-25a0-4939-afa6-657610d54b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:01.967678 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3c5c9-25a0-4939-afa6-657610d54b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:01.968402 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3c5c9-25a0-4939-afa6-657610d54b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:01.970007 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3c5c9-25a0-4939-afa6-657610d54b2c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:01.980552 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1392/2784] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:16:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:16:01.984627 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3e3af-cbc1-4f7e-92db-d925493c1b1c admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:01.995482 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3e3af-cbc1-4f7e-92db-d925493c1b1c admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:02.000115 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48280f89-357e-44bf-a809-cc05a84dfb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:02.000971 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48280f89-357e-44bf-a809-cc05a84dfb83 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:02.001247 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48280f89-357e-44bf-a809-cc05a84dfb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:02.001517 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48280f89-357e-44bf-a809-cc05a84dfb83 admin admin] PATH_INFO: `/v3/projects/482c66be4c2c46ecb9c94662e0f0c582/users/2ca5a67c49c84d96999e64603354bb1c/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:02.016041 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48280f89-357e-44bf-a809-cc05a84dfb83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482c66be4c2c46ecb9c94662e0f0c582, user_id=2ca5a67c49c84d96999e64603354bb1c, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:02.019239 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48280f89-357e-44bf-a809-cc05a84dfb83 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:02.031772 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1393/2785] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:16:01 2021] PUT /identity/v3/projects/482c66be4c2c46ecb9c94662e0f0c582/users/2ca5a67c49c84d96999e64603354bb1c/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:16:02.042821 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21374bde-eab2-437d-8121-540a8dee0030 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:02.043115 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21374bde-eab2-437d-8121-540a8dee0030 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:02.043510 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21374bde-eab2-437d-8121-540a8dee0030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:02.069875 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-21374bde-eab2-437d-8121-540a8dee0030 None None] MFA Rules not processed for user `2ca5a67c49c84d96999e64603354bb1c`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:16:02.071069 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-21374bde-eab2-437d-8121-540a8dee0030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:02.133273 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1393/2786] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:16:02 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:16:02.138054 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48280f89-357e-44bf-a809-cc05a84dfb83 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:02.197068 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48280f89-357e-44bf-a809-cc05a84dfb83 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:02.201725 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e4dc7-d2ce-4c9e-95c1-77ea5824fbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:02.202380 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e4dc7-d2ce-4c9e-95c1-77ea5824fbb1 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:02.202659 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e4dc7-d2ce-4c9e-95c1-77ea5824fbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:02.202934 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e4dc7-d2ce-4c9e-95c1-77ea5824fbb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:02.203645 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e4dc7-d2ce-4c9e-95c1-77ea5824fbb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:02.205538 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e4dc7-d2ce-4c9e-95c1-77ea5824fbb1 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:02.230159 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1394/2787] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:16:02 2021] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:16:02.234180 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21374bde-eab2-437d-8121-540a8dee0030 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:02.244979 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21374bde-eab2-437d-8121-540a8dee0030 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:02.299822 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bc57f-728b-4818-b7bc-268ed8df9f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:02.300483 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bc57f-728b-4818-b7bc-268ed8df9f02 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:02.300765 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bc57f-728b-4818-b7bc-268ed8df9f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:02.301046 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bc57f-728b-4818-b7bc-268ed8df9f02 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:02.301724 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bc57f-728b-4818-b7bc-268ed8df9f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:02.303664 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bc57f-728b-4818-b7bc-268ed8df9f02 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:02.322176 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1394/2788] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:16:02 2021] POST /identity/v3/users => generated 298 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 03:16:02.326271 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e4dc7-d2ce-4c9e-95c1-77ea5824fbb1 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:02.336848 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e4dc7-d2ce-4c9e-95c1-77ea5824fbb1 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:02.341524 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103c9be-1a27-4f7f-8b0b-3b5ed6d96a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:02.342175 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103c9be-1a27-4f7f-8b0b-3b5ed6d96a48 admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:02.342464 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103c9be-1a27-4f7f-8b0b-3b5ed6d96a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:02.342735 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103c9be-1a27-4f7f-8b0b-3b5ed6d96a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:02.343483 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103c9be-1a27-4f7f-8b0b-3b5ed6d96a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:02.345095 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103c9be-1a27-4f7f-8b0b-3b5ed6d96a48 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:02.355837 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1395/2789] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:16:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:16:02.359825 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bc57f-728b-4818-b7bc-268ed8df9f02 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:02.369707 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bc57f-728b-4818-b7bc-268ed8df9f02 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:02.374276 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7222872-136d-4773-a525-498b15bd476d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:02.375141 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7222872-136d-4773-a525-498b15bd476d admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:02.375459 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7222872-136d-4773-a525-498b15bd476d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:02.375740 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7222872-136d-4773-a525-498b15bd476d admin admin] PATH_INFO: `/v3/projects/e68fc9a3bb8a4ca29a0c3d207168f0a3/users/b59f921821d344e28ec3b66b8e2aebae/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:02.390204 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7222872-136d-4773-a525-498b15bd476d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68fc9a3bb8a4ca29a0c3d207168f0a3, user_id=b59f921821d344e28ec3b66b8e2aebae, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:02.392871 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7222872-136d-4773-a525-498b15bd476d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:02.405790 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1395/2790] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:16:02 2021] PUT /identity/v3/projects/e68fc9a3bb8a4ca29a0c3d207168f0a3/users/b59f921821d344e28ec3b66b8e2aebae/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:16:02.411077 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103c9be-1a27-4f7f-8b0b-3b5ed6d96a48 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:02.420951 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103c9be-1a27-4f7f-8b0b-3b5ed6d96a48 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:02.474529 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a9cd3-e97d-49d1-bda3-317f92d3ee6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:02.475187 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a9cd3-e97d-49d1-bda3-317f92d3ee6a admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:02.475499 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a9cd3-e97d-49d1-bda3-317f92d3ee6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:02.475779 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a9cd3-e97d-49d1-bda3-317f92d3ee6a admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:02.476493 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a9cd3-e97d-49d1-bda3-317f92d3ee6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:02.478080 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a9cd3-e97d-49d1-bda3-317f92d3ee6a admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:02.487662 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1396/2791] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:16:02 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 03:16:02.491811 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7222872-136d-4773-a525-498b15bd476d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:02.501783 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7222872-136d-4773-a525-498b15bd476d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:02.507110 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e023440-cc4a-4209-ae45-a0d3f7110a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:02.508011 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e023440-cc4a-4209-ae45-a0d3f7110a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:02.508292 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e023440-cc4a-4209-ae45-a0d3f7110a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:02.508570 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e023440-cc4a-4209-ae45-a0d3f7110a9c admin admin] PATH_INFO: `/v3/projects/e68fc9a3bb8a4ca29a0c3d207168f0a3/users/b59f921821d344e28ec3b66b8e2aebae/roles/99835eeda2f64af5bc9173a8370d4568` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:02.510492 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e023440-cc4a-4209-ae45-a0d3f7110a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68fc9a3bb8a4ca29a0c3d207168f0a3, user_id=b59f921821d344e28ec3b66b8e2aebae, role_id=99835eeda2f64af5bc9173a8370d4568)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:02.513415 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e023440-cc4a-4209-ae45-a0d3f7110a9c admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:02.524326 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1396/2792] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:16:02 2021] PUT /identity/v3/projects/e68fc9a3bb8a4ca29a0c3d207168f0a3/users/b59f921821d344e28ec3b66b8e2aebae/roles/99835eeda2f64af5bc9173a8370d4568 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:16:02.535739 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf064c0-1d44-44f5-8097-a84443a3b6e3 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:02.536026 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf064c0-1d44-44f5-8097-a84443a3b6e3 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:02.536299 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf064c0-1d44-44f5-8097-a84443a3b6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:02.561897 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-9cf064c0-1d44-44f5-8097-a84443a3b6e3 None None] MFA Rules not processed for user `b59f921821d344e28ec3b66b8e2aebae`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:16:02.563164 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-9cf064c0-1d44-44f5-8097-a84443a3b6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:02.629880 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1397/2793] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:16:02 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 03:16:02.639876 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e023440-cc4a-4209-ae45-a0d3f7110a9c admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:02.641630 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-1e023440-cc4a-4209-ae45-a0d3f7110a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:02.696948 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e023440-cc4a-4209-ae45-a0d3f7110a9c admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:02.700587 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382c2e6-5b00-4e92-b712-5dbbeedc0523 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:02.701220 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382c2e6-5b00-4e92-b712-5dbbeedc0523 service cinder] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:02.701502 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382c2e6-5b00-4e92-b712-5dbbeedc0523 service cinder] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:02.701780 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382c2e6-5b00-4e92-b712-5dbbeedc0523 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:02.711156 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382c2e6-5b00-4e92-b712-5dbbeedc0523 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:02.712599 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382c2e6-5b00-4e92-b712-5dbbeedc0523 service cinder] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:02.723196 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1397/2794] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:16:02 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:16:02.811869 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf064c0-1d44-44f5-8097-a84443a3b6e3 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:02.821842 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf064c0-1d44-44f5-8097-a84443a3b6e3 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:02.825461 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747a831-4a11-4a0c-ab6a-d7a6e68e5dd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:02.826086 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747a831-4a11-4a0c-ab6a-d7a6e68e5dd5 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:02.826361 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747a831-4a11-4a0c-ab6a-d7a6e68e5dd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:02.826631 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747a831-4a11-4a0c-ab6a-d7a6e68e5dd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:02.880780 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747a831-4a11-4a0c-ab6a-d7a6e68e5dd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:02.882199 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747a831-4a11-4a0c-ab6a-d7a6e68e5dd5 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:02.891023 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1398/2795] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:16:02 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:16:05.438783 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382c2e6-5b00-4e92-b712-5dbbeedc0523 service cinder] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:05.498127 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382c2e6-5b00-4e92-b712-5dbbeedc0523 service cinder] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:05.503229 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8a5a8-3a97-4605-88f2-dbdddf89e2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:05.504228 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8a5a8-3a97-4605-88f2-dbdddf89e2ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:05.504515 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8a5a8-3a97-4605-88f2-dbdddf89e2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:05.504792 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8a5a8-3a97-4605-88f2-dbdddf89e2ff admin admin] PATH_INFO: `/v3/users/2ca5a67c49c84d96999e64603354bb1c` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:05.505965 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8a5a8-3a97-4605-88f2-dbdddf89e2ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca5a67c49c84d96999e64603354bb1c)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:05.507897 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8a5a8-3a97-4605-88f2-dbdddf89e2ff admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:05.551464 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-23d8a5a8-3a97-4605-88f2-dbdddf89e2ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca5a67c49c84d96999e64603354bb1c'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:05.552114 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-23d8a5a8-3a97-4605-88f2-dbdddf89e2ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca5a67c49c84d96999e64603354bb1c'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:05.552705 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-23d8a5a8-3a97-4605-88f2-dbdddf89e2ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca5a67c49c84d96999e64603354bb1c'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:05.563712 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-23d8a5a8-3a97-4605-88f2-dbdddf89e2ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca5a67c49c84d96999e64603354bb1c'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:05.571091 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-23d8a5a8-3a97-4605-88f2-dbdddf89e2ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca5a67c49c84d96999e64603354bb1c'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:05.583213 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1398/2796] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:16:05 2021] DELETE /identity/v3/users/2ca5a67c49c84d96999e64603354bb1c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:16:05.587855 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e8054-7747-4993-bc69-738e8e6f1569 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:05.588338 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e8054-7747-4993-bc69-738e8e6f1569 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:05.588440 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e8054-7747-4993-bc69-738e8e6f1569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:05.604655 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-756e8054-7747-4993-bc69-738e8e6f1569 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:16:05.605832 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-756e8054-7747-4993-bc69-738e8e6f1569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:05.660653 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1399/2797] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:16:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:16:05.670925 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8a5a8-3a97-4605-88f2-dbdddf89e2ff admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:05.672403 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-23d8a5a8-3a97-4605-88f2-dbdddf89e2ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:05.729157 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8a5a8-3a97-4605-88f2-dbdddf89e2ff admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:05.732863 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fe22f-c839-4017-98d8-69c6a838cd03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:05.733501 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fe22f-c839-4017-98d8-69c6a838cd03 service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:05.733784 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fe22f-c839-4017-98d8-69c6a838cd03 service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:05.734059 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fe22f-c839-4017-98d8-69c6a838cd03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:05.743108 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fe22f-c839-4017-98d8-69c6a838cd03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:05.744559 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fe22f-c839-4017-98d8-69c6a838cd03 service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:05.754237 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1399/2798] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:16:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:16:06.023938 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e8054-7747-4993-bc69-738e8e6f1569 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:06.025499 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-756e8054-7747-4993-bc69-738e8e6f1569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:06.038494 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e8054-7747-4993-bc69-738e8e6f1569 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:06.043115 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803a340-5d8a-4f02-a353-fdd619b7957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:06.044016 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803a340-5d8a-4f02-a353-fdd619b7957b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:06.044296 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803a340-5d8a-4f02-a353-fdd619b7957b admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:06.044570 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803a340-5d8a-4f02-a353-fdd619b7957b admin admin] PATH_INFO: `/v3/projects/482c66be4c2c46ecb9c94662e0f0c582` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:06.045740 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803a340-5d8a-4f02-a353-fdd619b7957b admin admin] RBAC: Authorizing `identity:delete_project(project_id=482c66be4c2c46ecb9c94662e0f0c582)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:06.047700 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803a340-5d8a-4f02-a353-fdd619b7957b admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:06.093051 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-6803a340-5d8a-4f02-a353-fdd619b7957b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '482c66be4c2c46ecb9c94662e0f0c582', 'request_id': 'req-6803a340-5d8a-4f02-a353-fdd619b7957b'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:06.098947 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-6803a340-5d8a-4f02-a353-fdd619b7957b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '482c66be4c2c46ecb9c94662e0f0c582', 'request_id': 'req-6803a340-5d8a-4f02-a353-fdd619b7957b'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:06.106771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-6803a340-5d8a-4f02-a353-fdd619b7957b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '482c66be4c2c46ecb9c94662e0f0c582', 'request_id': 'req-6803a340-5d8a-4f02-a353-fdd619b7957b'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:06.118143 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-6803a340-5d8a-4f02-a353-fdd619b7957b admin admin] The token cache is being invalidate because project 482c66be4c2c46ecb9c94662e0f0c582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:16:06.118436 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-6803a340-5d8a-4f02-a353-fdd619b7957b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:06.119072 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-6803a340-5d8a-4f02-a353-fdd619b7957b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:06.120597 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1400/2799] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:16:06 2021] DELETE /identity/v3/projects/482c66be4c2c46ecb9c94662e0f0c582 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:16:06.124567 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fe22f-c839-4017-98d8-69c6a838cd03 service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:06.134256 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fe22f-c839-4017-98d8-69c6a838cd03 service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:06.188083 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086cd49-3856-4443-8ef0-47e4bd298553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:06.188931 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086cd49-3856-4443-8ef0-47e4bd298553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:06.189209 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086cd49-3856-4443-8ef0-47e4bd298553 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:06.189478 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086cd49-3856-4443-8ef0-47e4bd298553 admin admin] PATH_INFO: `/v3/users/b59f921821d344e28ec3b66b8e2aebae` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:06.190806 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086cd49-3856-4443-8ef0-47e4bd298553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b59f921821d344e28ec3b66b8e2aebae)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:06.192788 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086cd49-3856-4443-8ef0-47e4bd298553 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:06.236861 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-d086cd49-3856-4443-8ef0-47e4bd298553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b59f921821d344e28ec3b66b8e2aebae'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:06.237462 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-d086cd49-3856-4443-8ef0-47e4bd298553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b59f921821d344e28ec3b66b8e2aebae'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:06.238075 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-d086cd49-3856-4443-8ef0-47e4bd298553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b59f921821d344e28ec3b66b8e2aebae'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:06.249508 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-d086cd49-3856-4443-8ef0-47e4bd298553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b59f921821d344e28ec3b66b8e2aebae'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:06.256604 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-d086cd49-3856-4443-8ef0-47e4bd298553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b59f921821d344e28ec3b66b8e2aebae'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:06.269426 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1400/2800] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:16:06 2021] DELETE /identity/v3/users/b59f921821d344e28ec3b66b8e2aebae => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:16:06.546525 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803a340-5d8a-4f02-a353-fdd619b7957b admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:06.548076 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-6803a340-5d8a-4f02-a353-fdd619b7957b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:06.564053 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803a340-5d8a-4f02-a353-fdd619b7957b admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:06.620120 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0388f3-abc1-4501-95de-323b0199bae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:06.620981 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0388f3-abc1-4501-95de-323b0199bae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:06.621262 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0388f3-abc1-4501-95de-323b0199bae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:06.621535 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0388f3-abc1-4501-95de-323b0199bae7 admin admin] PATH_INFO: `/v3/projects/e68fc9a3bb8a4ca29a0c3d207168f0a3` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:06.622694 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0388f3-abc1-4501-95de-323b0199bae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e68fc9a3bb8a4ca29a0c3d207168f0a3)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:06.624614 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0388f3-abc1-4501-95de-323b0199bae7 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:06.670047 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-3b0388f3-abc1-4501-95de-323b0199bae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e68fc9a3bb8a4ca29a0c3d207168f0a3', 'request_id': 'req-3b0388f3-abc1-4501-95de-323b0199bae7'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:06.675814 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-3b0388f3-abc1-4501-95de-323b0199bae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e68fc9a3bb8a4ca29a0c3d207168f0a3', 'request_id': 'req-3b0388f3-abc1-4501-95de-323b0199bae7'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:06.682594 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-3b0388f3-abc1-4501-95de-323b0199bae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e68fc9a3bb8a4ca29a0c3d207168f0a3', 'request_id': 'req-3b0388f3-abc1-4501-95de-323b0199bae7'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:06.693723 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-3b0388f3-abc1-4501-95de-323b0199bae7 admin admin] The token cache is being invalidate because project e68fc9a3bb8a4ca29a0c3d207168f0a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:16:06.694009 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-3b0388f3-abc1-4501-95de-323b0199bae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:06.694626 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-3b0388f3-abc1-4501-95de-323b0199bae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:06.696173 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1401/2801] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:16:06 2021] DELETE /identity/v3/projects/e68fc9a3bb8a4ca29a0c3d207168f0a3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 03:16:06.703678 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601a913-61b4-4615-a2a2-b58e55899586 None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:06.704143 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601a913-61b4-4615-a2a2-b58e55899586 None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:06.704277 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601a913-61b4-4615-a2a2-b58e55899586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:06.723221 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-c601a913-61b4-4615-a2a2-b58e55899586 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:16:06.724460 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-c601a913-61b4-4615-a2a2-b58e55899586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:06.782622 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1401/2802] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:16:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:16:06.790876 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a86738-d448-4b8d-a1c1-74bfe50134bb None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:06.791176 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a86738-d448-4b8d-a1c1-74bfe50134bb None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:06.791480 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a86738-d448-4b8d-a1c1-74bfe50134bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:06.810082 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-95a86738-d448-4b8d-a1c1-74bfe50134bb None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:16:06.811386 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-95a86738-d448-4b8d-a1c1-74bfe50134bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:06.820072 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1402/2803] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:16:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:16:06.824071 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601a913-61b4-4615-a2a2-b58e55899586 None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:06.833455 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601a913-61b4-4615-a2a2-b58e55899586 None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:06.838146 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10538a-adc8-42f6-997d-97fe66028f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:06.838800 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10538a-adc8-42f6-997d-97fe66028f3d admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:06.839078 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10538a-adc8-42f6-997d-97fe66028f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:06.839352 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10538a-adc8-42f6-997d-97fe66028f3d admin admin] PATH_INFO: `/v3/domains` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:06.840092 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10538a-adc8-42f6-997d-97fe66028f3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 03:16:06.840396 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10538a-adc8-42f6-997d-97fe66028f3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:06.841964 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10538a-adc8-42f6-997d-97fe66028f3d admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:06.853357 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1402/2804] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Aug 31 03:16:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 03:16:06.857433 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a86738-d448-4b8d-a1c1-74bfe50134bb None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:06.867126 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a86738-d448-4b8d-a1c1-74bfe50134bb None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:06.871889 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec64d4d-b205-463d-b6d8-ef86926b25c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:06.872533 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec64d4d-b205-463d-b6d8-ef86926b25c6 admin admin] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:06.872816 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec64d4d-b205-463d-b6d8-ef86926b25c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:06.873109 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec64d4d-b205-463d-b6d8-ef86926b25c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:06.873772 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec64d4d-b205-463d-b6d8-ef86926b25c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:06.875699 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec64d4d-b205-463d-b6d8-ef86926b25c6 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:06.900592 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1403/2805] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Aug 31 03:16:06 2021] POST /identity/v3/projects => generated 361 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:16:06.904545 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10538a-adc8-42f6-997d-97fe66028f3d admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:06.914194 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10538a-adc8-42f6-997d-97fe66028f3d admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:06.967418 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad2ab1-5d30-47ad-89a6-255da6a4a958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:06.968072 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad2ab1-5d30-47ad-89a6-255da6a4a958 admin admin] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:06.968359 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad2ab1-5d30-47ad-89a6-255da6a4a958 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:06.968639 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad2ab1-5d30-47ad-89a6-255da6a4a958 admin admin] PATH_INFO: `/v3/users` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:06.969328 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad2ab1-5d30-47ad-89a6-255da6a4a958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:06.971458 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad2ab1-5d30-47ad-89a6-255da6a4a958 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:06.996964 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1403/2806] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Aug 31 03:16:06 2021] POST /identity/v3/users => generated 281 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 03:16:06.998237 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec64d4d-b205-463d-b6d8-ef86926b25c6 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:07.009350 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec64d4d-b205-463d-b6d8-ef86926b25c6 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:07.014240 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37c214-a79f-41e4-a506-5689e3099adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:07.014890 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37c214-a79f-41e4-a506-5689e3099adc admin admin] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:07.015169 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37c214-a79f-41e4-a506-5689e3099adc admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:07.015484 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37c214-a79f-41e4-a506-5689e3099adc admin admin] PATH_INFO: `/v3/roles` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:07.016197 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37c214-a79f-41e4-a506-5689e3099adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:07.017771 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37c214-a79f-41e4-a506-5689e3099adc admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:07.028202 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1404/2807] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:16:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:16:07.032149 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad2ab1-5d30-47ad-89a6-255da6a4a958 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:07.042525 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad2ab1-5d30-47ad-89a6-255da6a4a958 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:07.047049 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ad12a-570d-4c35-b9df-871b276452e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:07.047741 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ad12a-570d-4c35-b9df-871b276452e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:07.048025 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ad12a-570d-4c35-b9df-871b276452e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:07.048298 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ad12a-570d-4c35-b9df-871b276452e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:07.049014 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ad12a-570d-4c35-b9df-871b276452e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:07.051350 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ad12a-570d-4c35-b9df-871b276452e3 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:07.061051 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1404/2808] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Aug 31 03:16:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 03:16:07.065099 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37c214-a79f-41e4-a506-5689e3099adc admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:07.075006 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37c214-a79f-41e4-a506-5689e3099adc admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:07.079682 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25664443-4145-41da-8968-331a4de98431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:07.080594 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25664443-4145-41da-8968-331a4de98431 admin admin] REQUEST_METHOD: `PUT` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:07.081042 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25664443-4145-41da-8968-331a4de98431 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:07.081322 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25664443-4145-41da-8968-331a4de98431 admin admin] PATH_INFO: `/v3/projects/f79abaf1c1424234adf38cb4634ac85f/users/eb5dd0d9f5bb4d55b3310075a38a0401/roles/fd3d7d578a52485f96ce76c2bbe1360d` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:07.095492 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25664443-4145-41da-8968-331a4de98431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79abaf1c1424234adf38cb4634ac85f, user_id=eb5dd0d9f5bb4d55b3310075a38a0401, role_id=fd3d7d578a52485f96ce76c2bbe1360d)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:07.098663 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25664443-4145-41da-8968-331a4de98431 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:07.111262 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1405/2809] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Aug 31 03:16:07 2021] PUT /identity/v3/projects/f79abaf1c1424234adf38cb4634ac85f/users/eb5dd0d9f5bb4d55b3310075a38a0401/roles/fd3d7d578a52485f96ce76c2bbe1360d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:16:07.121919 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847f903-8f8d-4f06-b825-e30044f2945a None None] REQUEST_METHOD: `POST` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:07.122208 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847f903-8f8d-4f06-b825-e30044f2945a None None] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:07.122485 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847f903-8f8d-4f06-b825-e30044f2945a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:07.148034 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.auth.core [None req-f847f903-8f8d-4f06-b825-e30044f2945a None None] MFA Rules not processed for user `eb5dd0d9f5bb4d55b3310075a38a0401`. Rule list: `[]` (Enabled: `True`). {{(pid=73350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:16:07.149226 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-f847f903-8f8d-4f06-b825-e30044f2945a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:07.211565 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1405/2810] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:16:07 2021] POST /identity/v3/auth/tokens => generated 3381 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:16:07.222252 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25664443-4145-41da-8968-331a4de98431 admin admin] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:07.223962 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-25664443-4145-41da-8968-331a4de98431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:07.277913 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25664443-4145-41da-8968-331a4de98431 admin admin] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:07.281672 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedeaff-9f91-4228-920d-9295a0fd9b07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e701dd89a844fe9aa21c3b5e1fc59cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:07.282309 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedeaff-9f91-4228-920d-9295a0fd9b07 service cinder] REQUEST_METHOD: `GET` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:07.282591 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedeaff-9f91-4228-920d-9295a0fd9b07 service cinder] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:07.282870 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedeaff-9f91-4228-920d-9295a0fd9b07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:07.291584 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedeaff-9f91-4228-920d-9295a0fd9b07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:07.293067 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedeaff-9f91-4228-920d-9295a0fd9b07 service cinder] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:07.302388 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1406/2811] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:16:07 2021] GET /identity/v3/auth/tokens => generated 3381 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 03:16:43.190285 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847f903-8f8d-4f06-b825-e30044f2945a None None] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:43.249299 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847f903-8f8d-4f06-b825-e30044f2945a None None] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:43.254648 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fa310-d7fe-4e07-bf33-cbc217a9b413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:43.255532 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fa310-d7fe-4e07-bf33-cbc217a9b413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:43.255812 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fa310-d7fe-4e07-bf33-cbc217a9b413 admin admin] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:43.256086 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fa310-d7fe-4e07-bf33-cbc217a9b413 admin admin] PATH_INFO: `/v3/users/eb5dd0d9f5bb4d55b3310075a38a0401` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:43.257253 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fa310-d7fe-4e07-bf33-cbc217a9b413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb5dd0d9f5bb4d55b3310075a38a0401)` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:43.259220 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fa310-d7fe-4e07-bf33-cbc217a9b413 admin admin] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:43.302267 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b32fa310-d7fe-4e07-bf33-cbc217a9b413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb5dd0d9f5bb4d55b3310075a38a0401'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:43.302907 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b32fa310-d7fe-4e07-bf33-cbc217a9b413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb5dd0d9f5bb4d55b3310075a38a0401'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:43.303557 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b32fa310-d7fe-4e07-bf33-cbc217a9b413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb5dd0d9f5bb4d55b3310075a38a0401'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:43.315308 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b32fa310-d7fe-4e07-bf33-cbc217a9b413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb5dd0d9f5bb4d55b3310075a38a0401'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:43.322091 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.notifications [None req-b32fa310-d7fe-4e07-bf33-cbc217a9b413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb5dd0d9f5bb4d55b3310075a38a0401'} {{(pid=73350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:43.334641 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1406/2812] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Aug 31 03:16:43 2021] DELETE /identity/v3/users/eb5dd0d9f5bb4d55b3310075a38a0401 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:16:43.339421 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdc53f-ccb3-4e91-8f10-4e6c6ad55ee0 None None] REQUEST_METHOD: `POST` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:43.339948 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdc53f-ccb3-4e91-8f10-4e6c6ad55ee0 None None] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:43.340051 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdc53f-ccb3-4e91-8f10-4e6c6ad55ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:43.357209 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.auth.core [None req-52fdc53f-ccb3-4e91-8f10-4e6c6ad55ee0 None None] MFA Rules not processed for user `2a89afdaf4304b8588d33fcfb779c592`. Rule list: `[]` (Enabled: `True`). {{(pid=73351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 03:16:43.358398 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-52fdc53f-ccb3-4e91-8f10-4e6c6ad55ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:43.416016 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1407/2813] 10.222.0.39 () {58 vars in 958 bytes} [Tue Aug 31 03:16:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 03:16:43.425893 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fa310-d7fe-4e07-bf33-cbc217a9b413 admin admin] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:43.427352 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-b32fa310-d7fe-4e07-bf33-cbc217a9b413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:43.482272 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fa310-d7fe-4e07-bf33-cbc217a9b413 admin admin] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:43.486375 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86436d82-6f91-4d5d-b647-78781b29ad0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18b73b8e7244410b8f701b2ab43c5979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:43.487014 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86436d82-6f91-4d5d-b647-78781b29ad0a service neutron] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:43.487294 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86436d82-6f91-4d5d-b647-78781b29ad0a service neutron] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:43.487592 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86436d82-6f91-4d5d-b647-78781b29ad0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:43.496308 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86436d82-6f91-4d5d-b647-78781b29ad0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:43.497712 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86436d82-6f91-4d5d-b647-78781b29ad0a service neutron] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:43.507276 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1407/2814] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:16:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 03:16:43.776331 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdc53f-ccb3-4e91-8f10-4e6c6ad55ee0 None None] Authenticating user token {{(pid=73351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:16:43.777838 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.fernet_utils [None req-52fdc53f-ccb3-4e91-8f10-4e6c6ad55ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:16:43.791243 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdc53f-ccb3-4e91-8f10-4e6c6ad55ee0 None None] Validating token access rules against request {{(pid=73351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:16:43.796663 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528febd-b9ba-46c9-9abd-02de79345ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a89afdaf4304b8588d33fcfb779c592', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8eb33f1e09d7463d8975fc4c37c2e87b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:16:43.797531 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528febd-b9ba-46c9-9abd-02de79345ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:16:43.797808 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528febd-b9ba-46c9-9abd-02de79345ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:16:43.798052 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528febd-b9ba-46c9-9abd-02de79345ed8 admin admin] PATH_INFO: `/v3/projects/f79abaf1c1424234adf38cb4634ac85f` {{(pid=73351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:16:43.799954 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528febd-b9ba-46c9-9abd-02de79345ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f79abaf1c1424234adf38cb4634ac85f)` {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:16:43.801859 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528febd-b9ba-46c9-9abd-02de79345ed8 admin admin] RBAC: Authorization granted {{(pid=73351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:16:43.846732 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2528febd-b9ba-46c9-9abd-02de79345ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f79abaf1c1424234adf38cb4634ac85f', 'request_id': 'req-2528febd-b9ba-46c9-9abd-02de79345ed8'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:43.851907 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2528febd-b9ba-46c9-9abd-02de79345ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f79abaf1c1424234adf38cb4634ac85f', 'request_id': 'req-2528febd-b9ba-46c9-9abd-02de79345ed8'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:43.859628 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2528febd-b9ba-46c9-9abd-02de79345ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f79abaf1c1424234adf38cb4634ac85f', 'request_id': 'req-2528febd-b9ba-46c9-9abd-02de79345ed8'} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:43.870906 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2528febd-b9ba-46c9-9abd-02de79345ed8 admin admin] The token cache is being invalidate because project f79abaf1c1424234adf38cb4634ac85f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 03:16:43.871194 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2528febd-b9ba-46c9-9abd-02de79345ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:43.871853 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: DEBUG keystone.notifications [None req-2528febd-b9ba-46c9-9abd-02de79345ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 03:16:43.873376 dv-cinder-806665-1-iscsi devstack@keystone.service[73351]: [pid: 73351|app: 0|req: 1408/2815] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Aug 31 03:16:43 2021] DELETE /identity/v3/projects/f79abaf1c1424234adf38cb4634ac85f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 03:17:20.755927 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86436d82-6f91-4d5d-b647-78781b29ad0a service neutron] Authenticating user token {{(pid=73350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 03:17:20.757344 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-86436d82-6f91-4d5d-b647-78781b29ad0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:17:20.890334 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86436d82-6f91-4d5d-b647-78781b29ad0a service neutron] Validating token access rules against request {{(pid=73350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 03:17:20.946625 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45dae3-04b0-46fd-be4a-61e2e837f1ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbcf0359f8bc4f55be3307f235f8aac5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '011ec8d2410644a3b7d51a90f803b441', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 03:17:20.947254 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45dae3-04b0-46fd-be4a-61e2e837f1ea service placement] REQUEST_METHOD: `GET` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 03:17:20.947564 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45dae3-04b0-46fd-be4a-61e2e837f1ea service placement] SCRIPT_NAME: `/identity` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 03:17:20.948074 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45dae3-04b0-46fd-be4a-61e2e837f1ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 03:17:20.949820 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.fernet_utils [None req-ca45dae3-04b0-46fd-be4a-61e2e837f1ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 03:17:20.961457 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45dae3-04b0-46fd-be4a-61e2e837f1ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 03:17:20.962994 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45dae3-04b0-46fd-be4a-61e2e837f1ea service placement] RBAC: Authorization granted {{(pid=73350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 03:17:20.972785 dv-cinder-806665-1-iscsi devstack@keystone.service[73350]: [pid: 73350|app: 0|req: 1408/2816] 10.222.0.39 () {60 vars in 1366 bytes} [Tue Aug 31 03:17:20 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)